-- Logs begin at Tue 2022-08-09 18:08:41 UTC, end at Tue 2022-08-09 19:38:58 UTC. -- Aug 09 18:58:35.011286 dv-cinder-852654-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 09 18:58:35.021208 dv-cinder-852654-1-smb devstack@keystone.service[80513]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 09 18:58:35.021787 dv-cinder-852654-1-smb devstack@keystone.service[80513]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 18:58:35 2022] *** Aug 09 18:58:35.021787 dv-cinder-852654-1-smb devstack@keystone.service[80513]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 18:58:35.021787 dv-cinder-852654-1-smb devstack@keystone.service[80513]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 18:58:35.021787 dv-cinder-852654-1-smb devstack@keystone.service[80513]: nodename: dv-cinder-852654-1-smb Aug 09 18:58:35.021787 dv-cinder-852654-1-smb devstack@keystone.service[80513]: machine: x86_64 Aug 09 18:58:35.021787 dv-cinder-852654-1-smb devstack@keystone.service[80513]: clock source: unix Aug 09 18:58:35.021787 dv-cinder-852654-1-smb devstack@keystone.service[80513]: pcre jit disabled Aug 09 18:58:35.021787 dv-cinder-852654-1-smb devstack@keystone.service[80513]: detected number of CPU cores: 4 Aug 09 18:58:35.021787 dv-cinder-852654-1-smb devstack@keystone.service[80513]: current working directory: / Aug 09 18:58:35.021787 dv-cinder-852654-1-smb devstack@keystone.service[80513]: detected binary path: /usr/bin/uwsgi-core Aug 09 18:58:35.021787 dv-cinder-852654-1-smb devstack@keystone.service[80513]: your processes number limit is 47680 Aug 09 18:58:35.021787 dv-cinder-852654-1-smb devstack@keystone.service[80513]: your memory page size is 4096 bytes Aug 09 18:58:35.021787 dv-cinder-852654-1-smb devstack@keystone.service[80513]: detected max file descriptor number: 2048 Aug 09 18:58:35.021787 dv-cinder-852654-1-smb devstack@keystone.service[80513]: lock engine: pthread robust mutexes Aug 09 18:58:35.023033 dv-cinder-852654-1-smb devstack@keystone.service[80513]: thunder lock: enabled Aug 09 18:58:35.023033 dv-cinder-852654-1-smb devstack@keystone.service[80513]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 09 18:58:35.023033 dv-cinder-852654-1-smb devstack@keystone.service[80513]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 18:58:35.062376 dv-cinder-852654-1-smb devstack@keystone.service[80513]: Python main interpreter initialized at 0x55a5c5fac9c0 Aug 09 18:58:35.062376 dv-cinder-852654-1-smb devstack@keystone.service[80513]: python threads support enabled Aug 09 18:58:35.062376 dv-cinder-852654-1-smb devstack@keystone.service[80513]: your server socket listen backlog is limited to 100 connections Aug 09 18:58:35.062376 dv-cinder-852654-1-smb devstack@keystone.service[80513]: your mercy for graceful operations on workers is 90 seconds Aug 09 18:58:35.062730 dv-cinder-852654-1-smb devstack@keystone.service[80513]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 18:58:35.062805 dv-cinder-852654-1-smb devstack@keystone.service[80513]: *** Operational MODE: preforking *** Aug 09 18:58:35.063064 dv-cinder-852654-1-smb devstack@keystone.service[80513]: *** uWSGI is running in multiple interpreter mode *** Aug 09 18:58:35.063064 dv-cinder-852654-1-smb devstack@keystone.service[80513]: spawned uWSGI master process (pid: 80513) Aug 09 18:58:35.063270 dv-cinder-852654-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 09 18:58:35.064080 dv-cinder-852654-1-smb devstack@keystone.service[80513]: spawned uWSGI worker 1 (pid: 80523, cores: 1) Aug 09 18:58:35.064185 dv-cinder-852654-1-smb devstack@keystone.service[80513]: spawned uWSGI worker 2 (pid: 80524, cores: 1) Aug 09 18:58:35.065668 dv-cinder-852654-1-smb devstack@keystone.service[80513]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 18:58:40.624186 dv-cinder-852654-1-smb devstack@keystone.service[80523]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:58:40.624186 dv-cinder-852654-1-smb devstack@keystone.service[80523]: from cryptography.utils import int_from_bytes Aug 09 18:58:40.624972 dv-cinder-852654-1-smb devstack@keystone.service[80523]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:58:40.624972 dv-cinder-852654-1-smb devstack@keystone.service[80523]: from cryptography.utils import int_from_bytes Aug 09 18:58:40.625082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:58:40.625082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: from cryptography.utils import int_from_bytes Aug 09 18:58:40.625082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 18:58:40.625082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: from cryptography.utils import int_from_bytes Aug 09 18:58:40.674866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 18:58:40.675050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 18:58:40.675240 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] command line args: [] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 18:58:40.675463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 18:58:40.675555 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 18:58:40.675676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 18:58:40.675761 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ================================================================================ {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 18:58:40.675902 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] command line args: [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 18:58:40.675986 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] admin_token = **** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.676165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] config_dir = [] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.676242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 18:58:40.676355 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.676438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ================================================================================ {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 18:58:40.676538 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] config_source = [] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.676695 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] admin_token = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.676784 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] debug = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.676907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.677161 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] config_dir = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.677281 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.677383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.677520 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.677621 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] config_source = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.677768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] debug = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.677874 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.677980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.678106 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.678209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] list_limit = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.678300 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.678391 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] log_config_append = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.678483 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.678573 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.678677 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] log_dir = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.678770 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.678868 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] log_file = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.679057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.679652 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.679826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.680041 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.680127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.680315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.680436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_config_append = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.680552 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.680628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.680750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.680831 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_dir = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.680907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.681021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_file = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.681130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.681310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.681393 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.681614 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.681691 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.681852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.681984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.682072 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.682296 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.682423 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.682506 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.682577 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.682694 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.682819 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.682930 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.683228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.683311 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.683477 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] publish_errors = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.683559 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.683711 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.683827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.683943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.684117 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.684295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.684379 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.684493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.684586 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.684734 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.684817 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] standard_threads = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.685041 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.685118 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.685286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.685478 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.685567 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.685659 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] use_journal = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.685833 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] use_json = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.686009 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] use_stderr = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.686091 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.686171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] use_syslog = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.686286 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] publish_errors = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.686407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.686595 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.686672 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.686894 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.686976 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.687112 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.687188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.687383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.687465 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.687640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.687724 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.687880 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.688032 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] standard_threads = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.688130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.688340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.688494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.688606 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.688682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.688859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.688936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.689073 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] use_journal = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.689156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.689289 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] use_json = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.689367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.689523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] use_stderr = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.689604 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.689740 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] use_syslog = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.689826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.690045 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 18:58:40.690122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.690313 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.690396 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.690557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.690680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.690817 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.691066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.691148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.691315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.691398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.691556 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.691769 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.691860 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.692064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.692140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.692321 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.692468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.692572 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.692800 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.692882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.693035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.693174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.693271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.693539 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.693618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.693813 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.693891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.694110 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.694275 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.694385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.694659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.695431 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.695518 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.695715 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.695938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.696022 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.696265 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.696341 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.696598 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.696687 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.696910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.696993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.697225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.697301 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.697516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.697611 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.697766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.697892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.698038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.698153 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.698308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.698460 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.698567 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.698768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.698844 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.699052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.699127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.699291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.699405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.699528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.699700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.699776 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.700010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.700095 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.700263 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.700344 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.700501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.700609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.700738 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.700906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.701012 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.701229 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.701331 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.701525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.701641 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.701787 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.701891 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.702026 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.702163 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.702270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.702474 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.702563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.702737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.702820 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.702975 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.703093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.703212 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.703373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.703459 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.703678 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.703762 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.703932 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.704016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.704170 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.704296 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.704410 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.704592 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.704682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.704872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.704988 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.705112 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.705267 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.705352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.705585 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.705675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.705844 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.705929 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.706087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.706194 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.706329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.706546 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.706626 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.706801 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.706878 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.707037 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.707178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.707292 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.707469 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.707555 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.707774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.707850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.708013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.708103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.708280 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.708365 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.708524 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.708683 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.708765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.708992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.709067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.709236 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.709322 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.709537 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.709650 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.709784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.709929 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.710040 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.710242 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.710352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.710571 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.710815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.710892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.711057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.711152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.711309 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.711458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.711542 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.711780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.711856 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.712028 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.712108 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.712270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.712403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.712500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.712718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.712804 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.712969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.713046 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.713209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.713335 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.713536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.713685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.713791 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.713995 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.714072 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.714266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.714342 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.714514 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.714593 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.714758 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.714876 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.714999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.715186 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.715271 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.715463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.715540 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.715699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.715776 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.715934 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.716087 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.716165 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.716396 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.716472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.716642 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.716719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.716882 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.717026 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.717133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.717381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.717484 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.717670 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.717757 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.717937 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.718059 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] auth.external = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.718187 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.718337 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.718413 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.external = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.718649 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.718843 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.718949 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.719136 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.719222 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.719401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.password = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.719477 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] auth.password = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.719636 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] auth.token = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.719721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] auth.token = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.719880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.720037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.720114 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.720348 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.720425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.720582 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.720671 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.720835 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.720968 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.721085 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.721323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.721409 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.721590 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.721848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.721925 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.722109 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.722220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.722364 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.722465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] credential.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.722607 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.722719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.722858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.722972 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.723098 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.723225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.723366 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.723466 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.723625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.723711 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.723869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.723947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.724128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.724205 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.724418 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.724503 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.724664 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.724749 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.724919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.725102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.725181 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.725327 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.725403 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.725504 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.725670 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.725748 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.725911 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.726040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.726206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.726288 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.726460 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.726538 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] federation.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.726696 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.726782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.726950 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.727028 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.727195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.727273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.727437 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.727523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.727687 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.727766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.727931 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.728009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.728173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.728261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.728415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.728492 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.728654 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.728730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.728895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.728980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.729145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.729224 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.729419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.729543 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.729690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.729783 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.729943 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.730022 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.730180 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.730259 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.730422 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.730507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.730672 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.730750 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.730910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.730987 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.731149 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.731236 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.731384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.731460 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.731620 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.731697 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.731863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.731948 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.732098 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.732176 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.732337 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.732415 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.732584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.732675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.732835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.732920 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.733086 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.733165 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.733345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.733425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.733615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.733693 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.733854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.733931 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.734096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.734176 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.734331 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.734409 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.734565 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.734641 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.734806 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.734886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.735041 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.735120 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.735280 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.735358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.735515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.735594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.735756 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.735833 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.736006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.736084 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.736240 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.736319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.736489 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.736575 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.736736 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.736813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.736970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.737049 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.737211 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.737289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.737493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.737575 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.737716 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.737796 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.737958 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.738035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.738191 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.738274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.738433 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.738512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.738672 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.738749 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.738918 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.738996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.739161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.739240 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.739398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.739475 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.739636 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.739714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.739885 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.739963 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.740128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.740212 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.740363 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.740441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.740605 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.740683 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.740845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.740923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.741082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.741160 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.741320 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.741405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.742222 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.742321 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.742385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.742444 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.742568 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.742696 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.742924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.743004 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.743162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.743240 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.743412 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.743492 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.743657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.743740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.743898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.743976 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.744137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.744216 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.744379 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.744456 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.744617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.744695 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.744871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.744951 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.745109 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.745185 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.745346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.745424 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.745621 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.745703 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.745871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.745949 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.746110 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.746187 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.746362 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.746441 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.746605 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.746682 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.746847 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.746924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.747089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.747168 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.747329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.747407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.747578 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.747655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.747818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.747898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.748059 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.748138 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.748308 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.748402 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.748543 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.748620 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.748820 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.748898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.749063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.749211 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.749288 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.749359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.749561 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.749875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.749875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.750038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.750112 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.750183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.750254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.750324 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.750489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.750578 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.750742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.750821 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.750980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.751059 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.751221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.751308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.751465 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.751542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] resource.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.751715 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.751792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.751964 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.752050 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.752202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.752280 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.752453 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.752529 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.752692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.752777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.752928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.753006 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.753165 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] role.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.753243 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.753402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.753505 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] role.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.753667 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.753745 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.753904 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] role.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.753981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.754152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] role.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.754237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.754385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.754464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.754636 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.754714 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.754926 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.755020 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.755133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.755213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.755382 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.755460 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.755629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.755716 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.755866 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.755944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.756111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.756192 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.756360 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.756448 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.756596 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.756674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.756842 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.756919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.757088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.757903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.757994 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.758159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.758405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.758561 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.758677 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.758802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.758942 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.759053 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.759307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.759633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.759821 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.759926 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.760067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.760183 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.760328 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.760406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.760589 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.760669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.760839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.760917 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.761082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.761160 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.761323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.761403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.761590 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.761670 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.761836 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.761914 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.762090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.762170 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.762343 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.762420 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.762588 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.762666 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.762827 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.762905 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.763063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.763139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.763296 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.763372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.763535 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] token.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.763614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.763777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.763856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.764017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.764093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.764262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.764340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.764521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.764598 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.764771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.764848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.765011 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.765091 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.765259 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.765335 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.765528 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.765610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.765773 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.765852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.766013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.766089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.766252 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.766328 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.766491 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.766569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.766741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.766819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.766978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.767054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.767216 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.767294 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.767463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.767541 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.767757 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.767835 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.connection = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.768014 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.768104 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.connection = **** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.768261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.768348 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.768490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.768565 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.768734 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.768813 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.768975 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.769056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.769213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.769290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.769463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.769541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.769712 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.769792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.769952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.770031 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.770192 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.770269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.770429 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.770508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.770668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.770750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.770902 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.770979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.771146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.771225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.771383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.771459 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.771621 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.771698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.771853 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.771931 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.772092 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.772175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.772247 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 18:58:40.772319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 18:58:40.772487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 18:58:40.801376 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:40.801638 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:40.801831 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:40.801915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:40.802066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:40.802295 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:40.812251 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:40.812750 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:40.841244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:40.841493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:40.841719 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:40.841957 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:40.894680 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:40.895258 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:40.945650 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:40.945883 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:40.946426 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:40.946666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.011644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.011816 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.012039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.012218 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.012304 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.012456 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.012538 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.012671 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.012753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.012891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.013133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.013355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.035798 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.036008 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.036103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.036208 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.036291 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.036436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.036530 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.036653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.036734 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.036868 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.036948 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.037080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.037162 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.037293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.048735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.049104 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.062644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.062873 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.062966 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.063099 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.063184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.063327 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.063419 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.063547 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.063628 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.063764 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.063844 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.063978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.064156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80523) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.064233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 18:58:41.080877 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.081087 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 18:58:41.081432 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.081566 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.081648 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 18:58:41.081724 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 18:58:41.081920 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.082003 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.082186 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.082274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 18:58:41.082451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.082533 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.082711 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.082794 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.082992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.083255 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.094111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.094397 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.094671 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.094950 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.095035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.095261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.095508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.095798 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.102448 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.103402 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.105535 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.105832 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.106130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.106422 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.106560 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.106702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.106832 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.106959 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.107085 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.107219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.107376 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.107503 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.107678 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.107807 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.107942 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.108066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.108203 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.108331 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.108490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.108767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.109054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.109328 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.131819 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.133188 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.133605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.133898 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.134997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.135288 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.138743 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.139034 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.139319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.139904 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.140196 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.140493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.145893 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.146189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.147096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.147392 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.150580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.150875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.151165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.151456 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.151580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.151739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.151866 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.152022 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.152155 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.152279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.152412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.152535 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.152666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.152887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.153166 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.153441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.168885 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.169170 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.169826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.170115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.173411 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.174380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.176583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.176886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.177565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.177870 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.181947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.182943 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.185101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.186147 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.188280 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.188587 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.188891 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.189197 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.189308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.189556 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.189647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.189850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.189934 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.190192 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.190479 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.190783 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.205867 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.206164 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.206439 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.206710 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.206791 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.207016 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.207292 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.207562 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.213657 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.214629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.215236 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.215518 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.216206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.216492 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.218370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.218659 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.218964 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.219260 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.219354 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.219545 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.219629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.219905 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.220203 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.220486 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.231536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.231825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.232111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.232400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.238741 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.238821 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.238884 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.238945 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.239006 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.239067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.239141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.239141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.239141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.239141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.250545 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.251683 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.253515 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.254681 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.256455 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.257742 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.258422 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.259327 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.260200 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.260488 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.260785 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.261109 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.261410 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.261782 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.267204 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.268253 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.268814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.269911 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.271786 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.272083 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.272377 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.272662 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.272917 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.273261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.273580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.273868 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.280911 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.281255 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.281576 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.282051 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.282398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.282695 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.288389 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80523) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.289235 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.289551 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.289837 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.290116 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.290392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.290590 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 18:58:41.290681 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.290884 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.290975 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.291180 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.291316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.291468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.291593 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.291751 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.291870 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.292042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.292154 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.292325 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.292427 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.292603 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.292700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80523) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.292992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.293282 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.293588 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.293872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.294159 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.294431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 18:58:41.326525 dv-cinder-852654-1-smb devstack@keystone.service[80523]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a5c5fac9c0 pid: 80523 (default app) Aug 09 18:58:41.328489 dv-cinder-852654-1-smb devstack@keystone.service[80524]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a5c5fac9c0 pid: 80524 (default app) Aug 09 18:58:41.329845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad304b3-0b3e-44cb-8de4-6e6b73fc816a None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:41.330133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad304b3-0b3e-44cb-8de4-6e6b73fc816a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:41.330407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad304b3-0b3e-44cb-8de4-6e6b73fc816a None None] PATH_INFO: `/v3` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:41.334697 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 791 bytes} [Tue Aug 9 18:58:41 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:58:49.948631 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467c688-6d98-4f1b-bdc6-2206c64e05b4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:49.949240 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467c688-6d98-4f1b-bdc6-2206c64e05b4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:49.949240 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467c688-6d98-4f1b-bdc6-2206c64e05b4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:49.953609 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1/2] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:58:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 18:58:49.958945 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad8a73-c7ff-4bba-be0b-2abd8b2f8569 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:49.959387 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad8a73-c7ff-4bba-be0b-2abd8b2f8569 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:49.959478 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad8a73-c7ff-4bba-be0b-2abd8b2f8569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:50.033600 dv-cinder-852654-1-smb devstack@keystone.service[80523]: INFO dbcounter [None req-e5ad8a73-c7ff-4bba-be0b-2abd8b2f8569 None None] Registered counter for database keystone Aug 09 18:58:50.053032 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG oslo_db.sqlalchemy.engines [None req-e5ad8a73-c7ff-4bba-be0b-2abd8b2f8569 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:58:50.060874 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writer thread running {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:58:50.243793 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG passlib.handlers.bcrypt [None req-e5ad8a73-c7ff-4bba-be0b-2abd8b2f8569 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80523) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 09 18:58:50.244120 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG passlib.handlers.bcrypt [None req-e5ad8a73-c7ff-4bba-be0b-2abd8b2f8569 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80523) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 09 18:58:50.299589 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-e5ad8a73-c7ff-4bba-be0b-2abd8b2f8569 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:58:50.301194 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e5ad8a73-c7ff-4bba-be0b-2abd8b2f8569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:58:50.433268 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:58:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 09 18:58:50.549773 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467c688-6d98-4f1b-bdc6-2206c64e05b4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:50.618490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: INFO dbcounter [None req-3467c688-6d98-4f1b-bdc6-2206c64e05b4 None None] Registered counter for database keystone Aug 09 18:58:50.639534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG oslo_db.sqlalchemy.engines [None req-3467c688-6d98-4f1b-bdc6-2206c64e05b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 18:58:50.645537 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writer thread running {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 18:58:50.763157 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467c688-6d98-4f1b-bdc6-2206c64e05b4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:50.767298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3f597-6850-454c-85b8-056220cc77fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:50.767911 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3f597-6850-454c-85b8-056220cc77fa admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:50.768189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3f597-6850-454c-85b8-056220cc77fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:50.768460 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3f597-6850-454c-85b8-056220cc77fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:50.776490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3f597-6850-454c-85b8-056220cc77fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:58:50.829103 dv-cinder-852654-1-smb devstack@keystone.service[80524]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e8c3f597-6850-454c-85b8-056220cc77fa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 09 18:58:50.829445 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3f597-6850-454c-85b8-056220cc77fa admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:58:50.839268 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1324 bytes} [Tue Aug 9 18:58:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 18:58:50.845219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad8a73-c7ff-4bba-be0b-2abd8b2f8569 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:50.859703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad8a73-c7ff-4bba-be0b-2abd8b2f8569 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:50.864107 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12961b-9587-4faa-b960-c3861efb548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:50.865199 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12961b-9587-4faa-b960-c3861efb548e admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:50.865504 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12961b-9587-4faa-b960-c3861efb548e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:50.865781 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12961b-9587-4faa-b960-c3861efb548e admin admin] PATH_INFO: `/v3/projects/fc0f9bf2f261408aa0230daf03acb9d1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:50.867229 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12961b-9587-4faa-b960-c3861efb548e admin admin] RBAC: Authorizing `identity:get_project(project_id=fc0f9bf2f261408aa0230daf03acb9d1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:58:50.919274 dv-cinder-852654-1-smb devstack@keystone.service[80523]: WARNING keystone.common.rbac_enforcer.enforcer [None req-dc12961b-9587-4faa-b960-c3861efb548e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 09 18:58:50.919618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12961b-9587-4faa-b960-c3861efb548e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:58:50.924160 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 3/5] 10.222.0.65 () {56 vars in 1207 bytes} [Tue Aug 9 18:58:50 2022] GET /identity/v3/projects/fc0f9bf2f261408aa0230daf03acb9d1 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:58:52.894119 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29ac64-0991-46df-9a63-1a25c10aca29 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:52.894677 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29ac64-0991-46df-9a63-1a25c10aca29 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:52.894677 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29ac64-0991-46df-9a63-1a25c10aca29 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:52.899657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 3/6] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:58:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 18:58:52.905050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ae22f-5bdb-43b0-96fd-121e0751c0fb None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:52.905436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ae22f-5bdb-43b0-96fd-121e0751c0fb None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:52.905637 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ae22f-5bdb-43b0-96fd-121e0751c0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:52.927318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-071ae22f-5bdb-43b0-96fd-121e0751c0fb None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:58:52.928878 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-071ae22f-5bdb-43b0-96fd-121e0751c0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:58:52.936695 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:58:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 09 18:58:52.958098 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29ac64-0991-46df-9a63-1a25c10aca29 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:52.970690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29ac64-0991-46df-9a63-1a25c10aca29 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:52.974828 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b7a78-953a-4b4c-891d-dee90b4c8578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:52.976243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b7a78-953a-4b4c-891d-dee90b4c8578 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:52.976527 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b7a78-953a-4b4c-891d-dee90b4c8578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:52.976800 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b7a78-953a-4b4c-891d-dee90b4c8578 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:52.984344 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b7a78-953a-4b4c-891d-dee90b4c8578 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:58:52.986134 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b7a78-953a-4b4c-891d-dee90b4c8578 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:58:52.994701 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1324 bytes} [Tue Aug 9 18:58:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 18:58:53.000036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ae22f-5bdb-43b0-96fd-121e0751c0fb None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:53.010065 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ae22f-5bdb-43b0-96fd-121e0751c0fb None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:53.014462 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574ecca-8a27-48c5-b0a3-cd4f6a34d212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:53.015079 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574ecca-8a27-48c5-b0a3-cd4f6a34d212 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:53.015361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574ecca-8a27-48c5-b0a3-cd4f6a34d212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:53.015635 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574ecca-8a27-48c5-b0a3-cd4f6a34d212 admin admin] PATH_INFO: `/v3/users/de54cc4aa2214403a8d5cfbff5af1478` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:53.016953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574ecca-8a27-48c5-b0a3-cd4f6a34d212 admin admin] RBAC: Authorizing `identity:get_user(user_id=de54cc4aa2214403a8d5cfbff5af1478)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:58:53.018796 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574ecca-8a27-48c5-b0a3-cd4f6a34d212 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:58:53.020286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 5/9] 10.222.0.65 () {56 vars in 1198 bytes} [Tue Aug 9 18:58:52 2022] GET /identity/v3/users/de54cc4aa2214403a8d5cfbff5af1478 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:58:55.070931 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7e5b8-6787-42f6-ab10-4c73d014d1df None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:55.071464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7e5b8-6787-42f6-ab10-4c73d014d1df None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:55.071464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7e5b8-6787-42f6-ab10-4c73d014d1df None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:55.072798 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 5/10] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:58:55.077848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674c77a-02ec-4387-b426-97b6c4a2fcfe None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:55.078238 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674c77a-02ec-4387-b426-97b6c4a2fcfe None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:55.078476 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674c77a-02ec-4387-b426-97b6c4a2fcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:55.095493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea52378-7a35-4758-97ed-cfd4197f89a4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:55.095775 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea52378-7a35-4758-97ed-cfd4197f89a4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:55.096048 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea52378-7a35-4758-97ed-cfd4197f89a4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:55.096860 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4674c77a-02ec-4387-b426-97b6c4a2fcfe None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:58:55.097340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 6/11] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:58:55.098078 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4674c77a-02ec-4387-b426-97b6c4a2fcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:58:55.102950 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa221f7e-8c61-495d-a0c3-c23bf31602b2 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:55.103229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa221f7e-8c61-495d-a0c3-c23bf31602b2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:55.103495 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa221f7e-8c61-495d-a0c3-c23bf31602b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:55.146584 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG passlib.handlers.bcrypt [None req-aa221f7e-8c61-495d-a0c3-c23bf31602b2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80524) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 09 18:58:55.147526 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG passlib.handlers.bcrypt [None req-aa221f7e-8c61-495d-a0c3-c23bf31602b2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80524) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 09 18:58:55.177104 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 6/12] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:58:55.193322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-aa221f7e-8c61-495d-a0c3-c23bf31602b2 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:58:55.195690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-aa221f7e-8c61-495d-a0c3-c23bf31602b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:58:55.201146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674c77a-02ec-4387-b426-97b6c4a2fcfe None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:55.223950 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:55.296797 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 7/13] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:58:55.312673 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674c77a-02ec-4387-b426-97b6c4a2fcfe None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:55.319150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa221f7e-8c61-495d-a0c3-c23bf31602b2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:55.347851 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8774039-9b46-43b8-aca2-042706edae50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:55.348420 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8774039-9b46-43b8-aca2-042706edae50 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:55.348704 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8774039-9b46-43b8-aca2-042706edae50 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:55.348977 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8774039-9b46-43b8-aca2-042706edae50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:55.360472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8774039-9b46-43b8-aca2-042706edae50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:58:55.369350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-f8774039-9b46-43b8-aca2-042706edae50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:58:55.369350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:58:55.369350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:58:55.369350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:58:55.369350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:58:55.369350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:58:55.369350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:58:55.369350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:58:55.369350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:58:55.369350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:58:55.369350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:58:55.369350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:58:55.369350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:58:55.369350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:58:55.369350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:58:55.369350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:58:55.370463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:58:55.370463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:58:55.370463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:58:55.370463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:58:55.370463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:58:55.370463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:58:55.370463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:58:55.370463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:58:55.370463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:58:55.370463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:58:55.370463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:58:55.370463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:58:55.370463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:58:55.370463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:58:55.370463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:58:55.370463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:58:55.371489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:58:55.371489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:58:55.371489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:58:55.371489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:58:55.371489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:58:55.371489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:58:55.371489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:58:55.371489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:58:55.371489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:58:55.371489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:58:55.371489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:58:55.371489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:58:55.371489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 7/14] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 18:58:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 18:58:55.376496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8774039-9b46-43b8-aca2-042706edae50 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:55.421960 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa221f7e-8c61-495d-a0c3-c23bf31602b2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:55.424264 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:55.459208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:55.459544 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa46bb-ec7c-4429-a331-7704d6f6c547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:55.460476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa46bb-ec7c-4429-a331-7704d6f6c547 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:55.460752 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa46bb-ec7c-4429-a331-7704d6f6c547 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:55.461022 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa46bb-ec7c-4429-a331-7704d6f6c547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:55.477669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8774039-9b46-43b8-aca2-042706edae50 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:55.512985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca5b77-fef4-4b87-afb9-e074c383190a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:55.513630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca5b77-fef4-4b87-afb9-e074c383190a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:55.513916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca5b77-fef4-4b87-afb9-e074c383190a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:55.514190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca5b77-fef4-4b87-afb9-e074c383190a None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:55.514862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca5b77-fef4-4b87-afb9-e074c383190a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:58:55.515168 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca5b77-fef4-4b87-afb9-e074c383190a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:58:55.516561 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca5b77-fef4-4b87-afb9-e074c383190a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:58:55.528380 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 8/15] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:58:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:58:55.532572 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa46bb-ec7c-4429-a331-7704d6f6c547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:58:55.534047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca5b77-fef4-4b87-afb9-e074c383190a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:55.534181 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa46bb-ec7c-4429-a331-7704d6f6c547 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:58:55.635255 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca5b77-fef4-4b87-afb9-e074c383190a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:55.635530 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 8/16] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:58:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 18:58:55.641167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa46bb-ec7c-4429-a331-7704d6f6c547 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:55.644073 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:55.748806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa46bb-ec7c-4429-a331-7704d6f6c547 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:55.778698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd550f-ee3a-4a0d-9173-858a623e7a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:55.779328 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd550f-ee3a-4a0d-9173-858a623e7a51 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:55.779609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd550f-ee3a-4a0d-9173-858a623e7a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:55.779883 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd550f-ee3a-4a0d-9173-858a623e7a51 None admin] PATH_INFO: `/v3/users/de54cc4aa2214403a8d5cfbff5af1478` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:55.780993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd550f-ee3a-4a0d-9173-858a623e7a51 None admin] RBAC: Authorizing `identity:get_user(user_id=de54cc4aa2214403a8d5cfbff5af1478)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:58:55.782536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd550f-ee3a-4a0d-9173-858a623e7a51 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:58:55.783292 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebc0c6-8f13-4225-8d6a-c9e994d1ef90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:55.784098 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 9/17] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:58:55 2022] GET /identity/v3/users/de54cc4aa2214403a8d5cfbff5af1478 => generated 247 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:58:55.784194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebc0c6-8f13-4225-8d6a-c9e994d1ef90 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:55.784408 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebc0c6-8f13-4225-8d6a-c9e994d1ef90 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:55.784681 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebc0c6-8f13-4225-8d6a-c9e994d1ef90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:55.790296 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd550f-ee3a-4a0d-9173-858a623e7a51 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:55.803349 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebc0c6-8f13-4225-8d6a-c9e994d1ef90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:58:55.804813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebc0c6-8f13-4225-8d6a-c9e994d1ef90 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:58:55.804949 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:55.823457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-e8ebc0c6-8f13-4225-8d6a-c9e994d1ef90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 18:58:55.823457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:58:55.823457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:58:55.823457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:58:55.823457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:58:55.823457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:58:55.823457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:58:55.823457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:58:55.823457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:58:55.823457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:58:55.823457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:58:55.823457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:58:55.823457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 18:58:55.823457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 18:58:55.823457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 18:58:55.823457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 18:58:55.824385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:58:55.824385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:58:55.824385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:58:55.824385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:58:55.824385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:58:55.824385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:58:55.824385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:58:55.824385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:58:55.824385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:58:55.824385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:58:55.824385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:58:55.824385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:58:55.824385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:58:55.824385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:58:55.824385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:58:55.824385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:58:55.824385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 18:58:55.825184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 18:58:55.825184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 18:58:55.825184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:58:55.825184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 9/18] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 18:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 18:58:55.830438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebc0c6-8f13-4225-8d6a-c9e994d1ef90 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:55.887255 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:55.892103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd550f-ee3a-4a0d-9173-858a623e7a51 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:55.925210 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b2bc5-b354-46ca-bec3-581d13a76b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:55.925863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b2bc5-b354-46ca-bec3-581d13a76b1f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:55.926146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b2bc5-b354-46ca-bec3-581d13a76b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:55.926418 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b2bc5-b354-46ca-bec3-581d13a76b1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:55.927547 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b2bc5-b354-46ca-bec3-581d13a76b1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:58:55.929606 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b2bc5-b354-46ca-bec3-581d13a76b1f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:58:55.930600 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebc0c6-8f13-4225-8d6a-c9e994d1ef90 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:55.931132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 10/19] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 18:58:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:58:55.936925 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b2bc5-b354-46ca-bec3-581d13a76b1f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:55.963738 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe572ef7-f993-4338-8754-3251cba15dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:55.964342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe572ef7-f993-4338-8754-3251cba15dba None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:55.964621 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe572ef7-f993-4338-8754-3251cba15dba None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:55.964891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe572ef7-f993-4338-8754-3251cba15dba None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:55.965556 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe572ef7-f993-4338-8754-3251cba15dba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:58:55.965857 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe572ef7-f993-4338-8754-3251cba15dba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:58:55.967240 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe572ef7-f993-4338-8754-3251cba15dba None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:58:55.984636 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 10/20] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 18:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:58:56.019197 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:56.039242 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b2bc5-b354-46ca-bec3-581d13a76b1f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:56.075981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dea51-94e3-4fe1-b040-ea98fa7a78c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:56.076605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dea51-94e3-4fe1-b040-ea98fa7a78c5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:56.076884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dea51-94e3-4fe1-b040-ea98fa7a78c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:56.077151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dea51-94e3-4fe1-b040-ea98fa7a78c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:56.077907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dea51-94e3-4fe1-b040-ea98fa7a78c5 None admin] RBAC: Adding query filter params (role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.domain.id=default, user.id=de54cc4aa2214403a8d5cfbff5af1478) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:58:56.078460 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dea51-94e3-4fe1-b040-ea98fa7a78c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:58:56.079676 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dea51-94e3-4fe1-b040-ea98fa7a78c5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:58:56.086975 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 11/21] 10.222.0.65 () {56 vars in 1322 bytes} [Tue Aug 9 18:58:55 2022] GET /identity/v3/role_assignments?user.id=de54cc4aa2214403a8d5cfbff5af1478&scope.domain.id=default&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:58:58.415612 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e688976-da6c-47ae-bc9e-18b118530c98 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:58.416162 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e688976-da6c-47ae-bc9e-18b118530c98 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:58.416162 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e688976-da6c-47ae-bc9e-18b118530c98 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:58.417522 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 11/22] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:58:58.423372 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbf659-e88a-4ed6-8d78-b55c373e7c71 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:58.423840 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbf659-e88a-4ed6-8d78-b55c373e7c71 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:58.423921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbf659-e88a-4ed6-8d78-b55c373e7c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:58.430180 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f4963-3411-4a45-95e8-86b394736ba8 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:58.430460 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f4963-3411-4a45-95e8-86b394736ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:58.430730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f4963-3411-4a45-95e8-86b394736ba8 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:58.432032 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 12/23] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:58:58.437194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcc81b-055c-417b-80fc-07ee13a26739 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:58.437572 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcc81b-055c-417b-80fc-07ee13a26739 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:58.437852 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcc81b-055c-417b-80fc-07ee13a26739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:58.462894 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-d2cbf659-e88a-4ed6-8d78-b55c373e7c71 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:58:58.464094 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d2cbf659-e88a-4ed6-8d78-b55c373e7c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:58:58.482504 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-42fcc81b-055c-417b-80fc-07ee13a26739 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:58:58.483693 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-42fcc81b-055c-417b-80fc-07ee13a26739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:58:58.595627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 12/24] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:58:58.605214 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 13/25] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:58:58.648911 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbf659-e88a-4ed6-8d78-b55c373e7c71 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:58.652642 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcc81b-055c-417b-80fc-07ee13a26739 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:58.753924 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:58.808161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:58.836442 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcc81b-055c-417b-80fc-07ee13a26739 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:58.865992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbf659-e88a-4ed6-8d78-b55c373e7c71 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:58.896054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3b7bb-fd45-48e2-ba8a-7ee3d68dec08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:58.897312 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3b7bb-fd45-48e2-ba8a-7ee3d68dec08 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:58.897854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3b7bb-fd45-48e2-ba8a-7ee3d68dec08 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:58.898176 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3b7bb-fd45-48e2-ba8a-7ee3d68dec08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:58.911037 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed3b7bb-fd45-48e2-ba8a-7ee3d68dec08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:58:58.917984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-aed3b7bb-fd45-48e2-ba8a-7ee3d68dec08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:58:58.917984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:58:58.917984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:58:58.917984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:58:58.917984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:58:58.917984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:58:58.917984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:58:58.917984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:58:58.917984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:58:58.917984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:58:58.917984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:58:58.917984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:58:58.917984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:58:58.917984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:58:58.917984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:58:58.917984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:58:58.919057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:58:58.919057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:58:58.919057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:58:58.919057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:58:58.919057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:58:58.919057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:58:58.919057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:58:58.919057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:58:58.919057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:58:58.919057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:58:58.919057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:58:58.919057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:58:58.919057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:58:58.919057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:58:58.919057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:58:58.919057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:58:58.919927 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:58:58.919927 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:58:58.919927 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:58:58.919927 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:58:58.919927 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:58:58.919927 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:58:58.919927 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:58:58.919927 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:58:58.919927 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:58:58.919927 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:58:58.919927 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:58:58.919927 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:58:58.922130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 14/26] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 18:58:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:58:58.923577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad297c-9713-4382-93bd-26a8ae869a7b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:58.924044 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad297c-9713-4382-93bd-26a8ae869a7b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:58.924518 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad297c-9713-4382-93bd-26a8ae869a7b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:58.926137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 15/27] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:58:58.931712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad297c-9713-4382-93bd-26a8ae869a7b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:58.942256 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4952f-6e38-4933-8c37-ab05c99fb8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:58.942964 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4952f-6e38-4933-8c37-ab05c99fb8f9 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:58.943255 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4952f-6e38-4933-8c37-ab05c99fb8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:58.943602 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4952f-6e38-4933-8c37-ab05c99fb8f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:58.944299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4952f-6e38-4933-8c37-ab05c99fb8f9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:58:58.945753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4952f-6e38-4933-8c37-ab05c99fb8f9 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:58:59.169226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad297c-9713-4382-93bd-26a8ae869a7b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:59.176977 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:59.200138 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 13/28] 10.222.0.65 () {60 vars in 1131 bytes} [Tue Aug 9 18:58:58 2022] POST /identity/v3/roles => generated 219 bytes in 552 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 18:58:59.201832 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75ee51-5a61-4c35-b41b-bca18d0bb18c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:59.202288 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75ee51-5a61-4c35-b41b-bca18d0bb18c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:59.202728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75ee51-5a61-4c35-b41b-bca18d0bb18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:59.208656 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1b7ac-b7dd-4b0d-bb91-f3b13f0bb849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:59.209659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1b7ac-b7dd-4b0d-bb91-f3b13f0bb849 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:59.210227 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1b7ac-b7dd-4b0d-bb91-f3b13f0bb849 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:59.211625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1b7ac-b7dd-4b0d-bb91-f3b13f0bb849 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:59.212371 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1b7ac-b7dd-4b0d-bb91-f3b13f0bb849 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:58:59.212844 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1b7ac-b7dd-4b0d-bb91-f3b13f0bb849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:58:59.214769 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1b7ac-b7dd-4b0d-bb91-f3b13f0bb849 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:58:59.223914 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-fa75ee51-5a61-4c35-b41b-bca18d0bb18c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:58:59.226611 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fa75ee51-5a61-4c35-b41b-bca18d0bb18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:58:59.230092 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 16/29] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:58:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:58:59.231550 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7a09f-e869-47df-b85c-df2886040647 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:59.231923 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7a09f-e869-47df-b85c-df2886040647 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:59.232272 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7a09f-e869-47df-b85c-df2886040647 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:59.233743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 17/30] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:58:59.238776 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7a09f-e869-47df-b85c-df2886040647 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:59.356285 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 14/31] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:58:59.358050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d560e0-8196-43e2-a29f-2a009d68954a None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:59.359754 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d560e0-8196-43e2-a29f-2a009d68954a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:59.361412 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d560e0-8196-43e2-a29f-2a009d68954a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:59.398644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c8d560e0-8196-43e2-a29f-2a009d68954a None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:58:59.400041 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c8d560e0-8196-43e2-a29f-2a009d68954a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:58:59.428658 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7a09f-e869-47df-b85c-df2886040647 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:59.470585 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74b98d-7dc3-42a4-b25f-06c87d247231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:59.471717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74b98d-7dc3-42a4-b25f-06c87d247231 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:59.472219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74b98d-7dc3-42a4-b25f-06c87d247231 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:59.472787 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74b98d-7dc3-42a4-b25f-06c87d247231 None admin] PATH_INFO: `/v3/users/de54cc4aa2214403a8d5cfbff5af1478` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:59.474791 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74b98d-7dc3-42a4-b25f-06c87d247231 None admin] RBAC: Authorizing `identity:get_user(user_id=de54cc4aa2214403a8d5cfbff5af1478)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:58:59.476766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74b98d-7dc3-42a4-b25f-06c87d247231 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:58:59.478593 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:59.479345 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 18/32] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:58:59 2022] GET /identity/v3/users/de54cc4aa2214403a8d5cfbff5af1478 => generated 247 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:58:59.480495 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74b98d-7dc3-42a4-b25f-06c87d247231 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:59.487654 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 15/33] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:58:59.488515 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d560e0-8196-43e2-a29f-2a009d68954a None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:59.550957 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:59.615960 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d560e0-8196-43e2-a29f-2a009d68954a None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:59.630191 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74b98d-7dc3-42a4-b25f-06c87d247231 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:59.660851 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059e2f-3d66-4d2e-8305-3417bb2ab0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:59.661522 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059e2f-3d66-4d2e-8305-3417bb2ab0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:59.661810 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059e2f-3d66-4d2e-8305-3417bb2ab0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:59.662271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059e2f-3d66-4d2e-8305-3417bb2ab0f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:59.663638 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79059e2f-3d66-4d2e-8305-3417bb2ab0f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:58:59.665756 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79059e2f-3d66-4d2e-8305-3417bb2ab0f9 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:58:59.667625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 16/34] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 18:58:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:58:59.668379 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059e2f-3d66-4d2e-8305-3417bb2ab0f9 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:59.681382 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6097768-77f9-42fe-904d-1824b397fe98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:59.681993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6097768-77f9-42fe-904d-1824b397fe98 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:59.682432 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6097768-77f9-42fe-904d-1824b397fe98 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:59.682854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6097768-77f9-42fe-904d-1824b397fe98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:59.696694 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6097768-77f9-42fe-904d-1824b397fe98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:58:59.699300 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6097768-77f9-42fe-904d-1824b397fe98 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:58:59.714816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-f6097768-77f9-42fe-904d-1824b397fe98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 18:58:59.714816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:58:59.714816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:58:59.714816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:58:59.714816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:58:59.714816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:58:59.714816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:58:59.714816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:58:59.714816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:58:59.714816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:58:59.714816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:58:59.714816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:58:59.714816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 18:58:59.714816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 18:58:59.714816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 18:58:59.714816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 18:58:59.715864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:58:59.715864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:58:59.715864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:58:59.715864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:58:59.715864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:58:59.715864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:58:59.715864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:58:59.715864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:58:59.715864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:58:59.715864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:58:59.715864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:58:59.715864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:58:59.715864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:58:59.715864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:58:59.715864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:58:59.715864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:58:59.715864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 18:58:59.716988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 18:58:59.716988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 18:58:59.716988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:58:59.716988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 19/35] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 18:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:58:59.716988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6097768-77f9-42fe-904d-1824b397fe98 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:58:59.743320 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:59.788068 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059e2f-3d66-4d2e-8305-3417bb2ab0f9 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:59.812095 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:58:59.824992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6097768-77f9-42fe-904d-1824b397fe98 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:58:59.827815 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3522a3-cb1d-4628-9573-6d79cd697c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:59.827945 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3522a3-cb1d-4628-9573-6d79cd697c22 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:59.828236 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3522a3-cb1d-4628-9573-6d79cd697c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:59.828517 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3522a3-cb1d-4628-9573-6d79cd697c22 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:59.829249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3522a3-cb1d-4628-9573-6d79cd697c22 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:58:59.830826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3522a3-cb1d-4628-9573-6d79cd697c22 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:58:59.860720 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950f325-bcf5-4e88-9ae3-286c3d27040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:58:59.861377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950f325-bcf5-4e88-9ae3-286c3d27040a None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:59.861689 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950f325-bcf5-4e88-9ae3-286c3d27040a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:59.862002 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950f325-bcf5-4e88-9ae3-286c3d27040a None admin] PATH_INFO: `/v3/domains/default/users/de54cc4aa2214403a8d5cfbff5af1478/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:59.863938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950f325-bcf5-4e88-9ae3-286c3d27040a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=de54cc4aa2214403a8d5cfbff5af1478, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:58:59.865953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950f325-bcf5-4e88-9ae3-286c3d27040a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:58:59.895811 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 17/36] 10.222.0.65 () {60 vars in 1131 bytes} [Tue Aug 9 18:58:59 2022] POST /identity/v3/roles => generated 225 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 18:58:59.896937 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac548928-8b0e-4332-99e6-2efb79061e61 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:58:59.897239 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac548928-8b0e-4332-99e6-2efb79061e61 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:58:59.897542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac548928-8b0e-4332-99e6-2efb79061e61 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:58:59.898937 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 18/37] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:58:59.899584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac548928-8b0e-4332-99e6-2efb79061e61 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:00.023778 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac548928-8b0e-4332-99e6-2efb79061e61 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:00.047545 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:00.061241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b257e-a1d7-46ac-abc9-5f4b22f6ab8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:00.061954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b257e-a1d7-46ac-abc9-5f4b22f6ab8a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:00.062236 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b257e-a1d7-46ac-abc9-5f4b22f6ab8a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:00.062516 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b257e-a1d7-46ac-abc9-5f4b22f6ab8a None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:00.063168 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b257e-a1d7-46ac-abc9-5f4b22f6ab8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:00.063478 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b257e-a1d7-46ac-abc9-5f4b22f6ab8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:00.064880 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b257e-a1d7-46ac-abc9-5f4b22f6ab8a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:00.067785 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 20/38] 10.222.0.65 () {58 vars in 1361 bytes} [Tue Aug 9 18:58:59 2022] PUT /identity/v3/domains/default/users/de54cc4aa2214403a8d5cfbff5af1478/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 18:59:00.070064 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71176fa-38df-4134-b98c-5d111c0a4374 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:00.070355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71176fa-38df-4134-b98c-5d111c0a4374 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:00.070630 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71176fa-38df-4134-b98c-5d111c0a4374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:00.086275 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 19/39] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 18:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:00.088137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804a20c-fff8-4ac0-be36-d22226243f91 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:00.088137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804a20c-fff8-4ac0-be36-d22226243f91 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:00.088308 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804a20c-fff8-4ac0-be36-d22226243f91 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:00.092349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 20/40] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:00.092349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804a20c-fff8-4ac0-be36-d22226243f91 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:00.097601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d71176fa-38df-4134-b98c-5d111c0a4374 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:00.099177 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d71176fa-38df-4134-b98c-5d111c0a4374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:00.183420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 21/41] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:00.184786 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d911748-7a8e-425c-a8d5-fee5ea6b20f2 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:00.185083 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d911748-7a8e-425c-a8d5-fee5ea6b20f2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:00.185357 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d911748-7a8e-425c-a8d5-fee5ea6b20f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:00.204669 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6d911748-7a8e-425c-a8d5-fee5ea6b20f2 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:00.206096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6d911748-7a8e-425c-a8d5-fee5ea6b20f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:00.228135 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804a20c-fff8-4ac0-be36-d22226243f91 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:00.267320 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93c923-8ce7-4670-b500-c577303cf3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:00.268068 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93c923-8ce7-4670-b500-c577303cf3d2 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:00.268351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93c923-8ce7-4670-b500-c577303cf3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:00.268627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93c923-8ce7-4670-b500-c577303cf3d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:00.269285 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93c923-8ce7-4670-b500-c577303cf3d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:00.270854 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93c923-8ce7-4670-b500-c577303cf3d2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:00.281981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 22/42] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:00.282677 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d911748-7a8e-425c-a8d5-fee5ea6b20f2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:00.296704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:00.369613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 21/43] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Aug 9 18:59:00 2022] POST /identity/v3/projects => generated 301 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 18:59:00.370835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93c923-8ce7-4670-b500-c577303cf3d2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:00.398127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d911748-7a8e-425c-a8d5-fee5ea6b20f2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:00.429952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:00.441644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934889f9-7dc1-4559-8d4d-00a0020039b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:00.442396 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934889f9-7dc1-4559-8d4d-00a0020039b9 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:00.443102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934889f9-7dc1-4559-8d4d-00a0020039b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:00.443249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934889f9-7dc1-4559-8d4d-00a0020039b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:00.444636 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934889f9-7dc1-4559-8d4d-00a0020039b9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:00.446564 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934889f9-7dc1-4559-8d4d-00a0020039b9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:00.517919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93c923-8ce7-4670-b500-c577303cf3d2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:00.558718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43264e-03cb-4acc-a701-7a855f44d83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:00.559479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43264e-03cb-4acc-a701-7a855f44d83e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:00.559664 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43264e-03cb-4acc-a701-7a855f44d83e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:00.559942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43264e-03cb-4acc-a701-7a855f44d83e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:00.561107 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43264e-03cb-4acc-a701-7a855f44d83e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:00.562868 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43264e-03cb-4acc-a701-7a855f44d83e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:00.564636 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 22/44] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 18:59:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:00.570391 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43264e-03cb-4acc-a701-7a855f44d83e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:00.573620 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 23/45] 10.222.0.65 () {60 vars in 1131 bytes} [Tue Aug 9 18:59:00 2022] POST /identity/v3/roles => generated 223 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 18:59:00.697109 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43264e-03cb-4acc-a701-7a855f44d83e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:00.698988 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:00.735675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dbe5f5-f996-4509-b35f-934f83cbe519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:00.736386 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbe5f5-f996-4509-b35f-934f83cbe519 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:00.736865 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbe5f5-f996-4509-b35f-934f83cbe519 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:00.737512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dbe5f5-f996-4509-b35f-934f83cbe519 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:00.737865 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dbe5f5-f996-4509-b35f-934f83cbe519 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:00.739317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dbe5f5-f996-4509-b35f-934f83cbe519 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:00.830398 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 23/46] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Aug 9 18:59:00 2022] POST /identity/v3/projects => generated 312 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 18:59:02.103634 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cffd3-e6fb-4612-b5de-3ecd2845cd6f None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:02.104156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cffd3-e6fb-4612-b5de-3ecd2845cd6f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:02.104255 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cffd3-e6fb-4612-b5de-3ecd2845cd6f None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:02.105570 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 24/47] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:02.110809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12850e6-d3cf-4833-82d8-e6ed615460fb None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:02.111209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12850e6-d3cf-4833-82d8-e6ed615460fb None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:02.111367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12850e6-d3cf-4833-82d8-e6ed615460fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:02.129652 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c12850e6-d3cf-4833-82d8-e6ed615460fb None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:02.131157 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c12850e6-d3cf-4833-82d8-e6ed615460fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:02.195457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 24/48] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:02.217579 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cffd3-e6fb-4612-b5de-3ecd2845cd6f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:02.286532 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:02.321686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cffd3-e6fb-4612-b5de-3ecd2845cd6f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:02.354580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793fea7-b2ab-4f7a-ac50-187d9e9fb3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:02.355138 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793fea7-b2ab-4f7a-ac50-187d9e9fb3dc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:02.355423 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793fea7-b2ab-4f7a-ac50-187d9e9fb3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:02.355701 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793fea7-b2ab-4f7a-ac50-187d9e9fb3dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:02.366129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793fea7-b2ab-4f7a-ac50-187d9e9fb3dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:02.371274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-d793fea7-b2ab-4f7a-ac50-187d9e9fb3dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:02.371274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:02.371274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:02.371274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:02.371274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:02.371274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:02.371274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:02.371274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:02.371274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:02.371274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:02.371274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:02.371274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:02.371274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:02.371274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:02.371274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:02.371274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:02.372129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:02.372129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:02.372129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:02.372129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:02.372129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:02.372129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:02.372129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:02.372129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:02.372129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:02.372129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:02.372129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:02.372129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:02.372129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:02.372129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:02.372129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:02.372129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:02.372887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:02.372887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:02.372887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:02.372887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:02.372887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:02.372887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:02.372887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:02.372887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:02.372887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:02.372887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:02.372887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:02.372887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:02.372887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 25/49] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 18:59:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:02.378282 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12850e6-d3cf-4833-82d8-e6ed615460fb None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:02.460735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:02.476109 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12850e6-d3cf-4833-82d8-e6ed615460fb None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:02.512508 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5952c8-e47a-45d6-90e4-1f2f38e3169a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:02.513136 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5952c8-e47a-45d6-90e4-1f2f38e3169a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:02.513420 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5952c8-e47a-45d6-90e4-1f2f38e3169a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:02.513726 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5952c8-e47a-45d6-90e4-1f2f38e3169a None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:02.514404 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5952c8-e47a-45d6-90e4-1f2f38e3169a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:02.514710 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5952c8-e47a-45d6-90e4-1f2f38e3169a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:02.516111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5952c8-e47a-45d6-90e4-1f2f38e3169a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:02.525815 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 25/50] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:02.531458 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793fea7-b2ab-4f7a-ac50-187d9e9fb3dc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:02.627036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793fea7-b2ab-4f7a-ac50-187d9e9fb3dc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:02.652346 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:02.659672 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e006490-9c72-4b0b-87ef-bf379b33b54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:02.660298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e006490-9c72-4b0b-87ef-bf379b33b54a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:02.660575 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e006490-9c72-4b0b-87ef-bf379b33b54a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:02.660847 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e006490-9c72-4b0b-87ef-bf379b33b54a None admin] PATH_INFO: `/v3/users/de54cc4aa2214403a8d5cfbff5af1478` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:02.662738 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e006490-9c72-4b0b-87ef-bf379b33b54a None admin] RBAC: Authorizing `identity:get_user(user_id=de54cc4aa2214403a8d5cfbff5af1478)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:02.664333 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e006490-9c72-4b0b-87ef-bf379b33b54a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:02.665926 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 26/51] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:02 2022] GET /identity/v3/users/de54cc4aa2214403a8d5cfbff5af1478 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:02.671435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5952c8-e47a-45d6-90e4-1f2f38e3169a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:02.768344 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5952c8-e47a-45d6-90e4-1f2f38e3169a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:02.800500 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ae3ca-df87-4830-870e-37a16e101867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:02.801124 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ae3ca-df87-4830-870e-37a16e101867 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:02.801406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ae3ca-df87-4830-870e-37a16e101867 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:02.801714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ae3ca-df87-4830-870e-37a16e101867 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:02.802811 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ae3ca-df87-4830-870e-37a16e101867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:02.804263 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ae3ca-df87-4830-870e-37a16e101867 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:02.805841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 26/52] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 18:59:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:02.811528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e006490-9c72-4b0b-87ef-bf379b33b54a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:02.816847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f328f6-ba58-474e-ab2a-3853d2e48404 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:02.817128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f328f6-ba58-474e-ab2a-3853d2e48404 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:02.817409 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f328f6-ba58-474e-ab2a-3853d2e48404 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:02.819190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 27/53] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 18:59:02.823970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efedbd0-5770-4079-8b59-84b1599de7d4 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:02.824256 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efedbd0-5770-4079-8b59-84b1599de7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:02.824532 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efedbd0-5770-4079-8b59-84b1599de7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:02.842710 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-8efedbd0-5770-4079-8b59-84b1599de7d4 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:02.843907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8efedbd0-5770-4079-8b59-84b1599de7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:02.852948 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:02.910327 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 28/54] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:02.915451 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e006490-9c72-4b0b-87ef-bf379b33b54a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:02.933390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efedbd0-5770-4079-8b59-84b1599de7d4 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:02.948761 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfbf0a-93d0-4ebb-b6b3-a2414e8543fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:02.949359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfbf0a-93d0-4ebb-b6b3-a2414e8543fb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:02.949702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfbf0a-93d0-4ebb-b6b3-a2414e8543fb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:02.949961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfbf0a-93d0-4ebb-b6b3-a2414e8543fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:02.950678 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfbf0a-93d0-4ebb-b6b3-a2414e8543fb None admin] RBAC: Adding query filter params (role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.domain.id=default, user.id=de54cc4aa2214403a8d5cfbff5af1478) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:02.950983 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfbf0a-93d0-4ebb-b6b3-a2414e8543fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:02.952427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfbf0a-93d0-4ebb-b6b3-a2414e8543fb None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:02.961525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 27/55] 10.222.0.65 () {56 vars in 1322 bytes} [Tue Aug 9 18:59:02 2022] GET /identity/v3/role_assignments?user.id=de54cc4aa2214403a8d5cfbff5af1478&scope.domain.id=default&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:03.039528 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efedbd0-5770-4079-8b59-84b1599de7d4 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:03.075598 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5584c-3808-4198-b5cc-dedf80985f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:03.076250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5584c-3808-4198-b5cc-dedf80985f6b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:03.076533 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5584c-3808-4198-b5cc-dedf80985f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:03.076816 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5584c-3808-4198-b5cc-dedf80985f6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:03.078067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5584c-3808-4198-b5cc-dedf80985f6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:03.079539 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5584c-3808-4198-b5cc-dedf80985f6b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:03.081128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 29/56] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 18:59:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:03.087237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfbf0a-93d0-4ebb-b6b3-a2414e8543fb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:03.150188 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:03.190918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfbf0a-93d0-4ebb-b6b3-a2414e8543fb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:03.223763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5f825-3dd3-446c-855c-ae7c41cbd496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:03.229486 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5f825-3dd3-446c-855c-ae7c41cbd496 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:03.229486 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5f825-3dd3-446c-855c-ae7c41cbd496 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:03.229486 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5f825-3dd3-446c-855c-ae7c41cbd496 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:03.229486 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5f825-3dd3-446c-855c-ae7c41cbd496 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:03.229486 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5f825-3dd3-446c-855c-ae7c41cbd496 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:03.308779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 28/57] 10.222.0.65 () {60 vars in 1140 bytes} [Tue Aug 9 18:59:03 2022] POST /identity/v3/projects => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 18:59:05.304073 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06c154-241e-4d51-a1e3-7b4e6f17709a None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:05.304595 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06c154-241e-4d51-a1e3-7b4e6f17709a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:05.304707 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06c154-241e-4d51-a1e3-7b4e6f17709a None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:05.306019 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 30/58] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:05.311093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8d738-a769-4844-bfd1-616fec5473ba None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:05.311483 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8d738-a769-4844-bfd1-616fec5473ba None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:05.311651 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8d738-a769-4844-bfd1-616fec5473ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:05.329103 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-84d8d738-a769-4844-bfd1-616fec5473ba None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:05.330315 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-84d8d738-a769-4844-bfd1-616fec5473ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:05.394093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 29/59] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:05.419230 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06c154-241e-4d51-a1e3-7b4e6f17709a None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:05.433563 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:05.518372 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06c154-241e-4d51-a1e3-7b4e6f17709a None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:05.551515 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ddf80-9441-45a3-b809-7e969934b4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:05.552333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ddf80-9441-45a3-b809-7e969934b4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:05.552717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ddf80-9441-45a3-b809-7e969934b4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:05.552993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ddf80-9441-45a3-b809-7e969934b4d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:05.554165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ddf80-9441-45a3-b809-7e969934b4d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:05.555557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ddf80-9441-45a3-b809-7e969934b4d0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:05.557096 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 31/60] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 18:59:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:05.562755 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8d738-a769-4844-bfd1-616fec5473ba None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:05.605338 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:05.658681 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8d738-a769-4844-bfd1-616fec5473ba None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:05.691470 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5bfbc-c657-4990-8258-c8f7079742c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:05.692059 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5bfbc-c657-4990-8258-c8f7079742c8 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:05.692340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5bfbc-c657-4990-8258-c8f7079742c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:05.692614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5bfbc-c657-4990-8258-c8f7079742c8 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:05.693281 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5bfbc-c657-4990-8258-c8f7079742c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:05.694750 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5bfbc-c657-4990-8258-c8f7079742c8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:05.793416 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 30/61] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Aug 9 18:59:05 2022] POST /identity/v3/users => generated 275 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 18:59:08.816955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b8c95-06b8-4592-8154-8e9bc6e237b1 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:08.818469 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b8c95-06b8-4592-8154-8e9bc6e237b1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:08.818952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b8c95-06b8-4592-8154-8e9bc6e237b1 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:08.820490 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 32/62] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:08.825864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a584c2-76b6-4706-9b75-213a848a031c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:08.826725 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a584c2-76b6-4706-9b75-213a848a031c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:08.827207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a584c2-76b6-4706-9b75-213a848a031c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:08.858455 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d6a584c2-76b6-4706-9b75-213a848a031c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:08.860021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d6a584c2-76b6-4706-9b75-213a848a031c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:08.951134 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 31/63] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:08.974437 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f87a9-1119-47f2-b643-f68cfd03e4d5 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:08.975158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f87a9-1119-47f2-b643-f68cfd03e4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:08.975638 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f87a9-1119-47f2-b643-f68cfd03e4d5 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:08.977196 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 33/64] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:08.982441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cac586-8191-469f-88b8-5db7890f85c3 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:08.982735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cac586-8191-469f-88b8-5db7890f85c3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:08.983014 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cac586-8191-469f-88b8-5db7890f85c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:08.987371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f87a9-1119-47f2-b643-f68cfd03e4d5 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:09.001795 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-08cac586-8191-469f-88b8-5db7890f85c3 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:09.003977 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-08cac586-8191-469f-88b8-5db7890f85c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:09.031366 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:09.112832 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 32/65] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:09.136084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:09.159403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f87a9-1119-47f2-b643-f68cfd03e4d5 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:09.186837 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cac586-8191-469f-88b8-5db7890f85c3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:09.206108 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4a2c1-cca5-4a43-bf1a-cd4c6a16ca8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:09.206756 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4a2c1-cca5-4a43-bf1a-cd4c6a16ca8c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:09.207046 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4a2c1-cca5-4a43-bf1a-cd4c6a16ca8c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:09.207320 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4a2c1-cca5-4a43-bf1a-cd4c6a16ca8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:09.219944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4a2c1-cca5-4a43-bf1a-cd4c6a16ca8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:09.225250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-71e4a2c1-cca5-4a43-bf1a-cd4c6a16ca8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:09.225250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:09.225250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:09.225250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:09.225250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:09.225250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:09.225250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:09.225250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:09.225250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:09.225250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:09.225250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:09.225250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:09.225250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:09.225250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:09.225250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:09.225250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:09.226148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:09.226148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:09.226148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:09.226148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:09.226148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:09.226148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:09.226148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:09.226148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:09.226148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:09.226148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:09.226148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:09.226148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:09.226148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:09.226148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:09.226148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:09.226148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:09.226923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:09.226923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:09.226923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:09.226923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:09.226923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:09.226923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:09.226923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:09.226923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:09.226923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:09.226923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:09.226923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:09.226923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:09.226923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 34/66] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 18:59:09.230255 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c6a70-e1f0-4939-8849-b5ed375eb959 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:09.230255 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c6a70-e1f0-4939-8849-b5ed375eb959 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:09.230255 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c6a70-e1f0-4939-8849-b5ed375eb959 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:09.230255 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 35/67] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:09.235260 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21a2e9-f35f-4183-a111-16c37d1520f3 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:09.235548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21a2e9-f35f-4183-a111-16c37d1520f3 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:09.235829 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21a2e9-f35f-4183-a111-16c37d1520f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:09.256926 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4a21a2e9-f35f-4183-a111-16c37d1520f3 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:09.258513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4a21a2e9-f35f-4183-a111-16c37d1520f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:09.315657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cac586-8191-469f-88b8-5db7890f85c3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:09.332771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 36/68] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:09.342330 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21a2e9-f35f-4183-a111-16c37d1520f3 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:09.356805 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a17b1-04cf-4d60-932f-4ffcc9c4b679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:09.357696 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a17b1-04cf-4d60-932f-4ffcc9c4b679 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:09.358120 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a17b1-04cf-4d60-932f-4ffcc9c4b679 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:09.358561 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a17b1-04cf-4d60-932f-4ffcc9c4b679 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:09.371497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6a17b1-04cf-4d60-932f-4ffcc9c4b679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:09.377860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-fb6a17b1-04cf-4d60-932f-4ffcc9c4b679 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:09.377860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:09.377860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:09.377860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:09.377860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:09.377860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:09.377860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:09.377860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:09.377860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:09.377860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:09.377860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:09.377860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:09.377860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:09.377860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:09.377860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:09.377860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:09.378910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:09.378910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:09.378910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:09.378910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:09.378910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:09.378910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:09.378910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:09.378910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:09.378910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:09.378910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:09.378910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:09.378910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:09.378910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:09.378910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:09.378910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:09.378910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:09.379864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:09.379864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:09.379864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:09.379864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:09.379864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:09.379864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:09.379864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:09.379864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:09.379864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:09.379864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:09.379864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:09.379864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:09.382866 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 33/69] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 18:59:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 18:59:09.384301 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a17b1-04cf-4d60-932f-4ffcc9c4b679 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:09.413659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:09.432580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:09.464225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21a2e9-f35f-4183-a111-16c37d1520f3 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:09.490636 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a17b1-04cf-4d60-932f-4ffcc9c4b679 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:09.498410 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f0de4-3c4c-4f7f-ac34-f702afcc5b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:09.499031 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f0de4-3c4c-4f7f-ac34-f702afcc5b15 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:09.499314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f0de4-3c4c-4f7f-ac34-f702afcc5b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:09.499589 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f0de4-3c4c-4f7f-ac34-f702afcc5b15 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:09.500259 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f0de4-3c4c-4f7f-ac34-f702afcc5b15 None admin] RBAC: Adding query filter params (name=member) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:09.500567 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f0de4-3c4c-4f7f-ac34-f702afcc5b15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:09.502002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f0de4-3c4c-4f7f-ac34-f702afcc5b15 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:09.515645 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 37/70] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:09.518350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f0de4-3c4c-4f7f-ac34-f702afcc5b15 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:09.535041 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1fae0-a2a2-4ae8-8787-75cbee12159a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:09.535996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1fae0-a2a2-4ae8-8787-75cbee12159a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:09.536975 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1fae0-a2a2-4ae8-8787-75cbee12159a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:09.537392 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1fae0-a2a2-4ae8-8787-75cbee12159a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:09.548898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1fae0-a2a2-4ae8-8787-75cbee12159a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:09.554772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-18b1fae0-a2a2-4ae8-8787-75cbee12159a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:09.554772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:09.554772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:09.554772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:09.554772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:09.554772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:09.554772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:09.554772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:09.554772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:09.554772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:09.554772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:09.554772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:09.554772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:09.554772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:09.554772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:09.554772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:09.555820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:09.555820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:09.555820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:09.555820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:09.555820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:09.555820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:09.555820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:09.555820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:09.555820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:09.555820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:09.555820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:09.555820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:09.555820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:09.555820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:09.555820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:09.555820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:09.556768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:09.556768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:09.556768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:09.556768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:09.556768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:09.556768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:09.556768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:09.556768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:09.556768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:09.556768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:09.556768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:09.556768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:09.558682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 34/71] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 18:59:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:09.559991 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0f0f8-46bd-44ab-8cb6-362baca307b4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:09.560420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0f0f8-46bd-44ab-8cb6-362baca307b4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:09.560831 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0f0f8-46bd-44ab-8cb6-362baca307b4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:09.562224 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 35/72] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:09.563050 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0f0f8-46bd-44ab-8cb6-362baca307b4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:09.636270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f0de4-3c4c-4f7f-ac34-f702afcc5b15 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:09.656033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:09.668373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:09.673603 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dea53-58fa-4b25-8c9b-7f07127c3ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:09.674216 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dea53-58fa-4b25-8c9b-7f07127c3ccf None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:09.674495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dea53-58fa-4b25-8c9b-7f07127c3ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:09.674873 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dea53-58fa-4b25-8c9b-7f07127c3ccf None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:09.675421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5dea53-58fa-4b25-8c9b-7f07127c3ccf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:09.675869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5dea53-58fa-4b25-8c9b-7f07127c3ccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:09.677249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5dea53-58fa-4b25-8c9b-7f07127c3ccf None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:09.679703 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0f0f8-46bd-44ab-8cb6-362baca307b4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:09.686527 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 38/73] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:09.693369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcce6a3-d078-40a0-a588-df3be1144618 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:09.693677 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcce6a3-d078-40a0-a588-df3be1144618 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:09.693954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcce6a3-d078-40a0-a588-df3be1144618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:09.711162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-5dcce6a3-d078-40a0-a588-df3be1144618 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:09.712343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5dcce6a3-d078-40a0-a588-df3be1144618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:09.715389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45327a-c851-4528-8876-a54b73cd89df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:09.716043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45327a-c851-4528-8876-a54b73cd89df None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:09.716332 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45327a-c851-4528-8876-a54b73cd89df None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:09.716608 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45327a-c851-4528-8876-a54b73cd89df None admin] PATH_INFO: `/v3/users/52af65c8f39f4ae68548deb395a6c6a1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:09.732219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45327a-c851-4528-8876-a54b73cd89df None admin] RBAC: Authorizing `identity:get_user(user_id=52af65c8f39f4ae68548deb395a6c6a1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:09.733728 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f45327a-c851-4528-8876-a54b73cd89df None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:09.735371 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 36/74] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:09 2022] GET /identity/v3/users/52af65c8f39f4ae68548deb395a6c6a1 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:09.736140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45327a-c851-4528-8876-a54b73cd89df None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:09.782038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 39/75] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:09.783134 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcce6a3-d078-40a0-a588-df3be1144618 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:09.835579 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45327a-c851-4528-8876-a54b73cd89df None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:09.868690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9893b-0d3d-409c-9be2-700535115910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:09.869294 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9893b-0d3d-409c-9be2-700535115910 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:09.869634 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9893b-0d3d-409c-9be2-700535115910 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:09.869913 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9893b-0d3d-409c-9be2-700535115910 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:09.870577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9893b-0d3d-409c-9be2-700535115910 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:09.870889 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9893b-0d3d-409c-9be2-700535115910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:09.872271 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9893b-0d3d-409c-9be2-700535115910 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:09.874448 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:09.881893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 37/76] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 18:59:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:09.883077 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60097d4-44a4-4050-a506-eaea463a41b8 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:09.886524 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60097d4-44a4-4050-a506-eaea463a41b8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:09.886524 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60097d4-44a4-4050-a506-eaea463a41b8 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:09.886692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcce6a3-d078-40a0-a588-df3be1144618 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:09.887096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 38/77] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:09.887096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60097d4-44a4-4050-a506-eaea463a41b8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:09.909363 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:09.919718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c732325-64cf-4958-bd71-1153d507c65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:09.920353 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c732325-64cf-4958-bd71-1153d507c65b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:09.920742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c732325-64cf-4958-bd71-1153d507c65b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:09.921035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c732325-64cf-4958-bd71-1153d507c65b None admin] PATH_INFO: `/v3/users/de54cc4aa2214403a8d5cfbff5af1478` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:09.922197 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c732325-64cf-4958-bd71-1153d507c65b None admin] RBAC: Authorizing `identity:get_user(user_id=de54cc4aa2214403a8d5cfbff5af1478)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:09.923664 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c732325-64cf-4958-bd71-1153d507c65b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:09.925239 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 40/78] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:09 2022] GET /identity/v3/users/de54cc4aa2214403a8d5cfbff5af1478 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:09.926031 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c732325-64cf-4958-bd71-1153d507c65b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:09.988346 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60097d4-44a4-4050-a506-eaea463a41b8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:10.021360 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb390ac8-70bd-4aee-99c4-96afa3fc5d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:10.021983 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb390ac8-70bd-4aee-99c4-96afa3fc5d45 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:10.022262 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb390ac8-70bd-4aee-99c4-96afa3fc5d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:10.022530 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb390ac8-70bd-4aee-99c4-96afa3fc5d45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:10.025336 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c732325-64cf-4958-bd71-1153d507c65b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:10.060136 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac908e20-86ad-4639-b147-85fc506ef548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:10.060767 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac908e20-86ad-4639-b147-85fc506ef548 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:10.061051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac908e20-86ad-4639-b147-85fc506ef548 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:10.061325 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac908e20-86ad-4639-b147-85fc506ef548 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:10.071616 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac908e20-86ad-4639-b147-85fc506ef548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:10.076809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-ac908e20-86ad-4639-b147-85fc506ef548 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:10.076809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:10.076809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:10.076809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:10.076809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:10.076809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:10.076809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:10.076809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:10.076809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:10.076809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:10.076809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:10.076809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:10.076809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:10.076809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:10.076809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:10.076809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:10.077669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:10.077669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:10.077669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:10.077669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:10.077669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:10.077669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:10.077669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:10.077669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:10.077669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:10.077669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:10.077669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:10.077669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:10.077669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:10.077669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:10.077669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:10.077669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:10.078425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:10.078425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:10.078425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:10.078425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:10.078425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:10.078425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:10.078425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:10.078425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:10.078425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:10.078425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:10.078425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:10.078425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:10.078425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 41/79] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:10.079085 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e810f44-f356-4b7a-a560-351577217112 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:10.079370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e810f44-f356-4b7a-a560-351577217112 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:10.079648 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e810f44-f356-4b7a-a560-351577217112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:10.090591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:10.093998 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb390ac8-70bd-4aee-99c4-96afa3fc5d45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:10.095436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb390ac8-70bd-4aee-99c4-96afa3fc5d45 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:10.097572 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-5e810f44-f356-4b7a-a560-351577217112 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:10.099434 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5e810f44-f356-4b7a-a560-351577217112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:10.146778 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:10.167209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 42/80] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:10.167905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e810f44-f356-4b7a-a560-351577217112 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:10.193665 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 39/81] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:10.194622 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb390ac8-70bd-4aee-99c4-96afa3fc5d45 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:10.264391 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e810f44-f356-4b7a-a560-351577217112 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:10.289103 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:10.292606 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb390ac8-70bd-4aee-99c4-96afa3fc5d45 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:10.297825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96740f65-069e-4390-afd4-fe344c82cf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:10.298465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96740f65-069e-4390-afd4-fe344c82cf65 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:10.304117 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96740f65-069e-4390-afd4-fe344c82cf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:10.304117 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96740f65-069e-4390-afd4-fe344c82cf65 None admin] PATH_INFO: `/v3/users/52af65c8f39f4ae68548deb395a6c6a1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:10.304117 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96740f65-069e-4390-afd4-fe344c82cf65 None admin] RBAC: Authorizing `identity:get_user(user_id=52af65c8f39f4ae68548deb395a6c6a1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:10.304117 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96740f65-069e-4390-afd4-fe344c82cf65 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:10.304117 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 43/82] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:10 2022] GET /identity/v3/users/52af65c8f39f4ae68548deb395a6c6a1 => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:10.304117 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96740f65-069e-4390-afd4-fe344c82cf65 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:10.327903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1b3d7-bfbb-4a2e-8396-6b08271e0d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:10.328532 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1b3d7-bfbb-4a2e-8396-6b08271e0d65 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:10.329212 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1b3d7-bfbb-4a2e-8396-6b08271e0d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:10.329512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1b3d7-bfbb-4a2e-8396-6b08271e0d65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:10.357261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:10.396853 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1b3d7-bfbb-4a2e-8396-6b08271e0d65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:10.398293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1b3d7-bfbb-4a2e-8396-6b08271e0d65 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:10.406962 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96740f65-069e-4390-afd4-fe344c82cf65 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:10.440439 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd99c93-19a9-4e72-8b9f-fce53a369cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:10.441046 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd99c93-19a9-4e72-8b9f-fce53a369cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:10.441330 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd99c93-19a9-4e72-8b9f-fce53a369cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:10.441632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd99c93-19a9-4e72-8b9f-fce53a369cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:10.442295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd99c93-19a9-4e72-8b9f-fce53a369cb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:10.443156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd99c93-19a9-4e72-8b9f-fce53a369cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:10.444547 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd99c93-19a9-4e72-8b9f-fce53a369cb1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:10.452298 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 44/83] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:10.453084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd99c93-19a9-4e72-8b9f-fce53a369cb1 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:10.493629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:10.502628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 40/84] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:10.502628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1b3d7-bfbb-4a2e-8396-6b08271e0d65 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:10.559286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd99c93-19a9-4e72-8b9f-fce53a369cb1 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:10.572164 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:10.593401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc183a5b-de86-4bd5-ac01-bd5fe69c2cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:10.594066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc183a5b-de86-4bd5-ac01-bd5fe69c2cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:10.594350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc183a5b-de86-4bd5-ac01-bd5fe69c2cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:10.594622 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc183a5b-de86-4bd5-ac01-bd5fe69c2cb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:10.595271 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1b3d7-bfbb-4a2e-8396-6b08271e0d65 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:10.595807 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc183a5b-de86-4bd5-ac01-bd5fe69c2cb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:10.597270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc183a5b-de86-4bd5-ac01-bd5fe69c2cb4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:10.599743 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 45/85] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 18:59:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:10.600533 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc183a5b-de86-4bd5-ac01-bd5fe69c2cb4 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:10.632201 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f7367-46d8-4783-ad72-b2eb2169c8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:10.632829 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f7367-46d8-4783-ad72-b2eb2169c8df None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:10.633109 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f7367-46d8-4783-ad72-b2eb2169c8df None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:10.633383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f7367-46d8-4783-ad72-b2eb2169c8df None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:10.634792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f7367-46d8-4783-ad72-b2eb2169c8df None admin] RBAC: Authorizing `identity:get_project(project_id=e906580203f24a3787efe33c12436d59)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:10.636224 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f7367-46d8-4783-ad72-b2eb2169c8df None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:10.637868 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 41/86] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:10 2022] GET /identity/v3/projects/e906580203f24a3787efe33c12436d59 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:10.638626 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f7367-46d8-4783-ad72-b2eb2169c8df None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:10.700071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:10.701677 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc183a5b-de86-4bd5-ac01-bd5fe69c2cb4 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:10.733686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f7367-46d8-4783-ad72-b2eb2169c8df None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:10.735259 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8ed30-396c-4c37-af7f-27d7eb8fb073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:10.735866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8ed30-396c-4c37-af7f-27d7eb8fb073 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:10.736144 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8ed30-396c-4c37-af7f-27d7eb8fb073 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:10.736415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8ed30-396c-4c37-af7f-27d7eb8fb073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:10.766183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af7678-4adf-4c94-9979-dbcc5b996aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:10.766803 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af7678-4adf-4c94-9979-dbcc5b996aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:10.767083 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af7678-4adf-4c94-9979-dbcc5b996aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:10.767355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af7678-4adf-4c94-9979-dbcc5b996aa5 None admin] PATH_INFO: `/v3/users/52af65c8f39f4ae68548deb395a6c6a1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:10.768476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af7678-4adf-4c94-9979-dbcc5b996aa5 None admin] RBAC: Authorizing `identity:get_user(user_id=52af65c8f39f4ae68548deb395a6c6a1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:10.769971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af7678-4adf-4c94-9979-dbcc5b996aa5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:10.772254 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 42/87] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:10 2022] GET /identity/v3/users/52af65c8f39f4ae68548deb395a6c6a1 => generated 275 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:10.773016 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af7678-4adf-4c94-9979-dbcc5b996aa5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:10.789741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:10.808812 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8ed30-396c-4c37-af7f-27d7eb8fb073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:10.810357 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8ed30-396c-4c37-af7f-27d7eb8fb073 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:10.870502 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af7678-4adf-4c94-9979-dbcc5b996aa5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:10.905585 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed5a93-4c0b-4f2a-91aa-909a34963ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:10.906210 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed5a93-4c0b-4f2a-91aa-909a34963ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:10.906493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed5a93-4c0b-4f2a-91aa-909a34963ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:10.906767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed5a93-4c0b-4f2a-91aa-909a34963ed0 None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:10.907227 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 46/88] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:10.912312 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8ed30-396c-4c37-af7f-27d7eb8fb073 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:10.913183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed5a93-4c0b-4f2a-91aa-909a34963ed0 None admin] RBAC: Authorizing `identity:get_project(project_id=e906580203f24a3787efe33c12436d59)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:10.914687 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed5a93-4c0b-4f2a-91aa-909a34963ed0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:10.916357 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 43/89] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:10 2022] GET /identity/v3/projects/e906580203f24a3787efe33c12436d59 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:10.917112 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed5a93-4c0b-4f2a-91aa-909a34963ed0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:10.919728 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:10.986748 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:11.006489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8ed30-396c-4c37-af7f-27d7eb8fb073 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:11.016326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed5a93-4c0b-4f2a-91aa-909a34963ed0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:11.041064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983c82c-2e4e-4a89-91c6-526e8f9fe9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:11.041713 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983c82c-2e4e-4a89-91c6-526e8f9fe9d9 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:11.041998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983c82c-2e4e-4a89-91c6-526e8f9fe9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:11.042278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983c82c-2e4e-4a89-91c6-526e8f9fe9d9 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:11.042925 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983c82c-2e4e-4a89-91c6-526e8f9fe9d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:11.044426 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983c82c-2e4e-4a89-91c6-526e8f9fe9d9 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:11.049696 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93dde12-b588-428a-9fc6-cfcdc89514b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:11.050298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dde12-b588-428a-9fc6-cfcdc89514b0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:11.050580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dde12-b588-428a-9fc6-cfcdc89514b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:11.050851 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dde12-b588-428a-9fc6-cfcdc89514b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:11.051572 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93dde12-b588-428a-9fc6-cfcdc89514b0 None admin] RBAC: Adding query filter params (role.id=ead9959857d24ec6bea3b7556da18ce5, scope.project.id=e906580203f24a3787efe33c12436d59, user.id=52af65c8f39f4ae68548deb395a6c6a1) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:11.052519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93dde12-b588-428a-9fc6-cfcdc89514b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:11.053989 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93dde12-b588-428a-9fc6-cfcdc89514b0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:11.059495 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 44/90] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 18:59:10 2022] GET /identity/v3/role_assignments?user.id=52af65c8f39f4ae68548deb395a6c6a1&scope.project.id=e906580203f24a3787efe33c12436d59&role.id=ead9959857d24ec6bea3b7556da18ce5 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:11.060306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93dde12-b588-428a-9fc6-cfcdc89514b0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:11.135940 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:11.149508 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 47/91] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Aug 9 18:59:10 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 18:59:11.150391 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983c82c-2e4e-4a89-91c6-526e8f9fe9d9 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:11.188808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93dde12-b588-428a-9fc6-cfcdc89514b0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:11.238353 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96994bbe-d102-46e6-aa02-3ab6af37de5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:11.239412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96994bbe-d102-46e6-aa02-3ab6af37de5b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:11.240037 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96994bbe-d102-46e6-aa02-3ab6af37de5b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:11.240784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96994bbe-d102-46e6-aa02-3ab6af37de5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:11.326595 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96994bbe-d102-46e6-aa02-3ab6af37de5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:11.328629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96994bbe-d102-46e6-aa02-3ab6af37de5b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:11.339315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983c82c-2e4e-4a89-91c6-526e8f9fe9d9 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:11.378964 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f15906-3020-4982-87ae-e7fb7f9dbc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:11.379614 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f15906-3020-4982-87ae-e7fb7f9dbc5d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:11.379957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f15906-3020-4982-87ae-e7fb7f9dbc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:11.380733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f15906-3020-4982-87ae-e7fb7f9dbc5d None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:11.382132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f15906-3020-4982-87ae-e7fb7f9dbc5d None admin] RBAC: Authorizing `identity:get_project(project_id=e906580203f24a3787efe33c12436d59)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:11.384559 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f15906-3020-4982-87ae-e7fb7f9dbc5d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:11.385556 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 48/92] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:11 2022] GET /identity/v3/projects/e906580203f24a3787efe33c12436d59 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:11.387424 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f15906-3020-4982-87ae-e7fb7f9dbc5d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:11.393918 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:11.437647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:11.487808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 45/93] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:11.488551 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96994bbe-d102-46e6-aa02-3ab6af37de5b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:11.521304 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f15906-3020-4982-87ae-e7fb7f9dbc5d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:11.559722 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e5606-f102-492f-a27a-758f1eb7ea45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:11.560925 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e5606-f102-492f-a27a-758f1eb7ea45 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:11.561215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e5606-f102-492f-a27a-758f1eb7ea45 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:11.561587 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e5606-f102-492f-a27a-758f1eb7ea45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:11.562338 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e5606-f102-492f-a27a-758f1eb7ea45 None admin] RBAC: Adding query filter params (role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.project.id=e906580203f24a3787efe33c12436d59, user.id=de54cc4aa2214403a8d5cfbff5af1478) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:11.562713 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e5606-f102-492f-a27a-758f1eb7ea45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:11.564548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e5606-f102-492f-a27a-758f1eb7ea45 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:11.573109 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 49/94] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 18:59:11 2022] GET /identity/v3/role_assignments?user.id=de54cc4aa2214403a8d5cfbff5af1478&scope.project.id=e906580203f24a3787efe33c12436d59&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:11.574023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e5606-f102-492f-a27a-758f1eb7ea45 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:11.696836 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:11.705818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e5606-f102-492f-a27a-758f1eb7ea45 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:11.735535 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96994bbe-d102-46e6-aa02-3ab6af37de5b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:11.749032 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfa1d9-ad84-4960-b2cc-c3b090756e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:11.749807 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfa1d9-ad84-4960-b2cc-c3b090756e02 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:11.750103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfa1d9-ad84-4960-b2cc-c3b090756e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:11.751265 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfa1d9-ad84-4960-b2cc-c3b090756e02 None admin] PATH_INFO: `/v3/projects/639e0c6b4edc4b0194bdc5db0ab143fc` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:11.752505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfa1d9-ad84-4960-b2cc-c3b090756e02 None admin] RBAC: Authorizing `identity:get_project(project_id=639e0c6b4edc4b0194bdc5db0ab143fc)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:11.754075 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfa1d9-ad84-4960-b2cc-c3b090756e02 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:11.757587 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 50/95] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:11 2022] GET /identity/v3/projects/639e0c6b4edc4b0194bdc5db0ab143fc => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:11.764354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfa1d9-ad84-4960-b2cc-c3b090756e02 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:11.869802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c2866-1dc6-4d41-aefb-9866ce96472d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:11.870437 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c2866-1dc6-4d41-aefb-9866ce96472d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:11.870726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c2866-1dc6-4d41-aefb-9866ce96472d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:11.871266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c2866-1dc6-4d41-aefb-9866ce96472d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:11.871739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c2866-1dc6-4d41-aefb-9866ce96472d None admin] RBAC: Adding query filter params (role.id=e4ff1977289a44cea73b844f8ad102a1, scope.project.id=e906580203f24a3787efe33c12436d59, user.id=52af65c8f39f4ae68548deb395a6c6a1) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:11.872054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c2866-1dc6-4d41-aefb-9866ce96472d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:11.873538 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c2866-1dc6-4d41-aefb-9866ce96472d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:11.884574 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfa1d9-ad84-4960-b2cc-c3b090756e02 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:11.895216 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 46/96] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 18:59:11 2022] GET /identity/v3/role_assignments?user.id=52af65c8f39f4ae68548deb395a6c6a1&scope.project.id=e906580203f24a3787efe33c12436d59&role.id=e4ff1977289a44cea73b844f8ad102a1 => generated 259 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:11.924225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cae419-e5a6-4d3a-8087-1d664661e9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:11.924888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cae419-e5a6-4d3a-8087-1d664661e9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:11.925127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cae419-e5a6-4d3a-8087-1d664661e9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:11.925405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cae419-e5a6-4d3a-8087-1d664661e9b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:11.926235 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cae419-e5a6-4d3a-8087-1d664661e9b4 None admin] RBAC: Adding query filter params (role.id=ead9959857d24ec6bea3b7556da18ce5, scope.project.id=639e0c6b4edc4b0194bdc5db0ab143fc, user.id=52af65c8f39f4ae68548deb395a6c6a1) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:11.926625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cae419-e5a6-4d3a-8087-1d664661e9b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:11.928586 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cae419-e5a6-4d3a-8087-1d664661e9b4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:11.934990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 51/97] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 18:59:11 2022] GET /identity/v3/role_assignments?user.id=52af65c8f39f4ae68548deb395a6c6a1&scope.project.id=639e0c6b4edc4b0194bdc5db0ab143fc&role.id=ead9959857d24ec6bea3b7556da18ce5 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:11.935646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:13.559708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8badf7-2afb-4345-ae12-d7b9693ec543 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:13.560226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8badf7-2afb-4345-ae12-d7b9693ec543 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:13.560300 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8badf7-2afb-4345-ae12-d7b9693ec543 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:13.561806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 47/98] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:13.566999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a4073-fea9-4a92-a71c-67294b5fbb1b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:13.567790 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a4073-fea9-4a92-a71c-67294b5fbb1b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:13.567790 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a4073-fea9-4a92-a71c-67294b5fbb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:13.587513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ff0a4073-fea9-4a92-a71c-67294b5fbb1b None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:13.588743 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ff0a4073-fea9-4a92-a71c-67294b5fbb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:13.685013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 52/99] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:13.715107 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8badf7-2afb-4345-ae12-d7b9693ec543 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:13.753373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:13.840895 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8badf7-2afb-4345-ae12-d7b9693ec543 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:13.886677 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bbe78-93c2-4af0-9b91-b5408dd2ec8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:13.887318 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bbe78-93c2-4af0-9b91-b5408dd2ec8b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:13.887603 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bbe78-93c2-4af0-9b91-b5408dd2ec8b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:13.887889 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bbe78-93c2-4af0-9b91-b5408dd2ec8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:13.910312 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bbe78-93c2-4af0-9b91-b5408dd2ec8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:13.915735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-b97bbe78-93c2-4af0-9b91-b5408dd2ec8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:13.915735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:13.915735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:13.915735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:13.915735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:13.915735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:13.915735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:13.915735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:13.915735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:13.915735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:13.915735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:13.915735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:13.915735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:13.915735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:13.915735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:13.915735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:13.916576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:13.916576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:13.916576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:13.916576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:13.916576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:13.916576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:13.916576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:13.916576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:13.916576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:13.916576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:13.916576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:13.916576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:13.916576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:13.916576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:13.916576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:13.916576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:13.917351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:13.917351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:13.917351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:13.917351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:13.917351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:13.917351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:13.917351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:13.917351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:13.917351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:13.917351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:13.917351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:13.917351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:13.917351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 48/100] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:13.922950 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a4073-fea9-4a92-a71c-67294b5fbb1b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:14.048170 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a4073-fea9-4a92-a71c-67294b5fbb1b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:14.082551 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:14.093868 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bb869-6520-4ca4-b0f1-1958a82901ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:14.094457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bb869-6520-4ca4-b0f1-1958a82901ff None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:14.094744 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bb869-6520-4ca4-b0f1-1958a82901ff None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:14.095019 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bb869-6520-4ca4-b0f1-1958a82901ff None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:14.095701 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74bb869-6520-4ca4-b0f1-1958a82901ff None admin] RBAC: Adding query filter params (name=member) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:14.096010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74bb869-6520-4ca4-b0f1-1958a82901ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:14.097409 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74bb869-6520-4ca4-b0f1-1958a82901ff None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:14.106339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 53/101] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:14.112279 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bbe78-93c2-4af0-9b91-b5408dd2ec8b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:14.227580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980b38f-f5a9-4055-a192-91b8002086b8 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:14.227887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980b38f-f5a9-4055-a192-91b8002086b8 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:14.228165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980b38f-f5a9-4055-a192-91b8002086b8 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:14.229542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 54/102] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 18:59:14.234609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a74137-cfa5-47fe-8bf1-e46fd93e3bc5 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:14.234896 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a74137-cfa5-47fe-8bf1-e46fd93e3bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:14.235181 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a74137-cfa5-47fe-8bf1-e46fd93e3bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:14.243849 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:14.256890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-20a74137-cfa5-47fe-8bf1-e46fd93e3bc5 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:14.257065 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bbe78-93c2-4af0-9b91-b5408dd2ec8b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:14.259084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-20a74137-cfa5-47fe-8bf1-e46fd93e3bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:14.392047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 55/103] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:14.410737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2de05-afbe-415a-83c4-ba8c90432480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:14.411577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2de05-afbe-415a-83c4-ba8c90432480 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:14.411944 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2de05-afbe-415a-83c4-ba8c90432480 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:14.412227 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2de05-afbe-415a-83c4-ba8c90432480 None admin] PATH_INFO: `/v3/users/52af65c8f39f4ae68548deb395a6c6a1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:14.418312 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2de05-afbe-415a-83c4-ba8c90432480 None admin] RBAC: Authorizing `identity:get_user(user_id=52af65c8f39f4ae68548deb395a6c6a1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:14.419746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2de05-afbe-415a-83c4-ba8c90432480 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:14.421417 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 49/104] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:14 2022] GET /identity/v3/users/52af65c8f39f4ae68548deb395a6c6a1 => generated 275 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:14.427835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a74137-cfa5-47fe-8bf1-e46fd93e3bc5 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:14.435637 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2de05-afbe-415a-83c4-ba8c90432480 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:14.566866 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2de05-afbe-415a-83c4-ba8c90432480 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:14.608943 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1afbe-6f34-4447-ab3a-45827c31cc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:14.609608 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1afbe-6f34-4447-ab3a-45827c31cc77 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:14.609895 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1afbe-6f34-4447-ab3a-45827c31cc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:14.610173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1afbe-6f34-4447-ab3a-45827c31cc77 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:14.629223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1afbe-6f34-4447-ab3a-45827c31cc77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:14.635995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-10d1afbe-6f34-4447-ab3a-45827c31cc77 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 18:59:14.635995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:14.635995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:14.635995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:14.635995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:14.635995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:14.635995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:14.635995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:14.635995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:14.635995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:14.635995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:14.635995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:14.635995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:14.635995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:14.635995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:14.635995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:14.636945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:14.636945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:14.636945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:14.636945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:14.636945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:14.636945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:14.636945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:14.636945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:14.636945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:14.636945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:14.636945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:14.636945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:14.636945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:14.636945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:14.636945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:14.636945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:14.637726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:14.637726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:14.637726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:14.637726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:14.637726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:14.637726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:14.637726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:14.637726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:14.637726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:14.637726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:14.637726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 18:59:14.637726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:14.637726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 50/105] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:14.638361 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a6112-8f36-4ec9-a45f-23c91fd1dda2 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:14.638789 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a6112-8f36-4ec9-a45f-23c91fd1dda2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:14.638789 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a6112-8f36-4ec9-a45f-23c91fd1dda2 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:14.645819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 51/106] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:14.650754 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a6112-8f36-4ec9-a45f-23c91fd1dda2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:14.654391 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a74137-cfa5-47fe-8bf1-e46fd93e3bc5 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:14.690916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:14.697097 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:14.713157 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1984fc-35e1-4c1c-b0cd-48ae3508c219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:14.713833 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1984fc-35e1-4c1c-b0cd-48ae3508c219 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:14.714122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1984fc-35e1-4c1c-b0cd-48ae3508c219 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:14.714402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1984fc-35e1-4c1c-b0cd-48ae3508c219 None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:14.719680 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1984fc-35e1-4c1c-b0cd-48ae3508c219 None admin] RBAC: Authorizing `identity:get_project(project_id=e906580203f24a3787efe33c12436d59)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:14.721197 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1984fc-35e1-4c1c-b0cd-48ae3508c219 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:14.723043 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 56/107] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:14 2022] GET /identity/v3/projects/e906580203f24a3787efe33c12436d59 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:14.724874 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494a4b6-e625-4ca0-b481-67a89b761809 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:14.725297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494a4b6-e625-4ca0-b481-67a89b761809 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:14.732136 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494a4b6-e625-4ca0-b481-67a89b761809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:14.767833 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-7494a4b6-e625-4ca0-b481-67a89b761809 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:14.769051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7494a4b6-e625-4ca0-b481-67a89b761809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:14.840912 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a6112-8f36-4ec9-a45f-23c91fd1dda2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:14.868649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 57/108] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:14.869981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494a4b6-e625-4ca0-b481-67a89b761809 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:14.878438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77384f-1562-474d-a329-63b0c3d27b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:14.879054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77384f-1562-474d-a329-63b0c3d27b8d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:14.879340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77384f-1562-474d-a329-63b0c3d27b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:14.880178 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77384f-1562-474d-a329-63b0c3d27b8d None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:14.881275 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77384f-1562-474d-a329-63b0c3d27b8d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:14.881614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77384f-1562-474d-a329-63b0c3d27b8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:14.883021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77384f-1562-474d-a329-63b0c3d27b8d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:14.892203 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 52/109] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:14.893657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7893f-04fc-4cfd-97b5-4e9b0124bfc4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:14.894119 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7893f-04fc-4cfd-97b5-4e9b0124bfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:14.894542 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7893f-04fc-4cfd-97b5-4e9b0124bfc4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:14.896994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 53/110] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:14.898209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e77cc0-0935-4a72-b620-59303ac9b253 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:14.898638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e77cc0-0935-4a72-b620-59303ac9b253 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:14.899072 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e77cc0-0935-4a72-b620-59303ac9b253 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:14.900691 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 54/111] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:14.901818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e77cc0-0935-4a72-b620-59303ac9b253 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:14.982001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494a4b6-e625-4ca0-b481-67a89b761809 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:14.990082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:15.006287 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:15.012349 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e77cc0-0935-4a72-b620-59303ac9b253 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:15.020314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e7a7c-6861-4f72-ae15-c8ded423c760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:15.021882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e7a7c-6861-4f72-ae15-c8ded423c760 None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:15.022171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e7a7c-6861-4f72-ae15-c8ded423c760 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:15.022458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e7a7c-6861-4f72-ae15-c8ded423c760 None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59/users/52af65c8f39f4ae68548deb395a6c6a1/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:15.024422 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e7a7c-6861-4f72-ae15-c8ded423c760 None admin] RBAC: Authorizing `identity:create_grant(project_id=e906580203f24a3787efe33c12436d59, user_id=52af65c8f39f4ae68548deb395a6c6a1, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:15.025924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e7a7c-6861-4f72-ae15-c8ded423c760 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:15.047552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82263c6f-0b9c-4f28-9f9b-0ad2149239c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:15.048182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82263c6f-0b9c-4f28-9f9b-0ad2149239c6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:15.048464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82263c6f-0b9c-4f28-9f9b-0ad2149239c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:15.048738 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82263c6f-0b9c-4f28-9f9b-0ad2149239c6 None admin] PATH_INFO: `/v3/users/e54114cc544f4c9390757d63b2888138` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:15.062142 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82263c6f-0b9c-4f28-9f9b-0ad2149239c6 None admin] RBAC: Authorizing `identity:get_user(user_id=e54114cc544f4c9390757d63b2888138)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:15.063626 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82263c6f-0b9c-4f28-9f9b-0ad2149239c6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:15.065302 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 55/112] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:14 2022] GET /identity/v3/users/e54114cc544f4c9390757d63b2888138 => generated 289 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:15.066545 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6fde5-04e3-41a9-baca-19ae4b187e40 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:15.070466 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6fde5-04e3-41a9-baca-19ae4b187e40 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:15.070466 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6fde5-04e3-41a9-baca-19ae4b187e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:15.085817 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-dda6fde5-04e3-41a9-baca-19ae4b187e40 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:15.087017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-dda6fde5-04e3-41a9-baca-19ae4b187e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:15.092188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 58/113] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 18:59:14 2022] PUT /identity/v3/projects/e906580203f24a3787efe33c12436d59/users/52af65c8f39f4ae68548deb395a6c6a1/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 18:59:15.093725 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a031369-e4a6-4059-a28b-6704591ac228 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:15.094198 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a031369-e4a6-4059-a28b-6704591ac228 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:15.095050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a031369-e4a6-4059-a28b-6704591ac228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:15.118899 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-8a031369-e4a6-4059-a28b-6704591ac228 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:15.120191 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8a031369-e4a6-4059-a28b-6704591ac228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:15.165044 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 56/114] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:15.166414 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6fde5-04e3-41a9-baca-19ae4b187e40 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:15.218025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 59/115] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:15.219068 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a031369-e4a6-4059-a28b-6704591ac228 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:15.246514 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:15.289743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6fde5-04e3-41a9-baca-19ae4b187e40 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:15.327622 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957ba35-d759-4046-8158-8cb678b6b5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:15.328256 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957ba35-d759-4046-8158-8cb678b6b5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:15.328533 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957ba35-d759-4046-8158-8cb678b6b5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:15.328801 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957ba35-d759-4046-8158-8cb678b6b5d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:15.329932 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957ba35-d759-4046-8158-8cb678b6b5d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:15.331379 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957ba35-d759-4046-8158-8cb678b6b5d2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:15.333497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 57/116] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 18:59:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:15.337477 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957ba35-d759-4046-8158-8cb678b6b5d2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:15.363141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a031369-e4a6-4059-a28b-6704591ac228 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:15.375481 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:15.400997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482d44f-1b2f-4e2d-945f-00a36265f5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:15.401681 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482d44f-1b2f-4e2d-945f-00a36265f5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:15.402016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482d44f-1b2f-4e2d-945f-00a36265f5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:15.402293 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482d44f-1b2f-4e2d-945f-00a36265f5e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:15.437102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957ba35-d759-4046-8158-8cb678b6b5d2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:15.470952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a359008-c9c3-43be-bd54-a326828c1122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:15.471584 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a359008-c9c3-43be-bd54-a326828c1122 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:15.471864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a359008-c9c3-43be-bd54-a326828c1122 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:15.472140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a359008-c9c3-43be-bd54-a326828c1122 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:15.475525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:15.477957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482d44f-1b2f-4e2d-945f-00a36265f5e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:15.479813 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482d44f-1b2f-4e2d-945f-00a36265f5e0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:15.484089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a359008-c9c3-43be-bd54-a326828c1122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:15.488961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-0a359008-c9c3-43be-bd54-a326828c1122 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:15.488961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:15.488961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:15.488961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:15.488961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:15.488961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:15.488961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:15.488961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:15.488961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:15.488961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:15.488961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:15.488961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:15.488961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:15.488961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:15.488961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:15.488961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:15.489929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:15.489929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:15.489929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:15.489929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:15.489929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:15.489929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:15.489929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:15.489929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:15.489929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:15.489929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:15.489929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:15.489929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:15.489929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:15.489929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:15.489929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:15.489929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:15.490690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:15.490690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:15.490690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:15.490690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:15.490690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:15.490690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:15.490690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:15.490690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:15.490690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:15.490690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:15.490690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:15.490690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:15.490690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 58/117] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:15.491720 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a359008-c9c3-43be-bd54-a326828c1122 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:15.599718 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a359008-c9c3-43be-bd54-a326828c1122 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:15.600721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 60/118] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:15.601768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482d44f-1b2f-4e2d-945f-00a36265f5e0 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:15.615297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:15.638624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f35e4d-1072-4d03-aa77-444fbafe96c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:15.639265 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f35e4d-1072-4d03-aa77-444fbafe96c3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:15.639553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f35e4d-1072-4d03-aa77-444fbafe96c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:15.639874 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f35e4d-1072-4d03-aa77-444fbafe96c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:15.651839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f35e4d-1072-4d03-aa77-444fbafe96c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:15.656624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-c1f35e4d-1072-4d03-aa77-444fbafe96c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:15.656624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:15.656624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:15.656624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:15.656624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:15.656624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:15.656624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:15.656624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:15.656624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:15.656624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:15.656624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:15.656624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:15.656624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:15.656624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:15.656624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:15.656624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:15.657682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:15.657682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:15.657682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:15.657682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:15.657682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:15.657682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:15.657682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:15.657682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:15.657682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:15.657682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:15.657682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:15.657682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:15.657682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:15.657682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:15.657682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:15.657682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:15.658542 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:15.658542 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:15.658542 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:15.658542 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:15.658542 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:15.658542 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:15.658542 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:15.658542 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:15.658542 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:15.658542 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:15.658542 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:15.658542 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:15.658542 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 59/119] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 18:59:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:15.659322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f191ef-245f-401f-a044-842953c49de6 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:15.659501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f191ef-245f-401f-a044-842953c49de6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:15.659777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f191ef-245f-401f-a044-842953c49de6 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:15.661808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 60/120] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:15.662533 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f191ef-245f-401f-a044-842953c49de6 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:15.713535 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482d44f-1b2f-4e2d-945f-00a36265f5e0 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:15.728097 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:15.750121 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcd8d8-6fc2-49e6-87e9-27b163ba6478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:15.750910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcd8d8-6fc2-49e6-87e9-27b163ba6478 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:15.751210 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcd8d8-6fc2-49e6-87e9-27b163ba6478 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:15.751486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcd8d8-6fc2-49e6-87e9-27b163ba6478 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:15.752138 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcd8d8-6fc2-49e6-87e9-27b163ba6478 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:15.753766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcd8d8-6fc2-49e6-87e9-27b163ba6478 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:15.775056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f191ef-245f-401f-a044-842953c49de6 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:15.810359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243db9b-310f-47a5-b91e-42fe62599924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:15.810970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243db9b-310f-47a5-b91e-42fe62599924 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:15.811256 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243db9b-310f-47a5-b91e-42fe62599924 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:15.811535 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243db9b-310f-47a5-b91e-42fe62599924 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:15.812199 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243db9b-310f-47a5-b91e-42fe62599924 None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:15.812509 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243db9b-310f-47a5-b91e-42fe62599924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:15.814031 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243db9b-310f-47a5-b91e-42fe62599924 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:15.823651 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 61/121] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:15.824462 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243db9b-310f-47a5-b91e-42fe62599924 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:15.861479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 61/122] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Aug 9 18:59:15 2022] POST /identity/v3/projects => generated 302 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 18:59:15.861479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcd8d8-6fc2-49e6-87e9-27b163ba6478 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:15.937477 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:15.972466 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243db9b-310f-47a5-b91e-42fe62599924 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:15.991637 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcd8d8-6fc2-49e6-87e9-27b163ba6478 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:15.993635 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:16.015768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e5218-b889-438d-b27b-9a691be31942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:16.016500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e5218-b889-438d-b27b-9a691be31942 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:16.016786 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e5218-b889-438d-b27b-9a691be31942 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:16.017116 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e5218-b889-438d-b27b-9a691be31942 None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:16.018455 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e5218-b889-438d-b27b-9a691be31942 None admin] RBAC: Authorizing `identity:get_project(project_id=e906580203f24a3787efe33c12436d59)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:16.020687 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e5218-b889-438d-b27b-9a691be31942 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:16.028470 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 62/123] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:15 2022] GET /identity/v3/projects/e906580203f24a3787efe33c12436d59 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:16.029901 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21826db-5f64-4cef-b6b5-db8d7a7814b3 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:16.031296 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21826db-5f64-4cef-b6b5-db8d7a7814b3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:16.031296 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21826db-5f64-4cef-b6b5-db8d7a7814b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:16.039130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e3469-99f1-498b-b6a8-b58063e6db33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:16.039769 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e3469-99f1-498b-b6a8-b58063e6db33 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:16.040060 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e3469-99f1-498b-b6a8-b58063e6db33 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:16.040335 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e3469-99f1-498b-b6a8-b58063e6db33 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:16.041016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e3469-99f1-498b-b6a8-b58063e6db33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:16.041329 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e3469-99f1-498b-b6a8-b58063e6db33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:16.042865 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e3469-99f1-498b-b6a8-b58063e6db33 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:16.055785 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 62/124] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:16.057333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e3469-99f1-498b-b6a8-b58063e6db33 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:16.060676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e21826db-5f64-4cef-b6b5-db8d7a7814b3 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:16.062354 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e21826db-5f64-4cef-b6b5-db8d7a7814b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:16.155583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 63/125] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:16.157068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21826db-5f64-4cef-b6b5-db8d7a7814b3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:16.178300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e3469-99f1-498b-b6a8-b58063e6db33 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:16.213625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:16.232836 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b83b75-031b-46a3-a7e4-6a3d4ebd7697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:16.232836 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b83b75-031b-46a3-a7e4-6a3d4ebd7697 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:16.232836 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b83b75-031b-46a3-a7e4-6a3d4ebd7697 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:16.232836 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b83b75-031b-46a3-a7e4-6a3d4ebd7697 None admin] PATH_INFO: `/v3/users/52af65c8f39f4ae68548deb395a6c6a1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:16.233177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b83b75-031b-46a3-a7e4-6a3d4ebd7697 None admin] RBAC: Authorizing `identity:get_user(user_id=52af65c8f39f4ae68548deb395a6c6a1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:16.233177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b83b75-031b-46a3-a7e4-6a3d4ebd7697 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:16.234867 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 63/126] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:16 2022] GET /identity/v3/users/52af65c8f39f4ae68548deb395a6c6a1 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:16.235499 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b83b75-031b-46a3-a7e4-6a3d4ebd7697 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:16.277218 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21826db-5f64-4cef-b6b5-db8d7a7814b3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:16.295619 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:16.319492 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839d93b-e948-4123-a0ca-c2ea50f128bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:16.320167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839d93b-e948-4123-a0ca-c2ea50f128bf None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:16.320503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839d93b-e948-4123-a0ca-c2ea50f128bf None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:16.320811 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839d93b-e948-4123-a0ca-c2ea50f128bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:16.321677 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839d93b-e948-4123-a0ca-c2ea50f128bf None admin] RBAC: Adding query filter params (role.id=55b7e38eaf134f788a30329b137436ec, scope.project.id=e906580203f24a3787efe33c12436d59, user.id=e54114cc544f4c9390757d63b2888138) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:16.321990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839d93b-e948-4123-a0ca-c2ea50f128bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:16.323443 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839d93b-e948-4123-a0ca-c2ea50f128bf None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:16.338107 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 64/127] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 18:59:16 2022] GET /identity/v3/role_assignments?user.id=e54114cc544f4c9390757d63b2888138&scope.project.id=e906580203f24a3787efe33c12436d59&role.id=55b7e38eaf134f788a30329b137436ec => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:16.339194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839d93b-e948-4123-a0ca-c2ea50f128bf None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:16.360192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b83b75-031b-46a3-a7e4-6a3d4ebd7697 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:16.406108 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba3186-0a93-4957-9405-3c66bcfc0594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:16.406775 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba3186-0a93-4957-9405-3c66bcfc0594 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:16.407056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba3186-0a93-4957-9405-3c66bcfc0594 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:16.407327 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba3186-0a93-4957-9405-3c66bcfc0594 None admin] PATH_INFO: `/v3/users/de54cc4aa2214403a8d5cfbff5af1478` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:16.412910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba3186-0a93-4957-9405-3c66bcfc0594 None admin] RBAC: Authorizing `identity:get_user(user_id=de54cc4aa2214403a8d5cfbff5af1478)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:16.414464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba3186-0a93-4957-9405-3c66bcfc0594 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:16.421306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 64/128] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:16 2022] GET /identity/v3/users/de54cc4aa2214403a8d5cfbff5af1478 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:16.421989 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba3186-0a93-4957-9405-3c66bcfc0594 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:16.501892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:16.552318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba3186-0a93-4957-9405-3c66bcfc0594 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:16.569233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839d93b-e948-4123-a0ca-c2ea50f128bf None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:16.591578 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5476a01-d081-41a1-9239-1e4b2da5290e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:16.592695 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5476a01-d081-41a1-9239-1e4b2da5290e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:16.593188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5476a01-d081-41a1-9239-1e4b2da5290e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:16.593678 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5476a01-d081-41a1-9239-1e4b2da5290e None admin] PATH_INFO: `/v3/projects/639e0c6b4edc4b0194bdc5db0ab143fc` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:16.595161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5476a01-d081-41a1-9239-1e4b2da5290e None admin] RBAC: Authorizing `identity:get_project(project_id=639e0c6b4edc4b0194bdc5db0ab143fc)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:16.597044 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5476a01-d081-41a1-9239-1e4b2da5290e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:16.599227 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 65/129] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:16 2022] GET /identity/v3/projects/639e0c6b4edc4b0194bdc5db0ab143fc => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:16.600209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5476a01-d081-41a1-9239-1e4b2da5290e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:16.618262 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51d2da-57eb-4249-873f-5170ec1bff58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:16.618974 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51d2da-57eb-4249-873f-5170ec1bff58 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:16.619259 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51d2da-57eb-4249-873f-5170ec1bff58 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:16.619507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51d2da-57eb-4249-873f-5170ec1bff58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:16.634067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51d2da-57eb-4249-873f-5170ec1bff58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:16.647599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-bc51d2da-57eb-4249-873f-5170ec1bff58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:16.647599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:16.647599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:16.647599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:16.647599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:16.647599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:16.647599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:16.647599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:16.647599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:16.647599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:16.647599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:16.647599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:16.647599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:16.647599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:16.647599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:16.647599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:16.648490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:16.648490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:16.648490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:16.648490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:16.648490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:16.648490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:16.648490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:16.648490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:16.648490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:16.648490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:16.648490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:16.648490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:16.648490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:16.648490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:16.648490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:16.648490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:16.649251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:16.649251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:16.649251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:16.649251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:16.649251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:16.649251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:16.649251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:16.649251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:16.649251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:16.649251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:16.649251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:16.649251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:16.649251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 65/130] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 18:59:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:16.654429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51d2da-57eb-4249-873f-5170ec1bff58 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:16.716289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5476a01-d081-41a1-9239-1e4b2da5290e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:16.728803 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:16.778871 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:16.792439 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb18449-65ec-4531-b091-b691a4dac4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:16.793086 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb18449-65ec-4531-b091-b691a4dac4ac None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:16.793420 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb18449-65ec-4531-b091-b691a4dac4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:16.793722 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb18449-65ec-4531-b091-b691a4dac4ac None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:16.799207 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb18449-65ec-4531-b091-b691a4dac4ac None admin] RBAC: Authorizing `identity:get_project(project_id=e906580203f24a3787efe33c12436d59)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:16.799207 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb18449-65ec-4531-b091-b691a4dac4ac None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:16.803378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 66/131] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:16 2022] GET /identity/v3/projects/e906580203f24a3787efe33c12436d59 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:16.804280 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb18449-65ec-4531-b091-b691a4dac4ac None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:16.829281 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51d2da-57eb-4249-873f-5170ec1bff58 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:16.892129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc30bc7-c99e-4f7b-a1f8-d4865f7b3bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:16.892848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc30bc7-c99e-4f7b-a1f8-d4865f7b3bdd None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:16.893131 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc30bc7-c99e-4f7b-a1f8-d4865f7b3bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:16.893405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc30bc7-c99e-4f7b-a1f8-d4865f7b3bdd None admin] PATH_INFO: `/v3/projects/639e0c6b4edc4b0194bdc5db0ab143fc/users/52af65c8f39f4ae68548deb395a6c6a1/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:16.896259 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc30bc7-c99e-4f7b-a1f8-d4865f7b3bdd None admin] RBAC: Authorizing `identity:create_grant(project_id=639e0c6b4edc4b0194bdc5db0ab143fc, user_id=52af65c8f39f4ae68548deb395a6c6a1, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:16.900515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc30bc7-c99e-4f7b-a1f8-d4865f7b3bdd None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:16.954376 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb18449-65ec-4531-b091-b691a4dac4ac None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:16.995072 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd290cab-dec9-4532-aa4e-ce83d3dc1754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:16.996039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd290cab-dec9-4532-aa4e-ce83d3dc1754 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:16.996604 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd290cab-dec9-4532-aa4e-ce83d3dc1754 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:16.997150 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd290cab-dec9-4532-aa4e-ce83d3dc1754 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:16.998067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd290cab-dec9-4532-aa4e-ce83d3dc1754 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:16.998532 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd290cab-dec9-4532-aa4e-ce83d3dc1754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:17.000139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd290cab-dec9-4532-aa4e-ce83d3dc1754 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:17.009972 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 67/132] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 18:59:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:17.011088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd290cab-dec9-4532-aa4e-ce83d3dc1754 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:17.046356 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 66/133] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 18:59:16 2022] PUT /identity/v3/projects/639e0c6b4edc4b0194bdc5db0ab143fc/users/52af65c8f39f4ae68548deb395a6c6a1/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 18:59:17.046356 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc30bc7-c99e-4f7b-a1f8-d4865f7b3bdd None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:17.077000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:17.129173 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd290cab-dec9-4532-aa4e-ce83d3dc1754 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:17.167037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277ea62-b610-4376-800f-2afa02d65b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:17.168081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277ea62-b610-4376-800f-2afa02d65b9c None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:17.168567 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277ea62-b610-4376-800f-2afa02d65b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:17.169039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277ea62-b610-4376-800f-2afa02d65b9c None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59/users/de54cc4aa2214403a8d5cfbff5af1478/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:17.171297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277ea62-b610-4376-800f-2afa02d65b9c None admin] RBAC: Authorizing `identity:create_grant(project_id=e906580203f24a3787efe33c12436d59, user_id=de54cc4aa2214403a8d5cfbff5af1478, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:17.173076 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277ea62-b610-4376-800f-2afa02d65b9c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:17.180495 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:17.189848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc30bc7-c99e-4f7b-a1f8-d4865f7b3bdd None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:17.248698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 68/134] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 18:59:17 2022] PUT /identity/v3/projects/e906580203f24a3787efe33c12436d59/users/de54cc4aa2214403a8d5cfbff5af1478/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 18:59:17.251067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91115f0-3a58-4559-b5c9-2e6bea9520a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:17.251067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91115f0-3a58-4559-b5c9-2e6bea9520a1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:17.251067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91115f0-3a58-4559-b5c9-2e6bea9520a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:17.251067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91115f0-3a58-4559-b5c9-2e6bea9520a1 None admin] PATH_INFO: `/v3/users/52af65c8f39f4ae68548deb395a6c6a1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:17.251728 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91115f0-3a58-4559-b5c9-2e6bea9520a1 None admin] RBAC: Authorizing `identity:get_user(user_id=52af65c8f39f4ae68548deb395a6c6a1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:17.253338 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91115f0-3a58-4559-b5c9-2e6bea9520a1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:17.255275 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 67/135] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:17 2022] GET /identity/v3/users/52af65c8f39f4ae68548deb395a6c6a1 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:17.261850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277ea62-b610-4376-800f-2afa02d65b9c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:17.336052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc0248-2beb-451b-a28f-af1dba4cc50d None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:17.336052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc0248-2beb-451b-a28f-af1dba4cc50d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:17.336362 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc0248-2beb-451b-a28f-af1dba4cc50d None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:17.338064 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 68/136] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 18:59:17.344600 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99421c-0700-473a-80a4-af890fc1ef18 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:17.344932 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99421c-0700-473a-80a4-af890fc1ef18 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:17.345312 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99421c-0700-473a-80a4-af890fc1ef18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:17.375695 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ee99421c-0700-473a-80a4-af890fc1ef18 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:17.376962 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ee99421c-0700-473a-80a4-af890fc1ef18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:17.472199 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277ea62-b610-4376-800f-2afa02d65b9c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:17.512521 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:17.530399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 69/137] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:17.538860 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad583c3-bc11-4e7a-9dd9-1df01d8ffc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:17.539843 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad583c3-bc11-4e7a-9dd9-1df01d8ffc35 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:17.540317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad583c3-bc11-4e7a-9dd9-1df01d8ffc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:17.540777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad583c3-bc11-4e7a-9dd9-1df01d8ffc35 None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:17.542139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad583c3-bc11-4e7a-9dd9-1df01d8ffc35 None admin] RBAC: Authorizing `identity:get_project(project_id=e906580203f24a3787efe33c12436d59)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:17.543828 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad583c3-bc11-4e7a-9dd9-1df01d8ffc35 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:17.545739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 69/138] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:17 2022] GET /identity/v3/projects/e906580203f24a3787efe33c12436d59 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:17.552800 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99421c-0700-473a-80a4-af890fc1ef18 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:17.563661 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad583c3-bc11-4e7a-9dd9-1df01d8ffc35 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:17.708203 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad583c3-bc11-4e7a-9dd9-1df01d8ffc35 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:17.745288 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5baa0-e028-4a1b-8fee-aee56a9fb93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:17.747153 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5baa0-e028-4a1b-8fee-aee56a9fb93f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:17.747652 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5baa0-e028-4a1b-8fee-aee56a9fb93f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:17.748118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5baa0-e028-4a1b-8fee-aee56a9fb93f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:17.760018 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5baa0-e028-4a1b-8fee-aee56a9fb93f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:17.765583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-cfb5baa0-e028-4a1b-8fee-aee56a9fb93f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:17.765583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:17.765583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:17.765583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:17.765583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:17.765583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:17.765583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:17.765583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:17.765583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:17.765583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:17.765583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:17.765583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:17.765583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:17.765583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:17.765583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:17.765583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:17.766433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:17.766433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:17.766433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:17.766433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:17.766433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:17.766433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:17.766433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:17.766433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:17.766433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:17.766433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:17.766433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:17.766433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:17.766433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:17.766433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:17.766433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:17.766433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:17.767189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:17.767189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:17.767189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:17.767189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:17.767189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:17.767189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:17.767189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:17.767189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:17.767189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:17.767189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:17.767189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:17.767189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:17.769383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 70/139] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:17.778846 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5baa0-e028-4a1b-8fee-aee56a9fb93f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:17.789971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:17.800567 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99421c-0700-473a-80a4-af890fc1ef18 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:17.865674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:17.890218 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65252c49-82c0-440d-aa31-9e22e73e763e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:17.890910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65252c49-82c0-440d-aa31-9e22e73e763e None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:17.891205 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65252c49-82c0-440d-aa31-9e22e73e763e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:17.891485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65252c49-82c0-440d-aa31-9e22e73e763e None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59/users/52af65c8f39f4ae68548deb395a6c6a1/roles/e4ff1977289a44cea73b844f8ad102a1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:17.900665 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65252c49-82c0-440d-aa31-9e22e73e763e None admin] RBAC: Authorizing `identity:create_grant(project_id=e906580203f24a3787efe33c12436d59, user_id=52af65c8f39f4ae68548deb395a6c6a1, role_id=e4ff1977289a44cea73b844f8ad102a1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:17.902798 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65252c49-82c0-440d-aa31-9e22e73e763e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:17.946607 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5baa0-e028-4a1b-8fee-aee56a9fb93f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:17.992066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efe78d-b7e9-4e63-bd93-6056c873831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:17.992239 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 70/140] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 18:59:17 2022] PUT /identity/v3/projects/e906580203f24a3787efe33c12436d59/users/52af65c8f39f4ae68548deb395a6c6a1/roles/e4ff1977289a44cea73b844f8ad102a1 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 18:59:17.993111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efe78d-b7e9-4e63-bd93-6056c873831c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:17.993615 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efe78d-b7e9-4e63-bd93-6056c873831c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:17.994074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efe78d-b7e9-4e63-bd93-6056c873831c None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:17.994947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efe78d-b7e9-4e63-bd93-6056c873831c None admin] RBAC: Adding query filter params (name=member) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:17.995440 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efe78d-b7e9-4e63-bd93-6056c873831c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:17.997185 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efe78d-b7e9-4e63-bd93-6056c873831c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:18.008030 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 71/141] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:18.014481 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65252c49-82c0-440d-aa31-9e22e73e763e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:18.166572 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65252c49-82c0-440d-aa31-9e22e73e763e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:18.208354 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada517b-ee0e-4dd9-b8a8-585da60d9c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:18.209336 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada517b-ee0e-4dd9-b8a8-585da60d9c15 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:18.209653 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada517b-ee0e-4dd9-b8a8-585da60d9c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:18.209934 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada517b-ee0e-4dd9-b8a8-585da60d9c15 None admin] PATH_INFO: `/v3/users/52af65c8f39f4ae68548deb395a6c6a1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:18.211226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada517b-ee0e-4dd9-b8a8-585da60d9c15 None admin] RBAC: Authorizing `identity:get_user(user_id=52af65c8f39f4ae68548deb395a6c6a1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:18.212767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada517b-ee0e-4dd9-b8a8-585da60d9c15 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:18.214456 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 71/142] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:18 2022] GET /identity/v3/users/52af65c8f39f4ae68548deb395a6c6a1 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:18.220088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efe78d-b7e9-4e63-bd93-6056c873831c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:18.341344 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efe78d-b7e9-4e63-bd93-6056c873831c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:18.357017 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:18.377001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fd579-bc77-43b6-9bc0-5c2f4d35debe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:18.377657 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fd579-bc77-43b6-9bc0-5c2f4d35debe None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:18.378029 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fd579-bc77-43b6-9bc0-5c2f4d35debe None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:18.378304 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fd579-bc77-43b6-9bc0-5c2f4d35debe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:18.450619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fd579-bc77-43b6-9bc0-5c2f4d35debe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:18.452109 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fd579-bc77-43b6-9bc0-5c2f4d35debe None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:18.565129 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 72/143] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 18:59:18.574573 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada517b-ee0e-4dd9-b8a8-585da60d9c15 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:18.627579 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:18.681311 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a99db-0f3a-4fd0-8ee0-9d2a0691ed1b None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:18.682003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a99db-0f3a-4fd0-8ee0-9d2a0691ed1b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:18.682466 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a99db-0f3a-4fd0-8ee0-9d2a0691ed1b None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:18.684299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 73/144] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:18.689840 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824aa1e8-3360-4c33-96b2-b3c2292314e8 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:18.690368 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824aa1e8-3360-4c33-96b2-b3c2292314e8 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:18.690851 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824aa1e8-3360-4c33-96b2-b3c2292314e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:18.711237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-824aa1e8-3360-4c33-96b2-b3c2292314e8 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:18.712768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-824aa1e8-3360-4c33-96b2-b3c2292314e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:18.716682 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:18.752724 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada517b-ee0e-4dd9-b8a8-585da60d9c15 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:18.787465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 74/145] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:18.812820 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824aa1e8-3360-4c33-96b2-b3c2292314e8 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:18.839096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c4aa1-96b1-46cc-89d8-f798d20f56a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:18.839736 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c4aa1-96b1-46cc-89d8-f798d20f56a6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:18.840250 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c4aa1-96b1-46cc-89d8-f798d20f56a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:18.840352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c4aa1-96b1-46cc-89d8-f798d20f56a6 None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:18.841439 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c4aa1-96b1-46cc-89d8-f798d20f56a6 None admin] RBAC: Authorizing `identity:get_project(project_id=e906580203f24a3787efe33c12436d59)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:18.842933 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c4aa1-96b1-46cc-89d8-f798d20f56a6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:18.844740 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 72/146] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:18 2022] GET /identity/v3/projects/e906580203f24a3787efe33c12436d59 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:18.853912 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c4aa1-96b1-46cc-89d8-f798d20f56a6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:18.924572 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824aa1e8-3360-4c33-96b2-b3c2292314e8 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:18.961561 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe69e33-ae06-4907-b025-8cf985444561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:18.962557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe69e33-ae06-4907-b025-8cf985444561 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:18.963025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe69e33-ae06-4907-b025-8cf985444561 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:18.963523 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe69e33-ae06-4907-b025-8cf985444561 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:18.964944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe69e33-ae06-4907-b025-8cf985444561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:18.966668 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe69e33-ae06-4907-b025-8cf985444561 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:18.968709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 75/147] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 18:59:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:18.974609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe69e33-ae06-4907-b025-8cf985444561 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:18.986317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:19.083609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe69e33-ae06-4907-b025-8cf985444561 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:19.109155 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:19.123209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecceb6-4fd4-4743-830d-b34ed894070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:19.123872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecceb6-4fd4-4743-830d-b34ed894070e None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:19.124159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecceb6-4fd4-4743-830d-b34ed894070e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:19.124470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecceb6-4fd4-4743-830d-b34ed894070e None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:19.125136 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecceb6-4fd4-4743-830d-b34ed894070e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:19.126626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecceb6-4fd4-4743-830d-b34ed894070e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:19.128250 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c4aa1-96b1-46cc-89d8-f798d20f56a6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:19.174854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e100af3-cdb8-43b7-9131-25404bba8d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:19.175391 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e100af3-cdb8-43b7-9131-25404bba8d2f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:19.175670 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e100af3-cdb8-43b7-9131-25404bba8d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:19.175944 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e100af3-cdb8-43b7-9131-25404bba8d2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:19.177294 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e100af3-cdb8-43b7-9131-25404bba8d2f None admin] RBAC: Adding query filter params (role.id=ead9959857d24ec6bea3b7556da18ce5, scope.project.id=e906580203f24a3787efe33c12436d59, user.id=52af65c8f39f4ae68548deb395a6c6a1) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:19.177631 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e100af3-cdb8-43b7-9131-25404bba8d2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:19.179276 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e100af3-cdb8-43b7-9131-25404bba8d2f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:19.185885 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 73/148] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 18:59:18 2022] GET /identity/v3/role_assignments?user.id=52af65c8f39f4ae68548deb395a6c6a1&scope.project.id=e906580203f24a3787efe33c12436d59&role.id=ead9959857d24ec6bea3b7556da18ce5 => generated 608 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:19.187126 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74926985-4244-4d2b-9875-75d725d46bfc None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:19.187583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74926985-4244-4d2b-9875-75d725d46bfc None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:19.187861 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74926985-4244-4d2b-9875-75d725d46bfc None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:19.189311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 74/149] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:19.198909 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eb646-45d7-42b9-a0fc-5cc7d5f40304 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:19.199258 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eb646-45d7-42b9-a0fc-5cc7d5f40304 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:19.199534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89eb646-45d7-42b9-a0fc-5cc7d5f40304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:19.220879 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a89eb646-45d7-42b9-a0fc-5cc7d5f40304 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:19.222201 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a89eb646-45d7-42b9-a0fc-5cc7d5f40304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:19.232007 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 76/150] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Aug 9 18:59:18 2022] POST /identity/v3/users => generated 283 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 18:59:19.322012 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 75/151] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:19.369444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecceb6-4fd4-4743-830d-b34ed894070e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:19.443595 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:19.488315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecceb6-4fd4-4743-830d-b34ed894070e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:19.544863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a43720-a4d9-4218-a700-3f6da3db33a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:19.545589 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a43720-a4d9-4218-a700-3f6da3db33a6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:19.545867 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a43720-a4d9-4218-a700-3f6da3db33a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:19.546139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a43720-a4d9-4218-a700-3f6da3db33a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:19.559655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a43720-a4d9-4218-a700-3f6da3db33a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:19.565054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-48a43720-a4d9-4218-a700-3f6da3db33a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 18:59:19.565054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:19.565054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:19.565054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:19.565054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:19.565054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:19.565054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:19.565054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:19.565054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:19.565054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:19.565054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:19.565054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:19.565054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:19.565054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:19.565054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:19.565054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:19.565952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:19.565952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:19.565952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:19.565952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:19.565952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:19.565952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:19.565952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:19.565952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:19.565952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:19.565952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:19.565952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:19.565952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:19.565952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:19.565952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:19.565952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:19.565952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:19.567457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:19.567457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:19.567457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:19.567457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:19.567457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:19.567457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:19.567457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:19.567457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:19.567457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:19.567457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:19.567457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 18:59:19.567457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:19.567457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 77/152] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:19.572695 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89eb646-45d7-42b9-a0fc-5cc7d5f40304 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:19.683476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:19.698393 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89eb646-45d7-42b9-a0fc-5cc7d5f40304 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:19.743178 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c015502-185a-4759-a763-f80173ddd5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:19.743790 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c015502-185a-4759-a763-f80173ddd5ad None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:19.744059 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c015502-185a-4759-a763-f80173ddd5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:19.744327 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c015502-185a-4759-a763-f80173ddd5ad None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:19.744994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c015502-185a-4759-a763-f80173ddd5ad None admin] RBAC: Adding query filter params (name=reader) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:19.745290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c015502-185a-4759-a763-f80173ddd5ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:19.746698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c015502-185a-4759-a763-f80173ddd5ad None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:19.756228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 76/153] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:19.761718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a43720-a4d9-4218-a700-3f6da3db33a6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:19.896273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a43720-a4d9-4218-a700-3f6da3db33a6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:19.921118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:19.934600 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d9956-e872-4df2-ab4a-584f35b09e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:19.935565 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d9956-e872-4df2-ab4a-584f35b09e11 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:19.936042 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d9956-e872-4df2-ab4a-584f35b09e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:19.936511 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d9956-e872-4df2-ab4a-584f35b09e11 None admin] PATH_INFO: `/v3/users/e54114cc544f4c9390757d63b2888138` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:19.940553 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d9956-e872-4df2-ab4a-584f35b09e11 None admin] RBAC: Authorizing `identity:get_user(user_id=e54114cc544f4c9390757d63b2888138)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:19.946942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d9956-e872-4df2-ab4a-584f35b09e11 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:19.946942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 78/154] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:19 2022] GET /identity/v3/users/e54114cc544f4c9390757d63b2888138 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:19.950009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c015502-185a-4759-a763-f80173ddd5ad None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:20.074323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c015502-185a-4759-a763-f80173ddd5ad None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:20.114672 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fdb8b-2166-414d-8b64-c91f27632e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:20.115306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fdb8b-2166-414d-8b64-c91f27632e55 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:20.115586 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fdb8b-2166-414d-8b64-c91f27632e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:20.115858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fdb8b-2166-414d-8b64-c91f27632e55 None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:20.117774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fdb8b-2166-414d-8b64-c91f27632e55 None admin] RBAC: Authorizing `identity:get_project(project_id=e906580203f24a3787efe33c12436d59)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:20.119228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fdb8b-2166-414d-8b64-c91f27632e55 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:20.121095 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 77/155] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:19 2022] GET /identity/v3/projects/e906580203f24a3787efe33c12436d59 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:20.126616 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d9956-e872-4df2-ab4a-584f35b09e11 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:20.240152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d9956-e872-4df2-ab4a-584f35b09e11 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:20.277520 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75117a-f7f4-41ba-bb8f-335e0893b4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:20.278189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75117a-f7f4-41ba-bb8f-335e0893b4e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:20.278467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75117a-f7f4-41ba-bb8f-335e0893b4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:20.278736 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75117a-f7f4-41ba-bb8f-335e0893b4e8 None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59/users/e54114cc544f4c9390757d63b2888138/roles/55b7e38eaf134f788a30329b137436ec` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:20.280770 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75117a-f7f4-41ba-bb8f-335e0893b4e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e906580203f24a3787efe33c12436d59, user_id=e54114cc544f4c9390757d63b2888138, role_id=55b7e38eaf134f788a30329b137436ec)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:20.282291 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75117a-f7f4-41ba-bb8f-335e0893b4e8 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:20.310468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b55b04-df96-44db-9351-194e8b6792f2 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:20.310774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b55b04-df96-44db-9351-194e8b6792f2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:20.311019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b55b04-df96-44db-9351-194e8b6792f2 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:20.312674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 78/156] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:20.320412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b79dc-ea68-40c2-9040-02c99a47e132 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:20.320694 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b79dc-ea68-40c2-9040-02c99a47e132 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:20.320961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b79dc-ea68-40c2-9040-02c99a47e132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:20.341573 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-864b79dc-ea68-40c2-9040-02c99a47e132 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:20.342771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-864b79dc-ea68-40c2-9040-02c99a47e132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:20.357765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:20.365479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 79/157] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 18:59:20 2022] PUT /identity/v3/projects/e906580203f24a3787efe33c12436d59/users/e54114cc544f4c9390757d63b2888138/roles/55b7e38eaf134f788a30329b137436ec => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 18:59:20.436997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220bee9-1928-413a-a7ca-9bfbdafde491 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:20.437389 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220bee9-1928-413a-a7ca-9bfbdafde491 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:20.437901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220bee9-1928-413a-a7ca-9bfbdafde491 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:20.438012 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 79/158] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:20.439264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 80/159] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 18:59:20.444792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a713f4-363d-4ba9-9551-195adf41c81c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:20.445075 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a713f4-363d-4ba9-9551-195adf41c81c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:20.445344 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a713f4-363d-4ba9-9551-195adf41c81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:20.468176 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220bee9-1928-413a-a7ca-9bfbdafde491 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:20.473938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a0a713f4-363d-4ba9-9551-195adf41c81c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:20.480848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a0a713f4-363d-4ba9-9551-195adf41c81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:20.587340 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:20.633697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 80/160] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:20.672865 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220bee9-1928-413a-a7ca-9bfbdafde491 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:20.676980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a713f4-363d-4ba9-9551-195adf41c81c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:20.725522 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70753b3f-ee8e-4324-8138-2c177a70b045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:20.726174 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70753b3f-ee8e-4324-8138-2c177a70b045 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:20.726448 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70753b3f-ee8e-4324-8138-2c177a70b045 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:20.726715 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70753b3f-ee8e-4324-8138-2c177a70b045 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:20.741933 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70753b3f-ee8e-4324-8138-2c177a70b045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:20.747316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-70753b3f-ee8e-4324-8138-2c177a70b045 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:20.747316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:20.747316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:20.747316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:20.747316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:20.747316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:20.747316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:20.747316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:20.747316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:20.747316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:20.747316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:20.747316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:20.747316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:20.747316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:20.747316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:20.747316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:20.748226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:20.748226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:20.748226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:20.748226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:20.748226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:20.748226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:20.748226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:20.748226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:20.748226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:20.748226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:20.748226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:20.748226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:20.748226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:20.748226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:20.748226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:20.748226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:20.749103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:20.749103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:20.749103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:20.749103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:20.749103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:20.749103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:20.749103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:20.749103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:20.749103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:20.749103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:20.749103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:20.749103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:20.749103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 81/161] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 18:59:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 18:59:20.756888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70753b3f-ee8e-4324-8138-2c177a70b045 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:20.796598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:20.827910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a713f4-363d-4ba9-9551-195adf41c81c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:20.864768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70753b3f-ee8e-4324-8138-2c177a70b045 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:20.875130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583284d-122a-461a-a4e9-4ab3a6ddd761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:20.876127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583284d-122a-461a-a4e9-4ab3a6ddd761 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:20.876417 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:20.876736 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583284d-122a-461a-a4e9-4ab3a6ddd761 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:20.877334 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583284d-122a-461a-a4e9-4ab3a6ddd761 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:20.899045 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583284d-122a-461a-a4e9-4ab3a6ddd761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:20.907436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-2583284d-122a-461a-a4e9-4ab3a6ddd761 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:20.907436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:20.907436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:20.907436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:20.907436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:20.907436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:20.907436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:20.907436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:20.907436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:20.907436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:20.907436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:20.907436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:20.907436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:20.907436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:20.907436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:20.907436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:20.908539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:20.908539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:20.908539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:20.908539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:20.908539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:20.908539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:20.908539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:20.908539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:20.908539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:20.908539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:20.908539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:20.908539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:20.908539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:20.908539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:20.908539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:20.908539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:20.909515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:20.909515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:20.909515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:20.909515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:20.909515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:20.909515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:20.909515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:20.909515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:20.909515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:20.909515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:20.909515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:20.909515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:20.913551 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 81/162] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 18:59:20.917097 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e30f4e-1a90-4730-9d2b-69bbbfa33aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:20.918388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e30f4e-1a90-4730-9d2b-69bbbfa33aaf None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:20.918802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e30f4e-1a90-4730-9d2b-69bbbfa33aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:20.919771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583284d-122a-461a-a4e9-4ab3a6ddd761 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:20.923385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e30f4e-1a90-4730-9d2b-69bbbfa33aaf None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:20.924247 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e30f4e-1a90-4730-9d2b-69bbbfa33aaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:20.924689 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e30f4e-1a90-4730-9d2b-69bbbfa33aaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:20.926622 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e30f4e-1a90-4730-9d2b-69bbbfa33aaf None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:20.959194 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 82/163] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:20.972447 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ae8a9-e986-49d2-8ec7-ec6b86b53ff2 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:20.972729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ae8a9-e986-49d2-8ec7-ec6b86b53ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:20.973540 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ae8a9-e986-49d2-8ec7-ec6b86b53ff2 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:20.975146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 83/164] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:20.975909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ae8a9-e986-49d2-8ec7-ec6b86b53ff2 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:21.073568 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583284d-122a-461a-a4e9-4ab3a6ddd761 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:21.150752 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce1a7c-e204-4491-801f-bc0f3f29b90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:21.152054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce1a7c-e204-4491-801f-bc0f3f29b90c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:21.152687 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce1a7c-e204-4491-801f-bc0f3f29b90c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:21.153343 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce1a7c-e204-4491-801f-bc0f3f29b90c None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:21.154198 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce1a7c-e204-4491-801f-bc0f3f29b90c None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:21.155323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce1a7c-e204-4491-801f-bc0f3f29b90c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:21.156866 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce1a7c-e204-4491-801f-bc0f3f29b90c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:21.177568 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 82/165] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:21.179335 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c41103-0410-4213-a2ff-4253323d6a8d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:21.179781 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c41103-0410-4213-a2ff-4253323d6a8d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:21.180202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c41103-0410-4213-a2ff-4253323d6a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:21.185763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:21.214678 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-87c41103-0410-4213-a2ff-4253323d6a8d None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:21.216176 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-87c41103-0410-4213-a2ff-4253323d6a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:21.226475 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ae8a9-e986-49d2-8ec7-ec6b86b53ff2 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:21.294998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fdc27-4f90-47d7-8928-5fd9877855f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:21.296029 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fdc27-4f90-47d7-8928-5fd9877855f7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:21.296566 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fdc27-4f90-47d7-8928-5fd9877855f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:21.297155 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fdc27-4f90-47d7-8928-5fd9877855f7 None admin] PATH_INFO: `/v3/users/de54cc4aa2214403a8d5cfbff5af1478` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:21.300018 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fdc27-4f90-47d7-8928-5fd9877855f7 None admin] RBAC: Authorizing `identity:get_user(user_id=de54cc4aa2214403a8d5cfbff5af1478)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:21.302415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fdc27-4f90-47d7-8928-5fd9877855f7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:21.304496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 84/166] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:20 2022] GET /identity/v3/users/de54cc4aa2214403a8d5cfbff5af1478 => generated 247 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:21.305513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fdc27-4f90-47d7-8928-5fd9877855f7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:21.324826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 83/167] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:21.325713 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c41103-0410-4213-a2ff-4253323d6a8d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:21.382839 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:21.448493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fdc27-4f90-47d7-8928-5fd9877855f7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:21.493778 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c41103-0410-4213-a2ff-4253323d6a8d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:21.496154 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f0411-4902-4934-a664-1dd63cc238ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:21.496924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f0411-4902-4934-a664-1dd63cc238ad None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:21.497211 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f0411-4902-4934-a664-1dd63cc238ad None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:21.497510 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f0411-4902-4934-a664-1dd63cc238ad None admin] PATH_INFO: `/v3/users/52af65c8f39f4ae68548deb395a6c6a1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:21.498700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f0411-4902-4934-a664-1dd63cc238ad None admin] RBAC: Authorizing `identity:get_user(user_id=52af65c8f39f4ae68548deb395a6c6a1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:21.502136 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f0411-4902-4934-a664-1dd63cc238ad None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:21.502136 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 85/168] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:21 2022] GET /identity/v3/users/52af65c8f39f4ae68548deb395a6c6a1 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:21.502741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f0411-4902-4934-a664-1dd63cc238ad None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:21.542028 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:21.544723 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87d75d-0b8b-4daf-a19b-12a32103ef1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:21.546015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87d75d-0b8b-4daf-a19b-12a32103ef1f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:21.546509 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87d75d-0b8b-4daf-a19b-12a32103ef1f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:21.546979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87d75d-0b8b-4daf-a19b-12a32103ef1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:21.637416 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87d75d-0b8b-4daf-a19b-12a32103ef1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:21.639063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87d75d-0b8b-4daf-a19b-12a32103ef1f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:21.765408 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f0411-4902-4934-a664-1dd63cc238ad None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:21.788465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:21.802465 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 84/169] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:21.807982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87d75d-0b8b-4daf-a19b-12a32103ef1f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:21.854172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06509d73-e390-4e26-bce1-7de3336e5c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:21.855172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06509d73-e390-4e26-bce1-7de3336e5c39 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:21.855689 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06509d73-e390-4e26-bce1-7de3336e5c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:21.856170 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06509d73-e390-4e26-bce1-7de3336e5c39 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:21.873814 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:21.886365 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06509d73-e390-4e26-bce1-7de3336e5c39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:21.893717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-06509d73-e390-4e26-bce1-7de3336e5c39 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:21.893717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:21.893717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:21.893717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:21.893717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:21.893717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:21.893717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:21.893717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:21.893717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:21.893717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:21.893717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:21.893717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:21.893717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:21.893717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:21.893717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:21.893717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:21.894583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:21.894583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:21.894583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:21.894583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:21.894583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:21.894583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:21.894583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:21.894583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:21.894583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:21.894583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:21.894583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:21.894583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:21.894583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:21.894583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:21.894583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:21.894583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:21.896257 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:21.896257 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:21.896257 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:21.896257 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:21.896257 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:21.896257 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:21.896257 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:21.896257 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:21.896257 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:21.896257 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:21.896257 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:21.896257 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:21.896257 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 86/170] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 18:59:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:21.898307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06509d73-e390-4e26-bce1-7de3336e5c39 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:22.059350 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87d75d-0b8b-4daf-a19b-12a32103ef1f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:22.125204 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06509d73-e390-4e26-bce1-7de3336e5c39 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:22.134179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9480f1-d3b9-4572-a59f-8a27ac540b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:22.134808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9480f1-d3b9-4572-a59f-8a27ac540b3b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:22.135084 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9480f1-d3b9-4572-a59f-8a27ac540b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:22.135357 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9480f1-d3b9-4572-a59f-8a27ac540b3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:22.234340 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57f9a3-dde3-4069-ae95-71134194b0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:22.234921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57f9a3-dde3-4069-ae95-71134194b0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:22.235209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57f9a3-dde3-4069-ae95-71134194b0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:22.235489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57f9a3-dde3-4069-ae95-71134194b0a7 None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:22.236720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57f9a3-dde3-4069-ae95-71134194b0a7 None admin] RBAC: Authorizing `identity:get_project(project_id=e906580203f24a3787efe33c12436d59)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:22.238269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57f9a3-dde3-4069-ae95-71134194b0a7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:22.240299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 87/171] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:21 2022] GET /identity/v3/projects/e906580203f24a3787efe33c12436d59 => generated 298 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:22.241162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57f9a3-dde3-4069-ae95-71134194b0a7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:22.286617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9480f1-d3b9-4572-a59f-8a27ac540b3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:22.288106 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9480f1-d3b9-4572-a59f-8a27ac540b3b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:22.334076 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:22.343415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:22.413404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 85/172] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:22.414300 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9480f1-d3b9-4572-a59f-8a27ac540b3b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:22.503205 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57f9a3-dde3-4069-ae95-71134194b0a7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:22.520537 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9480f1-d3b9-4572-a59f-8a27ac540b3b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:22.553807 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:22.557398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5243c0-1cd4-410f-bd01-2577ac5613a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:22.558034 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5243c0-1cd4-410f-bd01-2577ac5613a7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:22.558312 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5243c0-1cd4-410f-bd01-2577ac5613a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:22.558584 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5243c0-1cd4-410f-bd01-2577ac5613a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:22.559314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5243c0-1cd4-410f-bd01-2577ac5613a7 None admin] RBAC: Adding query filter params (role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.project.id=e906580203f24a3787efe33c12436d59, user.id=de54cc4aa2214403a8d5cfbff5af1478) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:22.559622 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5243c0-1cd4-410f-bd01-2577ac5613a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:22.561071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5243c0-1cd4-410f-bd01-2577ac5613a7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:22.566184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991729f-7066-4cfd-aa04-7e0ebce2ecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:22.568669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991729f-7066-4cfd-aa04-7e0ebce2ecd2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:22.568669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991729f-7066-4cfd-aa04-7e0ebce2ecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:22.568846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 86/173] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 18:59:22 2022] GET /identity/v3/role_assignments?user.id=de54cc4aa2214403a8d5cfbff5af1478&scope.project.id=e906580203f24a3787efe33c12436d59&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:22.568919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991729f-7066-4cfd-aa04-7e0ebce2ecd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:22.568919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991729f-7066-4cfd-aa04-7e0ebce2ecd2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:22.569043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5243c0-1cd4-410f-bd01-2577ac5613a7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:22.569114 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991729f-7066-4cfd-aa04-7e0ebce2ecd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:22.569900 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991729f-7066-4cfd-aa04-7e0ebce2ecd2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:22.584037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 88/174] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 18:59:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:22.589764 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991729f-7066-4cfd-aa04-7e0ebce2ecd2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:22.680082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5243c0-1cd4-410f-bd01-2577ac5613a7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:22.727025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:22.731269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991729f-7066-4cfd-aa04-7e0ebce2ecd2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:22.742371 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc96d8-8b8b-434f-9322-432cde5d107e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:22.742966 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc96d8-8b8b-434f-9322-432cde5d107e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:22.743873 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc96d8-8b8b-434f-9322-432cde5d107e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:22.743873 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc96d8-8b8b-434f-9322-432cde5d107e None admin] PATH_INFO: `/v3/projects/639e0c6b4edc4b0194bdc5db0ab143fc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:22.744917 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc96d8-8b8b-434f-9322-432cde5d107e None admin] RBAC: Authorizing `identity:get_project(project_id=639e0c6b4edc4b0194bdc5db0ab143fc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:22.746441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc96d8-8b8b-434f-9322-432cde5d107e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:22.748186 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 87/175] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:22 2022] GET /identity/v3/projects/639e0c6b4edc4b0194bdc5db0ab143fc => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:22.759221 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc96d8-8b8b-434f-9322-432cde5d107e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:22.783584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6937a-6522-4f43-a041-45097e828ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:22.784235 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6937a-6522-4f43-a041-45097e828ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:22.784520 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6937a-6522-4f43-a041-45097e828ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:22.784796 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6937a-6522-4f43-a041-45097e828ae2 None admin] PATH_INFO: `/v3/users/52af65c8f39f4ae68548deb395a6c6a1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:22.790247 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6937a-6522-4f43-a041-45097e828ae2 None admin] RBAC: Authorizing `identity:get_user(user_id=52af65c8f39f4ae68548deb395a6c6a1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:22.791738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6937a-6522-4f43-a041-45097e828ae2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:22.793402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 89/176] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:22 2022] GET /identity/v3/users/52af65c8f39f4ae68548deb395a6c6a1 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:22.799023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6937a-6522-4f43-a041-45097e828ae2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:22.833480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:22.877274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc96d8-8b8b-434f-9322-432cde5d107e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:22.915636 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26598fbd-15f1-4e0c-ba21-848ed397b91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:22.916254 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26598fbd-15f1-4e0c-ba21-848ed397b91f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:22.916535 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26598fbd-15f1-4e0c-ba21-848ed397b91f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:22.917758 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26598fbd-15f1-4e0c-ba21-848ed397b91f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:22.917758 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26598fbd-15f1-4e0c-ba21-848ed397b91f None admin] RBAC: Adding query filter params (role.id=ead9959857d24ec6bea3b7556da18ce5, scope.project.id=639e0c6b4edc4b0194bdc5db0ab143fc, user.id=52af65c8f39f4ae68548deb395a6c6a1) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:22.918028 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26598fbd-15f1-4e0c-ba21-848ed397b91f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:22.919459 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26598fbd-15f1-4e0c-ba21-848ed397b91f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:22.928602 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 88/177] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 18:59:22 2022] GET /identity/v3/role_assignments?user.id=52af65c8f39f4ae68548deb395a6c6a1&scope.project.id=639e0c6b4edc4b0194bdc5db0ab143fc&role.id=ead9959857d24ec6bea3b7556da18ce5 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:22.965489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6937a-6522-4f43-a041-45097e828ae2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:23.010991 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252774f-b84e-4f3b-a1e8-6a19cb3b0554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:23.011541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252774f-b84e-4f3b-a1e8-6a19cb3b0554 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:23.011827 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252774f-b84e-4f3b-a1e8-6a19cb3b0554 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:23.012105 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252774f-b84e-4f3b-a1e8-6a19cb3b0554 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:23.055553 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:23.094603 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252774f-b84e-4f3b-a1e8-6a19cb3b0554 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:23.096103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252774f-b84e-4f3b-a1e8-6a19cb3b0554 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:23.217121 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 90/178] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 18:59:23.223342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26598fbd-15f1-4e0c-ba21-848ed397b91f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:23.352992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26598fbd-15f1-4e0c-ba21-848ed397b91f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:23.384745 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:23.394063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d237cbf-8ffa-4f07-b6b0-e679edb59012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:23.395300 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d237cbf-8ffa-4f07-b6b0-e679edb59012 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:23.395591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d237cbf-8ffa-4f07-b6b0-e679edb59012 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:23.395867 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d237cbf-8ffa-4f07-b6b0-e679edb59012 None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:23.397251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d237cbf-8ffa-4f07-b6b0-e679edb59012 None admin] RBAC: Authorizing `identity:get_project(project_id=e906580203f24a3787efe33c12436d59)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:23.398748 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d237cbf-8ffa-4f07-b6b0-e679edb59012 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:23.404359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 89/179] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:23 2022] GET /identity/v3/projects/e906580203f24a3787efe33c12436d59 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:23.406644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252774f-b84e-4f3b-a1e8-6a19cb3b0554 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:23.436954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05077f4-ccf7-4ae8-bbc2-bdf0955c45ab None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:23.437251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05077f4-ccf7-4ae8-bbc2-bdf0955c45ab None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:23.437533 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05077f4-ccf7-4ae8-bbc2-bdf0955c45ab None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:23.438896 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 90/180] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 18:59:23.443956 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39983a7d-b0e2-4fcf-b904-c7f86e52dc56 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:23.444238 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39983a7d-b0e2-4fcf-b904-c7f86e52dc56 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:23.444511 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39983a7d-b0e2-4fcf-b904-c7f86e52dc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:23.477509 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-39983a7d-b0e2-4fcf-b904-c7f86e52dc56 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:23.478715 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-39983a7d-b0e2-4fcf-b904-c7f86e52dc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:23.529409 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:23.592171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252774f-b84e-4f3b-a1e8-6a19cb3b0554 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:23.602168 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 91/181] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:23.604228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce18ca7-e156-4679-82b7-02d0a591f731 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:23.604464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce18ca7-e156-4679-82b7-02d0a591f731 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:23.604742 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce18ca7-e156-4679-82b7-02d0a591f731 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:23.606272 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 92/182] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:23.618518 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03264c-aba6-4489-8f17-70af7bdf620e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:23.618799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03264c-aba6-4489-8f17-70af7bdf620e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:23.619074 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03264c-aba6-4489-8f17-70af7bdf620e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:23.643521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6e03264c-aba6-4489-8f17-70af7bdf620e None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:23.645302 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6e03264c-aba6-4489-8f17-70af7bdf620e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:23.647544 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b72523-d064-4593-86f1-8048407f233c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:23.648226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b72523-d064-4593-86f1-8048407f233c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:23.648597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b72523-d064-4593-86f1-8048407f233c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:23.648877 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b72523-d064-4593-86f1-8048407f233c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:23.649636 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b72523-d064-4593-86f1-8048407f233c None admin] RBAC: Adding query filter params (role.id=e4ff1977289a44cea73b844f8ad102a1, scope.project.id=e906580203f24a3787efe33c12436d59, user.id=52af65c8f39f4ae68548deb395a6c6a1) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:23.649947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b72523-d064-4593-86f1-8048407f233c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:23.651412 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b72523-d064-4593-86f1-8048407f233c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:23.657436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 91/183] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 18:59:23 2022] GET /identity/v3/role_assignments?user.id=52af65c8f39f4ae68548deb395a6c6a1&scope.project.id=e906580203f24a3787efe33c12436d59&role.id=e4ff1977289a44cea73b844f8ad102a1 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:23.658346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b72523-d064-4593-86f1-8048407f233c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:23.760011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 93/184] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:23.762023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8209e8-e8d4-423f-9a6b-b5c73d9bc0bc None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:23.762541 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8209e8-e8d4-423f-9a6b-b5c73d9bc0bc None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:23.763229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8209e8-e8d4-423f-9a6b-b5c73d9bc0bc None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:23.769146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 94/185] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:23.771302 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24128e57-c5a4-4e55-8487-702ecfc9df0d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:23.772068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24128e57-c5a4-4e55-8487-702ecfc9df0d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:23.772536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24128e57-c5a4-4e55-8487-702ecfc9df0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:23.792272 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-24128e57-c5a4-4e55-8487-702ecfc9df0d None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:23.793896 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-24128e57-c5a4-4e55-8487-702ecfc9df0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:23.827982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b72523-d064-4593-86f1-8048407f233c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:23.863174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:23.864756 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:23.873139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e925b-8bc1-452a-b278-3a376ab41038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:23.873978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e925b-8bc1-452a-b278-3a376ab41038 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:23.874096 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e925b-8bc1-452a-b278-3a376ab41038 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:23.874562 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e925b-8bc1-452a-b278-3a376ab41038 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:23.888435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e925b-8bc1-452a-b278-3a376ab41038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:23.890666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 95/186] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:23.891790 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24128e57-c5a4-4e55-8487-702ecfc9df0d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:23.893436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-512e925b-8bc1-452a-b278-3a376ab41038 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:23.893436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:23.893436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:23.893436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:23.893436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:23.893436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:23.893436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:23.893436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:23.893436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:23.893436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:23.893436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:23.893436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:23.893436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:23.893436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:23.893436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:23.893436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:23.895178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:23.895178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:23.895178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:23.895178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:23.895178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:23.895178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:23.895178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:23.895178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:23.895178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:23.895178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:23.895178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:23.895178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:23.895178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:23.895178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:23.895178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:23.895178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:23.896010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:23.896010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:23.896010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:23.896010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:23.896010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:23.896010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:23.896010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:23.896010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:23.896010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:23.896010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:23.896010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:23.896010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:23.896010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 92/187] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 18:59:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:23.903740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e925b-8bc1-452a-b278-3a376ab41038 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:24.002539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24128e57-c5a4-4e55-8487-702ecfc9df0d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:24.015333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e925b-8bc1-452a-b278-3a376ab41038 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:24.037066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd9f1d-b5bc-4063-a5db-9da5d79aaf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:24.037784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd9f1d-b5bc-4063-a5db-9da5d79aaf73 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:24.038067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd9f1d-b5bc-4063-a5db-9da5d79aaf73 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:24.038335 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd9f1d-b5bc-4063-a5db-9da5d79aaf73 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:24.048075 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd9f1d-b5bc-4063-a5db-9da5d79aaf73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:24.048297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683358d-3673-4472-a4b4-aa7058932aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:24.048902 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683358d-3673-4472-a4b4-aa7058932aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:24.049183 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683358d-3673-4472-a4b4-aa7058932aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:24.049474 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683358d-3673-4472-a4b4-aa7058932aa7 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:24.050136 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683358d-3673-4472-a4b4-aa7058932aa7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:24.050441 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683358d-3673-4472-a4b4-aa7058932aa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:24.051816 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683358d-3673-4472-a4b4-aa7058932aa7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:24.052993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-40cd9f1d-b5bc-4063-a5db-9da5d79aaf73 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 18:59:24.052993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:24.052993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:24.052993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:24.052993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:24.052993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:24.052993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:24.052993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:24.052993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:24.052993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:24.052993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:24.052993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:24.052993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:24.052993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:24.052993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:24.052993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:24.054108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:24.054108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:24.054108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:24.054108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:24.054108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:24.054108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:24.054108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:24.054108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:24.054108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:24.054108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:24.054108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:24.054108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:24.054108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:24.054108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:24.054108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:24.054108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:24.055189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:24.055189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:24.055189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:24.055189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:24.055189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:24.055189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:24.055189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:24.055189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:24.055189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:24.055189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:24.055189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 18:59:24.055189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:24.055189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 96/188] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:24.058248 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd9f1d-b5bc-4063-a5db-9da5d79aaf73 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:24.067841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 93/189] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:24.067841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56815309-7728-4d80-93c7-74fd36b8fb14 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:24.067841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56815309-7728-4d80-93c7-74fd36b8fb14 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:24.067841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56815309-7728-4d80-93c7-74fd36b8fb14 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:24.067841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 94/190] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:24.067841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56815309-7728-4d80-93c7-74fd36b8fb14 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:24.106509 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:24.121547 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:24.159024 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd9f1d-b5bc-4063-a5db-9da5d79aaf73 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:24.169488 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56815309-7728-4d80-93c7-74fd36b8fb14 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:24.192018 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64225480-938b-4b86-88ec-d38606214749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:24.192645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64225480-938b-4b86-88ec-d38606214749 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:24.192923 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64225480-938b-4b86-88ec-d38606214749 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:24.193195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64225480-938b-4b86-88ec-d38606214749 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:24.194347 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64225480-938b-4b86-88ec-d38606214749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:24.195784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64225480-938b-4b86-88ec-d38606214749 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:24.197340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 97/191] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 18:59:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:24.201525 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23372a-c30b-40fe-a8d6-61d2b93ffd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:24.202133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23372a-c30b-40fe-a8d6-61d2b93ffd6a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:24.202382 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64225480-938b-4b86-88ec-d38606214749 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:24.202474 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23372a-c30b-40fe-a8d6-61d2b93ffd6a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:24.202671 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23372a-c30b-40fe-a8d6-61d2b93ffd6a None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:24.203379 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23372a-c30b-40fe-a8d6-61d2b93ffd6a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:24.203685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23372a-c30b-40fe-a8d6-61d2b93ffd6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:24.205045 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23372a-c30b-40fe-a8d6-61d2b93ffd6a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:24.213966 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 95/192] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:24.218437 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8351f5-82f0-406a-82dc-dff769d65020 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:24.218981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8351f5-82f0-406a-82dc-dff769d65020 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:24.218981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8351f5-82f0-406a-82dc-dff769d65020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:24.235865 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4f8351f5-82f0-406a-82dc-dff769d65020 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:24.237050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4f8351f5-82f0-406a-82dc-dff769d65020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:24.301338 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64225480-938b-4b86-88ec-d38606214749 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:24.303167 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 96/193] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:24.303970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8351f5-82f0-406a-82dc-dff769d65020 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:24.329979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:24.349675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:24.351203 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db159e7e-56bc-44c0-8914-7b7f2098ab90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:24.351841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db159e7e-56bc-44c0-8914-7b7f2098ab90 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:24.352125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db159e7e-56bc-44c0-8914-7b7f2098ab90 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:24.352400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db159e7e-56bc-44c0-8914-7b7f2098ab90 None admin] PATH_INFO: `/v3/users/39600eea237c471db007812ac7039844` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:24.366583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db159e7e-56bc-44c0-8914-7b7f2098ab90 None admin] RBAC: Authorizing `identity:get_user(user_id=39600eea237c471db007812ac7039844)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:24.368042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db159e7e-56bc-44c0-8914-7b7f2098ab90 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:24.369750 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 98/194] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:24 2022] GET /identity/v3/users/39600eea237c471db007812ac7039844 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:24.374445 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db159e7e-56bc-44c0-8914-7b7f2098ab90 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:24.403509 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8351f5-82f0-406a-82dc-dff769d65020 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:24.438199 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43f016-89c9-46f1-ad78-cd84b949bc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:24.438806 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43f016-89c9-46f1-ad78-cd84b949bc5f None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:24.439082 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43f016-89c9-46f1-ad78-cd84b949bc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:24.439350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43f016-89c9-46f1-ad78-cd84b949bc5f None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:24.439995 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43f016-89c9-46f1-ad78-cd84b949bc5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:24.441440 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43f016-89c9-46f1-ad78-cd84b949bc5f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:24.469698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db159e7e-56bc-44c0-8914-7b7f2098ab90 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:24.502126 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5e199-28dd-41cb-8c59-7cecdf2c410c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:24.502779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5e199-28dd-41cb-8c59-7cecdf2c410c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:24.503055 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5e199-28dd-41cb-8c59-7cecdf2c410c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:24.503323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5e199-28dd-41cb-8c59-7cecdf2c410c None admin] PATH_INFO: `/v3/users/e54114cc544f4c9390757d63b2888138` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:24.505364 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5e199-28dd-41cb-8c59-7cecdf2c410c None admin] RBAC: Authorizing `identity:get_user(user_id=e54114cc544f4c9390757d63b2888138)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:24.506409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5e199-28dd-41cb-8c59-7cecdf2c410c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:24.512769 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 99/195] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:24 2022] GET /identity/v3/users/e54114cc544f4c9390757d63b2888138 => generated 289 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:24.512769 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5e199-28dd-41cb-8c59-7cecdf2c410c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:24.548298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:24.558415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 97/196] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Aug 9 18:59:24 2022] POST /identity/v3/users => generated 297 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 18:59:24.558415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43f016-89c9-46f1-ad78-cd84b949bc5f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:24.623745 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5e199-28dd-41cb-8c59-7cecdf2c410c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:24.662732 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f396e7-3645-4a1f-8f69-2c6443f7195d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:24.663384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f396e7-3645-4a1f-8f69-2c6443f7195d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:24.663515 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:24.663719 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f396e7-3645-4a1f-8f69-2c6443f7195d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:24.663991 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f396e7-3645-4a1f-8f69-2c6443f7195d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:24.667097 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43f016-89c9-46f1-ad78-cd84b949bc5f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:24.676123 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f396e7-3645-4a1f-8f69-2c6443f7195d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:24.681061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-95f396e7-3645-4a1f-8f69-2c6443f7195d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:24.681061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:24.681061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:24.681061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:24.681061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:24.681061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:24.681061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:24.681061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:24.681061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:24.681061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:24.681061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:24.681061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:24.681061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:24.681061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:24.681061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:24.681061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:24.682260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:24.682260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:24.682260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:24.682260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:24.682260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:24.682260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:24.682260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:24.682260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:24.682260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:24.682260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:24.682260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:24.682260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:24.682260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:24.682260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:24.682260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:24.682260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:24.683069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:24.683069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:24.683069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:24.683069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:24.683069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:24.683069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:24.683069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:24.683069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:24.683069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:24.683069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:24.683069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:24.683069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:24.683069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 100/197] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 18:59:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:24.683069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f396e7-3645-4a1f-8f69-2c6443f7195d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:24.715102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad27d1-8d4b-42ff-bcb6-1a8e4cceddad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:24.715760 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad27d1-8d4b-42ff-bcb6-1a8e4cceddad None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:24.716297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad27d1-8d4b-42ff-bcb6-1a8e4cceddad None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:24.716605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad27d1-8d4b-42ff-bcb6-1a8e4cceddad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:24.792930 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:24.798516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f396e7-3645-4a1f-8f69-2c6443f7195d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:24.805083 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad27d1-8d4b-42ff-bcb6-1a8e4cceddad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:24.806774 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad27d1-8d4b-42ff-bcb6-1a8e4cceddad None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:24.840949 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107763b0-d1df-45cf-950c-a00260e6127c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:24.840949 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107763b0-d1df-45cf-950c-a00260e6127c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:24.840949 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107763b0-d1df-45cf-950c-a00260e6127c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:24.841329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107763b0-d1df-45cf-950c-a00260e6127c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:24.927712 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:24.930100 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107763b0-d1df-45cf-950c-a00260e6127c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:24.932091 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107763b0-d1df-45cf-950c-a00260e6127c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:24.932951 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 98/198] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:24.937477 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad27d1-8d4b-42ff-bcb6-1a8e4cceddad None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:25.044167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:25.049185 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 101/199] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:25.054670 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107763b0-d1df-45cf-950c-a00260e6127c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:25.068458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad27d1-8d4b-42ff-bcb6-1a8e4cceddad None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:25.111807 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c4821-3946-444b-8dfe-614c39436ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:25.112426 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c4821-3946-444b-8dfe-614c39436ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:25.112707 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c4821-3946-444b-8dfe-614c39436ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:25.112980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c4821-3946-444b-8dfe-614c39436ab7 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:25.114269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c4821-3946-444b-8dfe-614c39436ab7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:25.114583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c4821-3946-444b-8dfe-614c39436ab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:25.116452 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c4821-3946-444b-8dfe-614c39436ab7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:25.127250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 99/200] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 18:59:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:25.128061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c4821-3946-444b-8dfe-614c39436ab7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:25.171278 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107763b0-d1df-45cf-950c-a00260e6127c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:25.205872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:25.221194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a89b88-2b6b-4b62-a87f-c94416dc00da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:25.222263 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a89b88-2b6b-4b62-a87f-c94416dc00da None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:25.222794 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a89b88-2b6b-4b62-a87f-c94416dc00da None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:25.223279 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a89b88-2b6b-4b62-a87f-c94416dc00da None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:25.225194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a89b88-2b6b-4b62-a87f-c94416dc00da None admin] RBAC: Authorizing `identity:get_project(project_id=54b4a073d17c4838b5377059540ead2e)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:25.227739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a89b88-2b6b-4b62-a87f-c94416dc00da None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:25.235069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 102/201] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:25 2022] GET /identity/v3/projects/54b4a073d17c4838b5377059540ead2e => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:25.235069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a89b88-2b6b-4b62-a87f-c94416dc00da None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:25.257984 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c4821-3946-444b-8dfe-614c39436ab7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:25.304980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1b23e-bb6b-4075-b309-8bb36379b78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:25.305795 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1b23e-bb6b-4075-b309-8bb36379b78b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:25.306215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1b23e-bb6b-4075-b309-8bb36379b78b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:25.306497 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1b23e-bb6b-4075-b309-8bb36379b78b None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:25.307913 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1b23e-bb6b-4075-b309-8bb36379b78b None admin] RBAC: Authorizing `identity:get_project(project_id=e906580203f24a3787efe33c12436d59)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:25.310121 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1b23e-bb6b-4075-b309-8bb36379b78b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:25.312447 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 100/202] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:25 2022] GET /identity/v3/projects/e906580203f24a3787efe33c12436d59 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:25.313666 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1b23e-bb6b-4075-b309-8bb36379b78b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:25.317122 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:25.359908 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a89b88-2b6b-4b62-a87f-c94416dc00da None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:25.404086 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe90574-0c17-4f89-86c5-8527a16e8a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:25.404730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe90574-0c17-4f89-86c5-8527a16e8a1f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:25.405009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe90574-0c17-4f89-86c5-8527a16e8a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:25.405280 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe90574-0c17-4f89-86c5-8527a16e8a1f None admin] PATH_INFO: `/v3/users/39600eea237c471db007812ac7039844` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:25.406452 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe90574-0c17-4f89-86c5-8527a16e8a1f None admin] RBAC: Authorizing `identity:get_user(user_id=39600eea237c471db007812ac7039844)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:25.408399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe90574-0c17-4f89-86c5-8527a16e8a1f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:25.411605 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 103/203] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:25 2022] GET /identity/v3/users/39600eea237c471db007812ac7039844 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:25.412704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe90574-0c17-4f89-86c5-8527a16e8a1f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:25.436298 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1b23e-bb6b-4075-b309-8bb36379b78b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:25.474163 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:25.480498 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4503d-4f99-4caa-8714-26bcecd00481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:25.481112 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4503d-4f99-4caa-8714-26bcecd00481 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:25.481403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4503d-4f99-4caa-8714-26bcecd00481 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:25.481882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4503d-4f99-4caa-8714-26bcecd00481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:25.482616 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4503d-4f99-4caa-8714-26bcecd00481 None admin] RBAC: Adding query filter params (role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.project.id=54b4a073d17c4838b5377059540ead2e, user.id=39600eea237c471db007812ac7039844) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:25.483249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4503d-4f99-4caa-8714-26bcecd00481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:25.485022 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4503d-4f99-4caa-8714-26bcecd00481 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:25.497669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 101/204] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 18:59:25 2022] GET /identity/v3/role_assignments?user.id=39600eea237c471db007812ac7039844&scope.project.id=54b4a073d17c4838b5377059540ead2e&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:25.497669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4503d-4f99-4caa-8714-26bcecd00481 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:25.579066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe90574-0c17-4f89-86c5-8527a16e8a1f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:25.624474 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92b3fd-048f-4941-9f5c-74eb8c8d1c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:25.625095 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92b3fd-048f-4941-9f5c-74eb8c8d1c06 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:25.625377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92b3fd-048f-4941-9f5c-74eb8c8d1c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:25.625685 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92b3fd-048f-4941-9f5c-74eb8c8d1c06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:25.626426 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92b3fd-048f-4941-9f5c-74eb8c8d1c06 None admin] RBAC: Adding query filter params (role.id=55b7e38eaf134f788a30329b137436ec, scope.project.id=e906580203f24a3787efe33c12436d59, user.id=e54114cc544f4c9390757d63b2888138) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:25.626742 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92b3fd-048f-4941-9f5c-74eb8c8d1c06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:25.628204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92b3fd-048f-4941-9f5c-74eb8c8d1c06 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:25.632453 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:25.652011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 104/205] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 18:59:25 2022] GET /identity/v3/role_assignments?user.id=e54114cc544f4c9390757d63b2888138&scope.project.id=e906580203f24a3787efe33c12436d59&role.id=55b7e38eaf134f788a30329b137436ec => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:25.689707 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4503d-4f99-4caa-8714-26bcecd00481 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:25.728134 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66366806-71d6-4f87-8d9f-454ff3685326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:25.728687 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66366806-71d6-4f87-8d9f-454ff3685326 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:25.728971 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66366806-71d6-4f87-8d9f-454ff3685326 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:25.729246 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66366806-71d6-4f87-8d9f-454ff3685326 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:25.806981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66366806-71d6-4f87-8d9f-454ff3685326 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:25.808495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66366806-71d6-4f87-8d9f-454ff3685326 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:25.810506 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:25.926099 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 102/206] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:25.932141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92b3fd-048f-4941-9f5c-74eb8c8d1c06 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:26.040332 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92b3fd-048f-4941-9f5c-74eb8c8d1c06 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:26.075866 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9ae56-964c-4433-8d4b-a2bf1bc90c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:26.076500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9ae56-964c-4433-8d4b-a2bf1bc90c99 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:26.076784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9ae56-964c-4433-8d4b-a2bf1bc90c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:26.077062 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9ae56-964c-4433-8d4b-a2bf1bc90c99 None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:26.078231 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9ae56-964c-4433-8d4b-a2bf1bc90c99 None admin] RBAC: Authorizing `identity:get_project(project_id=54b4a073d17c4838b5377059540ead2e)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:26.079678 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9ae56-964c-4433-8d4b-a2bf1bc90c99 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:26.081634 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 105/207] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:25 2022] GET /identity/v3/projects/54b4a073d17c4838b5377059540ead2e => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:26.087927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66366806-71d6-4f87-8d9f-454ff3685326 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:26.187562 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:26.195074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66366806-71d6-4f87-8d9f-454ff3685326 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:26.231822 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0936b-797a-4dfb-9752-644462433430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:26.232437 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0936b-797a-4dfb-9752-644462433430 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:26.232721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0936b-797a-4dfb-9752-644462433430 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:26.232996 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0936b-797a-4dfb-9752-644462433430 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:26.233776 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0936b-797a-4dfb-9752-644462433430 None admin] RBAC: Adding query filter params (role.id=e4ff1977289a44cea73b844f8ad102a1, scope.project.id=54b4a073d17c4838b5377059540ead2e, user.id=39600eea237c471db007812ac7039844) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:26.234088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0936b-797a-4dfb-9752-644462433430 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:26.235550 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa0936b-797a-4dfb-9752-644462433430 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:26.242063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 103/208] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 18:59:26 2022] GET /identity/v3/role_assignments?user.id=39600eea237c471db007812ac7039844&scope.project.id=54b4a073d17c4838b5377059540ead2e&role.id=e4ff1977289a44cea73b844f8ad102a1 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:26.821720 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affed3e6-e8c3-41c3-b93f-18a2f6a8a9f0 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:26.822224 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affed3e6-e8c3-41c3-b93f-18a2f6a8a9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:26.822224 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affed3e6-e8c3-41c3-b93f-18a2f6a8a9f0 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:26.823628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 106/209] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:26.828822 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cf3bd-843e-4108-bf03-7a27f7813253 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:26.829220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cf3bd-843e-4108-bf03-7a27f7813253 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:26.829419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cf3bd-843e-4108-bf03-7a27f7813253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:26.844734 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5519a-f19d-4baa-8023-575ab1b0993a None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:26.845073 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5519a-f19d-4baa-8023-575ab1b0993a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:26.845273 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5519a-f19d-4baa-8023-575ab1b0993a None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:26.846975 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 107/210] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:26.853389 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a03cf3bd-843e-4108-bf03-7a27f7813253 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:26.853874 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd844187-958c-41a4-871b-c5547caa47e5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:26.854162 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd844187-958c-41a4-871b-c5547caa47e5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:26.854453 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd844187-958c-41a4-871b-c5547caa47e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:26.855788 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a03cf3bd-843e-4108-bf03-7a27f7813253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:26.876459 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-bd844187-958c-41a4-871b-c5547caa47e5 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:26.878122 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bd844187-958c-41a4-871b-c5547caa47e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:26.928841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 104/211] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:26.950924 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:26.951922 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cf3bd-843e-4108-bf03-7a27f7813253 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:26.959445 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 108/212] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:26.983601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd844187-958c-41a4-871b-c5547caa47e5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:27.047146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:27.059579 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cf3bd-843e-4108-bf03-7a27f7813253 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:27.095399 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f2a01-25f7-4ca6-8f76-58b193f00801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:27.096125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f2a01-25f7-4ca6-8f76-58b193f00801 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:27.096465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f2a01-25f7-4ca6-8f76-58b193f00801 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:27.096822 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f2a01-25f7-4ca6-8f76-58b193f00801 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:27.107078 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd844187-958c-41a4-871b-c5547caa47e5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:27.108739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f2a01-25f7-4ca6-8f76-58b193f00801 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:27.113981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-544f2a01-25f7-4ca6-8f76-58b193f00801 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:27.113981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:27.113981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:27.113981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:27.113981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:27.113981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:27.113981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:27.113981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:27.113981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:27.113981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:27.113981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:27.113981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:27.113981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:27.113981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:27.113981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:27.113981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:27.115088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:27.115088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:27.115088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:27.115088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:27.115088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:27.115088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:27.115088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:27.115088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:27.115088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:27.115088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:27.115088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:27.115088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:27.115088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:27.115088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:27.115088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:27.115088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:27.116111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:27.116111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:27.116111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:27.116111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:27.116111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:27.116111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:27.116111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:27.116111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:27.116111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:27.116111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:27.116111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:27.116111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:27.116111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 105/213] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:27.122045 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f2a01-25f7-4ca6-8f76-58b193f00801 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:27.149102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b4fc8-4c43-42b1-aa05-5cafd614d619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:27.150062 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b4fc8-4c43-42b1-aa05-5cafd614d619 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:27.150521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b4fc8-4c43-42b1-aa05-5cafd614d619 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:27.151039 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b4fc8-4c43-42b1-aa05-5cafd614d619 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:27.152288 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b4fc8-4c43-42b1-aa05-5cafd614d619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:27.154104 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b4fc8-4c43-42b1-aa05-5cafd614d619 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:27.155812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 109/214] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 18:59:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:27.161478 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b4fc8-4c43-42b1-aa05-5cafd614d619 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:27.227629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:27.233158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f2a01-25f7-4ca6-8f76-58b193f00801 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:27.268257 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b4fc8-4c43-42b1-aa05-5cafd614d619 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:27.269905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b21e0-fdbe-490a-bb47-b3170bd87bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:27.270588 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b21e0-fdbe-490a-bb47-b3170bd87bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:27.270923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b21e0-fdbe-490a-bb47-b3170bd87bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:27.271264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b21e0-fdbe-490a-bb47-b3170bd87bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:27.272632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b21e0-fdbe-490a-bb47-b3170bd87bc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:27.273334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b21e0-fdbe-490a-bb47-b3170bd87bc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:27.274756 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b21e0-fdbe-490a-bb47-b3170bd87bc8 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:27.285522 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 106/215] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:27.289325 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b21e0-fdbe-490a-bb47-b3170bd87bc8 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:27.315168 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:27.344060 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ced92b-a927-4153-9437-2b8a562d079d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:27.344787 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ced92b-a927-4153-9437-2b8a562d079d None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:27.345131 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ced92b-a927-4153-9437-2b8a562d079d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:27.345546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ced92b-a927-4153-9437-2b8a562d079d None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:27.346316 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ced92b-a927-4153-9437-2b8a562d079d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:27.348667 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ced92b-a927-4153-9437-2b8a562d079d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:27.414530 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b21e0-fdbe-490a-bb47-b3170bd87bc8 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:27.436155 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 110/216] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Aug 9 18:59:27 2022] POST /identity/v3/users => generated 297 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 18:59:27.467259 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1636ab-e28d-4ba9-8cf2-826de21f873e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:27.467917 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1636ab-e28d-4ba9-8cf2-826de21f873e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:27.468198 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1636ab-e28d-4ba9-8cf2-826de21f873e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:27.468521 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1636ab-e28d-4ba9-8cf2-826de21f873e None admin] PATH_INFO: `/v3/users/fa268966c9a04aa09432699193450288` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:27.485748 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1636ab-e28d-4ba9-8cf2-826de21f873e None admin] RBAC: Authorizing `identity:get_user(user_id=fa268966c9a04aa09432699193450288)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:27.487333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1636ab-e28d-4ba9-8cf2-826de21f873e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:27.491233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 107/217] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:27 2022] GET /identity/v3/users/fa268966c9a04aa09432699193450288 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:27.495414 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ced92b-a927-4153-9437-2b8a562d079d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:27.624397 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ced92b-a927-4153-9437-2b8a562d079d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:27.646240 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:27.662378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce7aec-ba0c-46cd-bab4-2526bbf2e322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:27.663342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce7aec-ba0c-46cd-bab4-2526bbf2e322 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:27.663788 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce7aec-ba0c-46cd-bab4-2526bbf2e322 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:27.664399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce7aec-ba0c-46cd-bab4-2526bbf2e322 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:27.737164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce7aec-ba0c-46cd-bab4-2526bbf2e322 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:27.739599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce7aec-ba0c-46cd-bab4-2526bbf2e322 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:27.777100 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36862537-0c32-4050-b62a-d45cb529ed7f None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:27.777813 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36862537-0c32-4050-b62a-d45cb529ed7f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:27.778287 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36862537-0c32-4050-b62a-d45cb529ed7f None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:27.779806 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 108/218] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:27.787335 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282b6e3-19ef-4c81-8a8c-6055a6c8cddf None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:27.787335 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282b6e3-19ef-4c81-8a8c-6055a6c8cddf None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:27.787335 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282b6e3-19ef-4c81-8a8c-6055a6c8cddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:27.807275 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-b282b6e3-19ef-4c81-8a8c-6055a6c8cddf None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:27.808701 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b282b6e3-19ef-4c81-8a8c-6055a6c8cddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:27.854034 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 111/219] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:27.860180 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce7aec-ba0c-46cd-bab4-2526bbf2e322 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:27.884038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:27.931922 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 109/220] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:27.933034 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:27.972121 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce7aec-ba0c-46cd-bab4-2526bbf2e322 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:27.977163 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282b6e3-19ef-4c81-8a8c-6055a6c8cddf None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:28.009622 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed0b29-6e3f-48c2-8a83-263e8b31eb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:28.010266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed0b29-6e3f-48c2-8a83-263e8b31eb19 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:28.010546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed0b29-6e3f-48c2-8a83-263e8b31eb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:28.010817 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed0b29-6e3f-48c2-8a83-263e8b31eb19 None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:28.011959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed0b29-6e3f-48c2-8a83-263e8b31eb19 None admin] RBAC: Authorizing `identity:get_project(project_id=54b4a073d17c4838b5377059540ead2e)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:28.013425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed0b29-6e3f-48c2-8a83-263e8b31eb19 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:28.018641 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 112/221] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:27 2022] GET /identity/v3/projects/54b4a073d17c4838b5377059540ead2e => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:28.022112 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed0b29-6e3f-48c2-8a83-263e8b31eb19 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:28.122972 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed0b29-6e3f-48c2-8a83-263e8b31eb19 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:28.125529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282b6e3-19ef-4c81-8a8c-6055a6c8cddf None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:28.141922 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:28.160527 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593f91c-b2ca-4a80-b0d7-5ae000410656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:28.161210 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593f91c-b2ca-4a80-b0d7-5ae000410656 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:28.161520 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593f91c-b2ca-4a80-b0d7-5ae000410656 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:28.161805 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593f91c-b2ca-4a80-b0d7-5ae000410656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:28.162548 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593f91c-b2ca-4a80-b0d7-5ae000410656 None admin] RBAC: Adding query filter params (role.id=ead9959857d24ec6bea3b7556da18ce5, scope.project.id=54b4a073d17c4838b5377059540ead2e, user.id=fa268966c9a04aa09432699193450288) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:28.162856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593f91c-b2ca-4a80-b0d7-5ae000410656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:28.164289 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593f91c-b2ca-4a80-b0d7-5ae000410656 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:28.170231 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 113/222] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 18:59:28 2022] GET /identity/v3/role_assignments?user.id=fa268966c9a04aa09432699193450288&scope.project.id=54b4a073d17c4838b5377059540ead2e&role.id=ead9959857d24ec6bea3b7556da18ce5 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:28.222395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecd6d7-9b9d-4cff-92f7-afd2e108faad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:28.223087 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecd6d7-9b9d-4cff-92f7-afd2e108faad None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:28.223372 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecd6d7-9b9d-4cff-92f7-afd2e108faad None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:28.223648 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecd6d7-9b9d-4cff-92f7-afd2e108faad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:28.239475 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecd6d7-9b9d-4cff-92f7-afd2e108faad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:28.244385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-9fecd6d7-9b9d-4cff-92f7-afd2e108faad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:28.244385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:28.244385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:28.244385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:28.244385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:28.244385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:28.244385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:28.244385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:28.244385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:28.244385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:28.244385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:28.244385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:28.244385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:28.244385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:28.244385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:28.244385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:28.245289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:28.245289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:28.245289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:28.245289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:28.245289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:28.245289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:28.245289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:28.245289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:28.245289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:28.245289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:28.245289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:28.245289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:28.245289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:28.245289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:28.245289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:28.245289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:28.246175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:28.246175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:28.246175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:28.246175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:28.246175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:28.246175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:28.246175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:28.246175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:28.246175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:28.246175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:28.246175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:28.246175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:28.254824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 110/223] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 18:59:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:28.260729 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593f91c-b2ca-4a80-b0d7-5ae000410656 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:28.384395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e837c7-749a-45bd-87af-0f1aeb06995d None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:28.384724 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e837c7-749a-45bd-87af-0f1aeb06995d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:28.384955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e837c7-749a-45bd-87af-0f1aeb06995d None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:28.386516 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 111/224] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 18:59:28.396750 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593f91c-b2ca-4a80-b0d7-5ae000410656 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:28.402928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc3147-cd28-414b-9f62-f7a6e3060763 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:28.403206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc3147-cd28-414b-9f62-f7a6e3060763 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:28.403482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc3147-cd28-414b-9f62-f7a6e3060763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:28.432890 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a6e8c-ca87-4683-95f1-2532b9a4bb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:28.433528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a6e8c-ca87-4683-95f1-2532b9a4bb55 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:28.433815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a6e8c-ca87-4683-95f1-2532b9a4bb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:28.433998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-fcbc3147-cd28-414b-9f62-f7a6e3060763 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:28.434096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a6e8c-ca87-4683-95f1-2532b9a4bb55 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:28.434755 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a6e8c-ca87-4683-95f1-2532b9a4bb55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:28.435057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a6e8c-ca87-4683-95f1-2532b9a4bb55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:28.435217 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fcbc3147-cd28-414b-9f62-f7a6e3060763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:28.436491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a6e8c-ca87-4683-95f1-2532b9a4bb55 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:28.447181 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 114/225] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:28.452630 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a6e8c-ca87-4683-95f1-2532b9a4bb55 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:28.473537 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:28.537925 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:28.546397 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 112/226] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:28.573054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc3147-cd28-414b-9f62-f7a6e3060763 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:28.635985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a6e8c-ca87-4683-95f1-2532b9a4bb55 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:28.685428 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadedc00-22fd-4f75-ac49-cd0b36c903e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:28.686015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadedc00-22fd-4f75-ac49-cd0b36c903e8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:28.686296 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadedc00-22fd-4f75-ac49-cd0b36c903e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:28.686565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadedc00-22fd-4f75-ac49-cd0b36c903e8 None admin] PATH_INFO: `/v3/users/39600eea237c471db007812ac7039844` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:28.687998 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadedc00-22fd-4f75-ac49-cd0b36c903e8 None admin] RBAC: Authorizing `identity:get_user(user_id=39600eea237c471db007812ac7039844)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:28.689471 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadedc00-22fd-4f75-ac49-cd0b36c903e8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:28.691965 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 115/227] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:28 2022] GET /identity/v3/users/39600eea237c471db007812ac7039844 => generated 283 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:28.699195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadedc00-22fd-4f75-ac49-cd0b36c903e8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:28.775123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc3147-cd28-414b-9f62-f7a6e3060763 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:28.828932 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8be924-f25c-4df4-a51d-23b996f930b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:28.829769 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8be924-f25c-4df4-a51d-23b996f930b7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:28.830149 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8be924-f25c-4df4-a51d-23b996f930b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:28.830514 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8be924-f25c-4df4-a51d-23b996f930b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:28.842127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:28.855168 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8be924-f25c-4df4-a51d-23b996f930b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:28.859781 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadedc00-22fd-4f75-ac49-cd0b36c903e8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:28.860624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-fc8be924-f25c-4df4-a51d-23b996f930b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:28.860624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:28.860624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:28.860624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:28.860624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:28.860624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:28.860624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:28.860624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:28.860624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:28.860624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:28.860624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:28.860624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:28.860624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:28.860624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:28.860624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:28.860624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:28.861505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:28.861505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:28.861505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:28.861505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:28.861505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:28.861505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:28.861505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:28.861505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:28.861505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:28.861505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:28.861505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:28.861505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:28.861505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:28.861505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:28.861505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:28.861505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:28.862319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:28.862319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:28.862319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:28.862319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:28.862319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:28.862319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:28.862319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:28.862319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:28.862319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:28.862319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:28.862319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:28.862319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:28.870081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 113/228] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 18:59:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 18:59:28.876186 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8be924-f25c-4df4-a51d-23b996f930b7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:28.896528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e395e-c464-40d1-b5af-36e98a4cfeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:28.897218 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e395e-c464-40d1-b5af-36e98a4cfeb4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:28.897560 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e395e-c464-40d1-b5af-36e98a4cfeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:28.897842 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e395e-c464-40d1-b5af-36e98a4cfeb4 None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:28.898989 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e395e-c464-40d1-b5af-36e98a4cfeb4 None admin] RBAC: Authorizing `identity:get_project(project_id=54b4a073d17c4838b5377059540ead2e)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:28.900508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e395e-c464-40d1-b5af-36e98a4cfeb4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:28.902477 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 116/229] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:28 2022] GET /identity/v3/projects/54b4a073d17c4838b5377059540ead2e => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:28.908165 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e395e-c464-40d1-b5af-36e98a4cfeb4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:28.935929 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:29.019269 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e395e-c464-40d1-b5af-36e98a4cfeb4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:29.058105 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8be924-f25c-4df4-a51d-23b996f930b7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:29.059540 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6b734-3927-4554-b232-b9faca6c317e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:29.060283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6b734-3927-4554-b232-b9faca6c317e None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:29.060563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6b734-3927-4554-b232-b9faca6c317e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:29.060835 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6b734-3927-4554-b232-b9faca6c317e None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e/users/39600eea237c471db007812ac7039844/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:29.065490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6b734-3927-4554-b232-b9faca6c317e None admin] RBAC: Authorizing `identity:create_grant(project_id=54b4a073d17c4838b5377059540ead2e, user_id=39600eea237c471db007812ac7039844, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:29.065490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6b734-3927-4554-b232-b9faca6c317e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:29.103952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3fea7-4674-400a-bf57-f1ec0159027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:29.104914 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3fea7-4674-400a-bf57-f1ec0159027e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:29.105426 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3fea7-4674-400a-bf57-f1ec0159027e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:29.105977 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3fea7-4674-400a-bf57-f1ec0159027e None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:29.106875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3fea7-4674-400a-bf57-f1ec0159027e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:29.107447 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3fea7-4674-400a-bf57-f1ec0159027e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:29.109032 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3fea7-4674-400a-bf57-f1ec0159027e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:29.119247 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 114/230] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 18:59:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:29.126591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3fea7-4674-400a-bf57-f1ec0159027e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:29.163652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 117/231] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 18:59:28 2022] PUT /identity/v3/projects/54b4a073d17c4838b5377059540ead2e/users/39600eea237c471db007812ac7039844/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 18:59:29.249381 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3fea7-4674-400a-bf57-f1ec0159027e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:29.321248 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:29.351654 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee2f35-84a0-4adc-976b-02f96e1b9cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:29.352352 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee2f35-84a0-4adc-976b-02f96e1b9cdd None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:29.352630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee2f35-84a0-4adc-976b-02f96e1b9cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:29.352901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee2f35-84a0-4adc-976b-02f96e1b9cdd None admin] PATH_INFO: `/v3/users/39600eea237c471db007812ac7039844` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:29.354125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee2f35-84a0-4adc-976b-02f96e1b9cdd None admin] RBAC: Authorizing `identity:get_user(user_id=39600eea237c471db007812ac7039844)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:29.355991 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee2f35-84a0-4adc-976b-02f96e1b9cdd None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:29.359818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 115/232] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:29 2022] GET /identity/v3/users/39600eea237c471db007812ac7039844 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:29.364758 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6b734-3927-4554-b232-b9faca6c317e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:29.385650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:29.485284 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6b734-3927-4554-b232-b9faca6c317e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:29.525531 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f2305-f25d-4e5d-940d-40a058a26f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:29.526174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f2305-f25d-4e5d-940d-40a058a26f56 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:29.526451 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f2305-f25d-4e5d-940d-40a058a26f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:29.526719 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f2305-f25d-4e5d-940d-40a058a26f56 None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:29.527913 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f2305-f25d-4e5d-940d-40a058a26f56 None admin] RBAC: Authorizing `identity:get_project(project_id=54b4a073d17c4838b5377059540ead2e)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:29.529357 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f2305-f25d-4e5d-940d-40a058a26f56 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:29.531429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 118/233] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:29 2022] GET /identity/v3/projects/54b4a073d17c4838b5377059540ead2e => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:29.538059 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee2f35-84a0-4adc-976b-02f96e1b9cdd None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:29.681542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee2f35-84a0-4adc-976b-02f96e1b9cdd None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:29.715380 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d6081-c73e-4516-9693-2f4227f93578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:29.716040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d6081-c73e-4516-9693-2f4227f93578 None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:29.716377 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d6081-c73e-4516-9693-2f4227f93578 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:29.716655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d6081-c73e-4516-9693-2f4227f93578 None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e/users/39600eea237c471db007812ac7039844/roles/e4ff1977289a44cea73b844f8ad102a1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:29.718871 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d6081-c73e-4516-9693-2f4227f93578 None admin] RBAC: Authorizing `identity:create_grant(project_id=54b4a073d17c4838b5377059540ead2e, user_id=39600eea237c471db007812ac7039844, role_id=e4ff1977289a44cea73b844f8ad102a1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:29.720325 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d6081-c73e-4516-9693-2f4227f93578 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:29.828227 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 116/234] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 18:59:29 2022] PUT /identity/v3/projects/54b4a073d17c4838b5377059540ead2e/users/39600eea237c471db007812ac7039844/roles/e4ff1977289a44cea73b844f8ad102a1 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 18:59:30.130243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b7fb8-9c9c-4cdb-9099-2b90d98e67ce None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:30.130740 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b7fb8-9c9c-4cdb-9099-2b90d98e67ce None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:30.131017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b7fb8-9c9c-4cdb-9099-2b90d98e67ce None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:30.132207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 119/235] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:30.138011 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f32b1-f391-4921-95f5-6c349d51dee1 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:30.138436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f32b1-f391-4921-95f5-6c349d51dee1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:30.138534 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f32b1-f391-4921-95f5-6c349d51dee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:30.141947 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831700b3-a0f8-46e8-b6d9-a470ba3aac53 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:30.142225 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831700b3-a0f8-46e8-b6d9-a470ba3aac53 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:30.142494 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831700b3-a0f8-46e8-b6d9-a470ba3aac53 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:30.144558 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 120/236] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 18:59:30.149476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77428df-d853-495a-a82a-1be925f5af5f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:30.149783 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77428df-d853-495a-a82a-1be925f5af5f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:30.150229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77428df-d853-495a-a82a-1be925f5af5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:30.177035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a77428df-d853-495a-a82a-1be925f5af5f None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:30.178249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a77428df-d853-495a-a82a-1be925f5af5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:30.178927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-213f32b1-f391-4921-95f5-6c349d51dee1 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:30.180103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-213f32b1-f391-4921-95f5-6c349d51dee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:30.222609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:30.257868 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 121/237] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:30.286319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77428df-d853-495a-a82a-1be925f5af5f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:30.298857 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:30.302512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 117/238] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:30.329500 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f32b1-f391-4921-95f5-6c349d51dee1 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:30.445812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77428df-d853-495a-a82a-1be925f5af5f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:30.484762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60ce5c-45cf-4663-ae48-68f81ce9e6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:30.485395 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60ce5c-45cf-4663-ae48-68f81ce9e6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:30.485701 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60ce5c-45cf-4663-ae48-68f81ce9e6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:30.485969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60ce5c-45cf-4663-ae48-68f81ce9e6c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:30.487357 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60ce5c-45cf-4663-ae48-68f81ce9e6c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:30.488966 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60ce5c-45cf-4663-ae48-68f81ce9e6c4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:30.492242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 122/239] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 18:59:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:30.500002 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60ce5c-45cf-4663-ae48-68f81ce9e6c4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:30.534390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f32b1-f391-4921-95f5-6c349d51dee1 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:30.585584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f19a6-fbd7-424e-ad3a-a91bb409e9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:30.586220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f19a6-fbd7-424e-ad3a-a91bb409e9dc None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:30.586497 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f19a6-fbd7-424e-ad3a-a91bb409e9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:30.586767 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f19a6-fbd7-424e-ad3a-a91bb409e9dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:30.599059 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f19a6-fbd7-424e-ad3a-a91bb409e9dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:30.603738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-0f4f19a6-fbd7-424e-ad3a-a91bb409e9dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 18:59:30.603738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:30.603738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:30.603738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:30.603738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:30.603738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:30.603738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:30.603738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:30.603738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:30.603738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:30.603738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:30.603738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:30.603738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:30.603738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:30.603738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:30.603738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:30.604619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:30.604619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:30.604619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:30.604619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:30.604619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:30.604619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:30.604619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:30.604619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:30.604619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:30.604619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:30.604619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:30.604619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:30.604619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:30.604619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:30.604619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:30.604619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:30.605415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:30.605415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:30.605415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:30.605415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:30.605415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:30.605415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:30.605415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:30.605415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:30.605415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:30.605415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:30.605415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 18:59:30.605415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:30.605415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 118/240] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 18:59:30.607259 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35be768-0cf0-4b35-a47a-2b44d22aa284 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:30.607543 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35be768-0cf0-4b35-a47a-2b44d22aa284 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:30.607879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35be768-0cf0-4b35-a47a-2b44d22aa284 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:30.609236 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 119/241] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:30.614292 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35be768-0cf0-4b35-a47a-2b44d22aa284 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:30.630779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:30.642627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:30.658759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60ce5c-45cf-4663-ae48-68f81ce9e6c4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:30.703372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d94d3-12bd-413e-8945-fead681db6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:30.704003 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d94d3-12bd-413e-8945-fead681db6cc None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:30.704340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d94d3-12bd-413e-8945-fead681db6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:30.704606 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d94d3-12bd-413e-8945-fead681db6cc None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:30.705308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d94d3-12bd-413e-8945-fead681db6cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:30.707130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d94d3-12bd-413e-8945-fead681db6cc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:30.720648 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35be768-0cf0-4b35-a47a-2b44d22aa284 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:30.756398 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2ac55-7abf-4b71-bf17-28098c0fd367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:30.757010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2ac55-7abf-4b71-bf17-28098c0fd367 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:30.757289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2ac55-7abf-4b71-bf17-28098c0fd367 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:30.757589 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2ac55-7abf-4b71-bf17-28098c0fd367 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:30.758506 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2ac55-7abf-4b71-bf17-28098c0fd367 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:30.758807 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2ac55-7abf-4b71-bf17-28098c0fd367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:30.760203 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2ac55-7abf-4b71-bf17-28098c0fd367 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:30.768887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 120/242] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:30.773653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2617ebb-95af-4bde-be4f-996aad825d7c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:30.773653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2617ebb-95af-4bde-be4f-996aad825d7c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:30.773653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2617ebb-95af-4bde-be4f-996aad825d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:30.792573 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f2617ebb-95af-4bde-be4f-996aad825d7c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:30.793806 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f2617ebb-95af-4bde-be4f-996aad825d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:30.800807 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 123/243] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Aug 9 18:59:30 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 18:59:30.803172 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d94d3-12bd-413e-8945-fead681db6cc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:30.937309 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d94d3-12bd-413e-8945-fead681db6cc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:30.938801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 121/244] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:30.975974 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:30.977595 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2617ebb-95af-4bde-be4f-996aad825d7c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:30.994827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170097f-d68f-46da-864f-0de434dae84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:30.995481 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170097f-d68f-46da-864f-0de434dae84d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:30.995762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170097f-d68f-46da-864f-0de434dae84d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:30.996035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170097f-d68f-46da-864f-0de434dae84d None admin] PATH_INFO: `/v3/users/93f57b7aebbc42b0a21165dea56bf049` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:31.013516 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:31.027393 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170097f-d68f-46da-864f-0de434dae84d None admin] RBAC: Authorizing `identity:get_user(user_id=93f57b7aebbc42b0a21165dea56bf049)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:31.030114 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170097f-d68f-46da-864f-0de434dae84d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:31.032136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 124/245] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:30 2022] GET /identity/v3/users/93f57b7aebbc42b0a21165dea56bf049 => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:31.038779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170097f-d68f-46da-864f-0de434dae84d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:31.123637 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2617ebb-95af-4bde-be4f-996aad825d7c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:31.163682 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113b11b-c513-48ed-9612-35d115313798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:31.164433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113b11b-c513-48ed-9612-35d115313798 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:31.164655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113b11b-c513-48ed-9612-35d115313798 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:31.164927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113b11b-c513-48ed-9612-35d115313798 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:31.173237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170097f-d68f-46da-864f-0de434dae84d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:31.177161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113b11b-c513-48ed-9612-35d115313798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:31.182264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-7113b11b-c513-48ed-9612-35d115313798 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:31.182264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:31.182264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:31.182264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:31.182264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:31.182264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:31.182264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:31.182264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:31.182264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:31.182264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:31.182264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:31.182264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:31.182264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:31.182264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:31.182264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:31.182264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:31.183132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:31.183132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:31.183132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:31.183132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:31.183132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:31.183132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:31.183132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:31.183132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:31.183132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:31.183132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:31.183132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:31.183132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:31.183132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:31.183132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:31.183132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:31.183132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:31.183915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:31.183915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:31.183915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:31.183915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:31.183915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:31.183915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:31.183915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:31.183915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:31.183915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:31.183915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:31.183915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:31.183915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:31.183915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 122/246] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 18:59:31.190536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113b11b-c513-48ed-9612-35d115313798 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:31.238814 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8bc50-4ecf-491f-9b99-bfbe3fab4e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:31.239417 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8bc50-4ecf-491f-9b99-bfbe3fab4e0d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:31.239768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8bc50-4ecf-491f-9b99-bfbe3fab4e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:31.240084 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8bc50-4ecf-491f-9b99-bfbe3fab4e0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:31.302450 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:31.312507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:31.330099 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8bc50-4ecf-491f-9b99-bfbe3fab4e0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:31.332187 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8bc50-4ecf-491f-9b99-bfbe3fab4e0d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:31.337659 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113b11b-c513-48ed-9612-35d115313798 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:31.385916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc8700-d2b6-45f9-98a3-090638706284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:31.386541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc8700-d2b6-45f9-98a3-090638706284 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:31.387145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc8700-d2b6-45f9-98a3-090638706284 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:31.387428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc8700-d2b6-45f9-98a3-090638706284 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:31.388282 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc8700-d2b6-45f9-98a3-090638706284 None admin] RBAC: Adding query filter params (name=member) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:31.388690 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc8700-d2b6-45f9-98a3-090638706284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:31.391195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc8700-d2b6-45f9-98a3-090638706284 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:31.401867 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 123/247] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:31.407511 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc8700-d2b6-45f9-98a3-090638706284 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:31.458835 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 125/248] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 18:59:31.466406 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8bc50-4ecf-491f-9b99-bfbe3fab4e0d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:31.530109 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc8700-d2b6-45f9-98a3-090638706284 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:31.567917 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae4339-e05b-4de6-9e01-5736f54bad78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:31.568387 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae4339-e05b-4de6-9e01-5736f54bad78 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:31.568669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae4339-e05b-4de6-9e01-5736f54bad78 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:31.568942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae4339-e05b-4de6-9e01-5736f54bad78 None admin] PATH_INFO: `/v3/users/fa268966c9a04aa09432699193450288` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:31.570126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae4339-e05b-4de6-9e01-5736f54bad78 None admin] RBAC: Authorizing `identity:get_user(user_id=fa268966c9a04aa09432699193450288)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:31.571600 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae4339-e05b-4de6-9e01-5736f54bad78 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:31.577482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 124/249] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:31 2022] GET /identity/v3/users/fa268966c9a04aa09432699193450288 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:31.579901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae4339-e05b-4de6-9e01-5736f54bad78 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:31.582543 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:31.591792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8bc50-4ecf-491f-9b99-bfbe3fab4e0d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:31.595050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:31.627862 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04482a04-08fa-4183-9bbb-0eb34bd95b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:31.628990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04482a04-08fa-4183-9bbb-0eb34bd95b5f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:31.629499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04482a04-08fa-4183-9bbb-0eb34bd95b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:31.629975 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04482a04-08fa-4183-9bbb-0eb34bd95b5f None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:31.631353 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04482a04-08fa-4183-9bbb-0eb34bd95b5f None admin] RBAC: Authorizing `identity:get_project(project_id=54b4a073d17c4838b5377059540ead2e)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:31.633312 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04482a04-08fa-4183-9bbb-0eb34bd95b5f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:31.635630 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 126/250] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:31 2022] GET /identity/v3/projects/54b4a073d17c4838b5377059540ead2e => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:31.643380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04482a04-08fa-4183-9bbb-0eb34bd95b5f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:31.688307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae4339-e05b-4de6-9e01-5736f54bad78 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:31.725283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb53c3-789d-4ee1-91bd-083c40903a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:31.725955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb53c3-789d-4ee1-91bd-083c40903a58 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:31.726237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb53c3-789d-4ee1-91bd-083c40903a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:31.726512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb53c3-789d-4ee1-91bd-083c40903a58 None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:31.727803 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb53c3-789d-4ee1-91bd-083c40903a58 None admin] RBAC: Authorizing `identity:get_project(project_id=54b4a073d17c4838b5377059540ead2e)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:31.729278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb53c3-789d-4ee1-91bd-083c40903a58 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:31.731288 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 125/251] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:31 2022] GET /identity/v3/projects/54b4a073d17c4838b5377059540ead2e => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:31.736910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb53c3-789d-4ee1-91bd-083c40903a58 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:31.754891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04482a04-08fa-4183-9bbb-0eb34bd95b5f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:31.792362 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af429df-f6c1-42e7-aed8-7ba9fc0f8686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:31.793289 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af429df-f6c1-42e7-aed8-7ba9fc0f8686 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:31.793862 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af429df-f6c1-42e7-aed8-7ba9fc0f8686 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:31.794339 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af429df-f6c1-42e7-aed8-7ba9fc0f8686 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:31.795289 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af429df-f6c1-42e7-aed8-7ba9fc0f8686 None admin] RBAC: Adding query filter params (role.id=55b7e38eaf134f788a30329b137436ec, scope.project.id=54b4a073d17c4838b5377059540ead2e, user.id=93f57b7aebbc42b0a21165dea56bf049) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:31.795795 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af429df-f6c1-42e7-aed8-7ba9fc0f8686 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:31.797660 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af429df-f6c1-42e7-aed8-7ba9fc0f8686 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:31.804467 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 127/252] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 18:59:31 2022] GET /identity/v3/role_assignments?user.id=93f57b7aebbc42b0a21165dea56bf049&scope.project.id=54b4a073d17c4838b5377059540ead2e&role.id=55b7e38eaf134f788a30329b137436ec => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:31.824104 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:31.850301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb53c3-789d-4ee1-91bd-083c40903a58 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:31.889843 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af24be-9fad-42b7-b460-14265657ae69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:31.890536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af24be-9fad-42b7-b460-14265657ae69 None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:31.890818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af24be-9fad-42b7-b460-14265657ae69 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:31.891159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af24be-9fad-42b7-b460-14265657ae69 None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e/users/fa268966c9a04aa09432699193450288/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:31.893266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af24be-9fad-42b7-b460-14265657ae69 None admin] RBAC: Authorizing `identity:create_grant(project_id=54b4a073d17c4838b5377059540ead2e, user_id=fa268966c9a04aa09432699193450288, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:31.895440 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af24be-9fad-42b7-b460-14265657ae69 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:31.977299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 126/253] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 18:59:31 2022] PUT /identity/v3/projects/54b4a073d17c4838b5377059540ead2e/users/fa268966c9a04aa09432699193450288/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 18:59:32.208062 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dd123-1828-47f3-9baf-890825ae2a2a None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:32.209119 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dd123-1828-47f3-9baf-890825ae2a2a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:32.209656 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dd123-1828-47f3-9baf-890825ae2a2a None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:32.211292 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 128/254] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:32.229086 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c434a-d673-407c-98e1-d8040f9c6707 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:32.229632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c434a-d673-407c-98e1-d8040f9c6707 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:32.232714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c434a-d673-407c-98e1-d8040f9c6707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:32.258939 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-812c434a-d673-407c-98e1-d8040f9c6707 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:32.260200 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-812c434a-d673-407c-98e1-d8040f9c6707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:32.377077 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 127/255] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:32.402768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dd123-1828-47f3-9baf-890825ae2a2a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:32.434260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:32.476029 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe01ad-eda7-4ba2-9dcc-f0773a11429e None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:32.476397 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe01ad-eda7-4ba2-9dcc-f0773a11429e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:32.476771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe01ad-eda7-4ba2-9dcc-f0773a11429e None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:32.478569 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 128/256] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:32.484615 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc945c5-6845-4922-8f07-75b50567420f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:32.485005 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc945c5-6845-4922-8f07-75b50567420f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:32.485385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc945c5-6845-4922-8f07-75b50567420f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:32.526540 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-dcc945c5-6845-4922-8f07-75b50567420f None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:32.530063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-dcc945c5-6845-4922-8f07-75b50567420f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:32.551737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dd123-1828-47f3-9baf-890825ae2a2a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:32.640280 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438f756-1015-4537-80ce-63f63f0307bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:32.645477 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438f756-1015-4537-80ce-63f63f0307bc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:32.647355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438f756-1015-4537-80ce-63f63f0307bc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:32.647824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438f756-1015-4537-80ce-63f63f0307bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:32.677287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438f756-1015-4537-80ce-63f63f0307bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:32.689580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1438f756-1015-4537-80ce-63f63f0307bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:32.689580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:32.689580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:32.689580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:32.689580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:32.689580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:32.689580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:32.689580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:32.689580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:32.689580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:32.689580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:32.689580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:32.689580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:32.689580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:32.689580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:32.689580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:32.690702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:32.690702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:32.690702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:32.690702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:32.690702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:32.690702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:32.690702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:32.690702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:32.690702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:32.690702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:32.690702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:32.690702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:32.690702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:32.690702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:32.690702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:32.690702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:32.691845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:32.691845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:32.691845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:32.691845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:32.691845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:32.691845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:32.691845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:32.691845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:32.691845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:32.691845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:32.691845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:32.691845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:32.694819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 129/257] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 18:59:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:32.702398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438f756-1015-4537-80ce-63f63f0307bc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:32.704847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:32.719091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 129/258] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:32.756620 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc945c5-6845-4922-8f07-75b50567420f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:32.894954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:32.937675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438f756-1015-4537-80ce-63f63f0307bc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:32.969677 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc945c5-6845-4922-8f07-75b50567420f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:33.020717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d8a5e-b114-45b1-aae0-7762812a7882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:33.021247 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d8a5e-b114-45b1-aae0-7762812a7882 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:33.021552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d8a5e-b114-45b1-aae0-7762812a7882 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:33.021831 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d8a5e-b114-45b1-aae0-7762812a7882 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:33.022502 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d8a5e-b114-45b1-aae0-7762812a7882 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:33.022806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d8a5e-b114-45b1-aae0-7762812a7882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:33.024196 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d8a5e-b114-45b1-aae0-7762812a7882 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:33.047994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 130/259] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:33.054241 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d8a5e-b114-45b1-aae0-7762812a7882 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:33.056199 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d6572-2a80-41be-b2dd-ad1f5f081242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:33.056852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d6572-2a80-41be-b2dd-ad1f5f081242 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:33.057131 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d6572-2a80-41be-b2dd-ad1f5f081242 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:33.057398 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d6572-2a80-41be-b2dd-ad1f5f081242 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:33.080399 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d6572-2a80-41be-b2dd-ad1f5f081242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:33.085844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-ec7d6572-2a80-41be-b2dd-ad1f5f081242 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:33.085844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:33.085844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:33.085844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:33.085844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:33.085844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:33.085844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:33.085844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:33.085844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:33.085844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:33.085844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:33.085844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:33.085844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:33.085844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:33.085844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:33.085844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:33.086702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:33.086702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:33.086702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:33.086702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:33.086702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:33.086702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:33.086702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:33.086702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:33.086702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:33.086702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:33.086702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:33.086702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:33.086702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:33.086702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:33.086702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:33.086702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:33.087493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:33.087493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:33.087493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:33.087493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:33.087493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:33.087493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:33.087493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:33.087493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:33.087493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:33.087493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:33.087493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:33.087493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:33.090118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 130/260] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 18:59:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:33.104041 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d6572-2a80-41be-b2dd-ad1f5f081242 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:33.199978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:33.231837 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d8a5e-b114-45b1-aae0-7762812a7882 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:33.290097 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386c4c6-b5f3-4df4-8cdd-71eeeca0ccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:33.290653 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386c4c6-b5f3-4df4-8cdd-71eeeca0ccfa None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:33.290939 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386c4c6-b5f3-4df4-8cdd-71eeeca0ccfa None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:33.291209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386c4c6-b5f3-4df4-8cdd-71eeeca0ccfa None admin] PATH_INFO: `/v3/users/39600eea237c471db007812ac7039844` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:33.294631 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386c4c6-b5f3-4df4-8cdd-71eeeca0ccfa None admin] RBAC: Authorizing `identity:get_user(user_id=39600eea237c471db007812ac7039844)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:33.296129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386c4c6-b5f3-4df4-8cdd-71eeeca0ccfa None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:33.297827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 131/261] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:33 2022] GET /identity/v3/users/39600eea237c471db007812ac7039844 => generated 283 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:33.299840 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d6572-2a80-41be-b2dd-ad1f5f081242 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:33.303891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386c4c6-b5f3-4df4-8cdd-71eeeca0ccfa None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:33.324672 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:33.374743 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad5f72-c98b-455c-aad6-0a3fd3a7f256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:33.375366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad5f72-c98b-455c-aad6-0a3fd3a7f256 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:33.375639 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad5f72-c98b-455c-aad6-0a3fd3a7f256 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:33.375901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad5f72-c98b-455c-aad6-0a3fd3a7f256 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:33.376565 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad5f72-c98b-455c-aad6-0a3fd3a7f256 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:33.376863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad5f72-c98b-455c-aad6-0a3fd3a7f256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:33.378878 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad5f72-c98b-455c-aad6-0a3fd3a7f256 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:33.395473 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 131/262] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 18:59:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:33.401067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad5f72-c98b-455c-aad6-0a3fd3a7f256 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:33.473999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386c4c6-b5f3-4df4-8cdd-71eeeca0ccfa None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:33.538195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52271da4-0cf3-483f-9c00-fd3acc6e7bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:33.539054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52271da4-0cf3-483f-9c00-fd3acc6e7bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:33.539497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52271da4-0cf3-483f-9c00-fd3acc6e7bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:33.539908 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52271da4-0cf3-483f-9c00-fd3acc6e7bc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:33.635643 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad5f72-c98b-455c-aad6-0a3fd3a7f256 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:33.668131 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52271da4-0cf3-483f-9c00-fd3acc6e7bc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:33.669635 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52271da4-0cf3-483f-9c00-fd3acc6e7bc5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:33.684609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:33.697795 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:33.722720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489b168-77e2-4169-87fb-6fd7bcb15186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:33.723781 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489b168-77e2-4169-87fb-6fd7bcb15186 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:33.724263 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489b168-77e2-4169-87fb-6fd7bcb15186 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:33.724728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489b168-77e2-4169-87fb-6fd7bcb15186 None admin] PATH_INFO: `/v3/users/39600eea237c471db007812ac7039844` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:33.730341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489b168-77e2-4169-87fb-6fd7bcb15186 None admin] RBAC: Authorizing `identity:get_user(user_id=39600eea237c471db007812ac7039844)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:33.733369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489b168-77e2-4169-87fb-6fd7bcb15186 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:33.735306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 132/263] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:33 2022] GET /identity/v3/users/39600eea237c471db007812ac7039844 => generated 283 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:33.740851 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489b168-77e2-4169-87fb-6fd7bcb15186 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:33.862254 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 132/264] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:33.867608 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52271da4-0cf3-483f-9c00-fd3acc6e7bc5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:33.935069 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489b168-77e2-4169-87fb-6fd7bcb15186 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:33.986487 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52271da4-0cf3-483f-9c00-fd3acc6e7bc5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:34.001808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:34.010185 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d9534-321b-4f39-b6a4-4dd42b152dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:34.010819 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d9534-321b-4f39-b6a4-4dd42b152dbe None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:34.011096 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d9534-321b-4f39-b6a4-4dd42b152dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:34.011370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d9534-321b-4f39-b6a4-4dd42b152dbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:34.022856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cebf51-550c-4267-939c-2f39792de045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:34.023484 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cebf51-550c-4267-939c-2f39792de045 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:34.023762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cebf51-550c-4267-939c-2f39792de045 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:34.024033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cebf51-550c-4267-939c-2f39792de045 None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:34.025441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cebf51-550c-4267-939c-2f39792de045 None admin] RBAC: Authorizing `identity:get_project(project_id=54b4a073d17c4838b5377059540ead2e)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:34.026928 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cebf51-550c-4267-939c-2f39792de045 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:34.028576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 133/265] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:33 2022] GET /identity/v3/projects/54b4a073d17c4838b5377059540ead2e => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:34.034432 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cebf51-550c-4267-939c-2f39792de045 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:34.113817 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:34.128522 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d9534-321b-4f39-b6a4-4dd42b152dbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:34.130029 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d9534-321b-4f39-b6a4-4dd42b152dbe None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:34.136955 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cebf51-550c-4267-939c-2f39792de045 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:34.171679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094e8f0-c0a6-4d80-b549-586b9321fa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:34.172287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094e8f0-c0a6-4d80-b549-586b9321fa20 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:34.172569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094e8f0-c0a6-4d80-b549-586b9321fa20 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:34.172838 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094e8f0-c0a6-4d80-b549-586b9321fa20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:34.173858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094e8f0-c0a6-4d80-b549-586b9321fa20 None admin] RBAC: Adding query filter params (role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.project.id=54b4a073d17c4838b5377059540ead2e, user.id=39600eea237c471db007812ac7039844) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:34.174163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094e8f0-c0a6-4d80-b549-586b9321fa20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:34.176141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094e8f0-c0a6-4d80-b549-586b9321fa20 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:34.182121 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 134/266] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 18:59:34 2022] GET /identity/v3/role_assignments?user.id=39600eea237c471db007812ac7039844&scope.project.id=54b4a073d17c4838b5377059540ead2e&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:34.283463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 133/267] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 18:59:34.290053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094e8f0-c0a6-4d80-b549-586b9321fa20 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:34.340977 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe27edc-2a8b-4e49-b813-8065bb6412cc None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:34.341520 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe27edc-2a8b-4e49-b813-8065bb6412cc None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:34.341598 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe27edc-2a8b-4e49-b813-8065bb6412cc None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:34.343213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 134/268] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:34.349217 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1678be-2d79-474a-8f09-0b44ef8b990b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:34.349531 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1678be-2d79-474a-8f09-0b44ef8b990b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:34.349994 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1678be-2d79-474a-8f09-0b44ef8b990b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:34.373555 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ea1678be-2d79-474a-8f09-0b44ef8b990b None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:34.373555 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ea1678be-2d79-474a-8f09-0b44ef8b990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:34.381549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:34.479053 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 135/269] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:34.488007 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094e8f0-c0a6-4d80-b549-586b9321fa20 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:34.499503 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3304902-901c-48b5-a97d-45bc84802139 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:34.499844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3304902-901c-48b5-a97d-45bc84802139 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:34.500066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3304902-901c-48b5-a97d-45bc84802139 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:34.501626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 136/270] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 18:59:34.509256 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488a02a-66d3-416f-99d7-fad9813b0c89 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:34.509256 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488a02a-66d3-416f-99d7-fad9813b0c89 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:34.509256 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488a02a-66d3-416f-99d7-fad9813b0c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:34.541796 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c488a02a-66d3-416f-99d7-fad9813b0c89 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:34.542913 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c488a02a-66d3-416f-99d7-fad9813b0c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:34.564119 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:34.570454 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7ee43-b787-4d69-ab1b-44536073ae71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:34.571133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7ee43-b787-4d69-ab1b-44536073ae71 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:34.571420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7ee43-b787-4d69-ab1b-44536073ae71 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:34.571700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7ee43-b787-4d69-ab1b-44536073ae71 None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:34.573819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7ee43-b787-4d69-ab1b-44536073ae71 None admin] RBAC: Authorizing `identity:get_project(project_id=54b4a073d17c4838b5377059540ead2e)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:34.575293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7ee43-b787-4d69-ab1b-44536073ae71 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:34.577135 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 135/271] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:34 2022] GET /identity/v3/projects/54b4a073d17c4838b5377059540ead2e => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:34.577743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7ee43-b787-4d69-ab1b-44536073ae71 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:34.643625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 137/272] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:34.644579 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488a02a-66d3-416f-99d7-fad9813b0c89 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:34.690131 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7ee43-b787-4d69-ab1b-44536073ae71 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:34.721955 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:34.731780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ead64-6428-4e1e-95de-4a163a19b5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:34.732533 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ead64-6428-4e1e-95de-4a163a19b5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:34.732823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ead64-6428-4e1e-95de-4a163a19b5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:34.733097 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ead64-6428-4e1e-95de-4a163a19b5c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:34.734331 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ead64-6428-4e1e-95de-4a163a19b5c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:34.735904 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ead64-6428-4e1e-95de-4a163a19b5c6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:34.738190 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 136/273] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 18:59:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:34.738964 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ead64-6428-4e1e-95de-4a163a19b5c6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:34.762428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488a02a-66d3-416f-99d7-fad9813b0c89 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:34.797751 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b9f53-e1c4-4621-b6b2-79758a35b71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:34.798340 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b9f53-e1c4-4621-b6b2-79758a35b71e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:34.798616 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b9f53-e1c4-4621-b6b2-79758a35b71e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:34.798885 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b9f53-e1c4-4621-b6b2-79758a35b71e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:34.799660 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b9f53-e1c4-4621-b6b2-79758a35b71e None admin] RBAC: Adding query filter params (role.id=e4ff1977289a44cea73b844f8ad102a1, scope.project.id=54b4a073d17c4838b5377059540ead2e, user.id=39600eea237c471db007812ac7039844) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:34.800522 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b9f53-e1c4-4621-b6b2-79758a35b71e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:34.802025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b9f53-e1c4-4621-b6b2-79758a35b71e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:34.808398 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 138/274] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 18:59:34 2022] GET /identity/v3/role_assignments?user.id=39600eea237c471db007812ac7039844&scope.project.id=54b4a073d17c4838b5377059540ead2e&role.id=e4ff1977289a44cea73b844f8ad102a1 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:34.809191 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b9f53-e1c4-4621-b6b2-79758a35b71e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:34.826094 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:34.854548 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ead64-6428-4e1e-95de-4a163a19b5c6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:34.894787 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cc0ba-66a6-43d7-9f0b-c62a8c5ece3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:34.895969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cc0ba-66a6-43d7-9f0b-c62a8c5ece3b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:34.896459 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cc0ba-66a6-43d7-9f0b-c62a8c5ece3b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:34.896936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cc0ba-66a6-43d7-9f0b-c62a8c5ece3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:34.911325 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cc0ba-66a6-43d7-9f0b-c62a8c5ece3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:34.917401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9e3cc0ba-66a6-43d7-9f0b-c62a8c5ece3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:34.917401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:34.917401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:34.917401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:34.917401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:34.917401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:34.917401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:34.917401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:34.917401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:34.917401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:34.917401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:34.917401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:34.917401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:34.917401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:34.917401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:34.917401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:34.918399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:34.918399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:34.918399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:34.918399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:34.918399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:34.918399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:34.918399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:34.918399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:34.918399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:34.918399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:34.918399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:34.918399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:34.918399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:34.918399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:34.918399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:34.918399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:34.919213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:34.919213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:34.919213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:34.919213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:34.919213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:34.919213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:34.919213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:34.919213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:34.919213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:34.919213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:34.919213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:34.919213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:34.922049 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 137/275] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:34.923588 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4ed9-bcce-4c0b-b144-7ff60bb5fe17 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:34.924094 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4ed9-bcce-4c0b-b144-7ff60bb5fe17 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:34.924590 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4ed9-bcce-4c0b-b144-7ff60bb5fe17 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:34.924692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b9f53-e1c4-4621-b6b2-79758a35b71e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:34.927105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 138/276] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:34.928398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a4ed9-bcce-4c0b-b144-7ff60bb5fe17 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:34.964095 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e35b2-d19c-4c56-aa48-002073b3b03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:34.964987 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e35b2-d19c-4c56-aa48-002073b3b03d None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:34.964987 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e35b2-d19c-4c56-aa48-002073b3b03d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:34.965245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e35b2-d19c-4c56-aa48-002073b3b03d None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:34.965999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e35b2-d19c-4c56-aa48-002073b3b03d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:34.967883 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e35b2-d19c-4c56-aa48-002073b3b03d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:34.980333 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:35.041015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a4ed9-bcce-4c0b-b144-7ff60bb5fe17 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:35.076439 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a6f53-f8ad-4cf9-99fb-acb3eabf2ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:35.077249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a6f53-f8ad-4cf9-99fb-acb3eabf2ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:35.077717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a6f53-f8ad-4cf9-99fb-acb3eabf2ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:35.077991 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a6f53-f8ad-4cf9-99fb-acb3eabf2ba3 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:35.078658 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a6f53-f8ad-4cf9-99fb-acb3eabf2ba3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:35.078959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a6f53-f8ad-4cf9-99fb-acb3eabf2ba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:35.080327 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a6f53-f8ad-4cf9-99fb-acb3eabf2ba3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:35.080763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 139/277] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Aug 9 18:59:34 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 18:59:35.084103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb084fa-b385-4729-b960-4c7c958f8bfa None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:35.084398 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb084fa-b385-4729-b960-4c7c958f8bfa None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:35.084673 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb084fa-b385-4729-b960-4c7c958f8bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:35.089591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 139/278] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:35.090898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2ae9e-de8c-4eb4-94c5-3f2fe3b2a1e4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:35.091169 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2ae9e-de8c-4eb4-94c5-3f2fe3b2a1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:35.091445 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2ae9e-de8c-4eb4-94c5-3f2fe3b2a1e4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:35.092846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 140/279] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:35.097925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2ae9e-de8c-4eb4-94c5-3f2fe3b2a1e4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:35.106994 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-cbb084fa-b385-4729-b960-4c7c958f8bfa None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:35.107188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cbb084fa-b385-4729-b960-4c7c958f8bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:35.187844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:35.194588 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 140/280] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:35.196178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41d68-a290-470b-afbe-5c1fef70028c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:35.196621 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41d68-a290-470b-afbe-5c1fef70028c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:35.197043 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41d68-a290-470b-afbe-5c1fef70028c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:35.217422 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-cfd41d68-a290-470b-afbe-5c1fef70028c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:35.219038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cfd41d68-a290-470b-afbe-5c1fef70028c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:35.220390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2ae9e-de8c-4eb4-94c5-3f2fe3b2a1e4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:35.222792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:35.264038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bd9b3-c446-4774-9813-a9197ac823db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:35.265005 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bd9b3-c446-4774-9813-a9197ac823db None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:35.265421 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bd9b3-c446-4774-9813-a9197ac823db None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:35.265916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bd9b3-c446-4774-9813-a9197ac823db None admin] PATH_INFO: `/v3/users/9cc097df36cb4d229083319a2a11c489` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:35.282993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bd9b3-c446-4774-9813-a9197ac823db None admin] RBAC: Authorizing `identity:get_user(user_id=9cc097df36cb4d229083319a2a11c489)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:35.285311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bd9b3-c446-4774-9813-a9197ac823db None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:35.287154 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 141/281] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:35 2022] GET /identity/v3/users/9cc097df36cb4d229083319a2a11c489 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:35.289647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bd9b3-c446-4774-9813-a9197ac823db None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:35.299385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 141/282] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:35.300376 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd41d68-a290-470b-afbe-5c1fef70028c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:35.419331 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bd9b3-c446-4774-9813-a9197ac823db None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:35.422686 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd41d68-a290-470b-afbe-5c1fef70028c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:35.452772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:35.459371 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74b44d-e30f-4d49-aa4f-682c0343ed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:35.460075 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74b44d-e30f-4d49-aa4f-682c0343ed51 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:35.460503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74b44d-e30f-4d49-aa4f-682c0343ed51 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:35.460780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74b44d-e30f-4d49-aa4f-682c0343ed51 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:35.463609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49be0c-bcbc-4c4e-bde9-7ae07fa0e2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:35.464415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49be0c-bcbc-4c4e-bde9-7ae07fa0e2cd None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:35.464859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49be0c-bcbc-4c4e-bde9-7ae07fa0e2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:35.465290 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49be0c-bcbc-4c4e-bde9-7ae07fa0e2cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:35.466222 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49be0c-bcbc-4c4e-bde9-7ae07fa0e2cd None admin] RBAC: Adding query filter params (role.id=ead9959857d24ec6bea3b7556da18ce5, user.id=9cc097df36cb4d229083319a2a11c489, scope.system=all) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:35.467707 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49be0c-bcbc-4c4e-bde9-7ae07fa0e2cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:35.468431 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49be0c-bcbc-4c4e-bde9-7ae07fa0e2cd None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:35.473039 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74b44d-e30f-4d49-aa4f-682c0343ed51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:35.475010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 142/283] 10.222.0.65 () {56 vars in 1308 bytes} [Tue Aug 9 18:59:35 2022] GET /identity/v3/role_assignments?user.id=9cc097df36cb4d229083319a2a11c489&scope.system=all&role.id=ead9959857d24ec6bea3b7556da18ce5 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:35.476014 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49be0c-bcbc-4c4e-bde9-7ae07fa0e2cd None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:35.481762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-eb74b44d-e30f-4d49-aa4f-682c0343ed51 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 18:59:35.481762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:35.481762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:35.481762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:35.481762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:35.481762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:35.481762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:35.481762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:35.481762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:35.481762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:35.481762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:35.481762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:35.481762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:35.481762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:35.481762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:35.481762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:35.482682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:35.482682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:35.482682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:35.482682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:35.482682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:35.482682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:35.482682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:35.482682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:35.482682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:35.482682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:35.482682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:35.482682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:35.482682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:35.482682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:35.482682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:35.482682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:35.483476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:35.483476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:35.483476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:35.483476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:35.483476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:35.483476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:35.483476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:35.483476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:35.483476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:35.483476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:35.483476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 18:59:35.483476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:35.483476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 142/284] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:35.495633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74b44d-e30f-4d49-aa4f-682c0343ed51 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:35.543563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:35.653479 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74b44d-e30f-4d49-aa4f-682c0343ed51 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:35.691342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc23ce-ff25-4898-a681-2f792bbf81b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:35.691880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc23ce-ff25-4898-a681-2f792bbf81b7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:35.692169 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc23ce-ff25-4898-a681-2f792bbf81b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:35.692421 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc23ce-ff25-4898-a681-2f792bbf81b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:35.693096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc23ce-ff25-4898-a681-2f792bbf81b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:35.693400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc23ce-ff25-4898-a681-2f792bbf81b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:35.694812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc23ce-ff25-4898-a681-2f792bbf81b7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:35.710124 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49be0c-bcbc-4c4e-bde9-7ae07fa0e2cd None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:35.711035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 143/285] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:35.716800 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc23ce-ff25-4898-a681-2f792bbf81b7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:35.750618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee82d91-8a55-4791-b138-7bf5f73a74b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:35.751283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee82d91-8a55-4791-b138-7bf5f73a74b9 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:35.752416 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee82d91-8a55-4791-b138-7bf5f73a74b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:35.752416 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee82d91-8a55-4791-b138-7bf5f73a74b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:35.764290 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee82d91-8a55-4791-b138-7bf5f73a74b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:35.769384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-7ee82d91-8a55-4791-b138-7bf5f73a74b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:35.769384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:35.769384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:35.769384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:35.769384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:35.769384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:35.769384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:35.769384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:35.769384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:35.769384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:35.769384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:35.769384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:35.769384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:35.769384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:35.769384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:35.769384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:35.770623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:35.770623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:35.770623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:35.770623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:35.770623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:35.770623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:35.770623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:35.770623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:35.770623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:35.770623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:35.770623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:35.770623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:35.770623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:35.770623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:35.770623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:35.770623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:35.771428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:35.771428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:35.771428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:35.771428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:35.771428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:35.771428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:35.771428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:35.771428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:35.771428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:35.771428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:35.771428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:35.771428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:35.771428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 143/286] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:35.777254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee82d91-8a55-4791-b138-7bf5f73a74b9 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:35.836464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:35.868399 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:35.871757 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc23ce-ff25-4898-a681-2f792bbf81b7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:35.923978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee6308-b5b2-4403-95db-8eba10d45a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:35.924619 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee6308-b5b2-4403-95db-8eba10d45a39 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:35.925004 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee6308-b5b2-4403-95db-8eba10d45a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:35.925558 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee6308-b5b2-4403-95db-8eba10d45a39 None admin] PATH_INFO: `/v3/users/93f57b7aebbc42b0a21165dea56bf049` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:35.927073 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee6308-b5b2-4403-95db-8eba10d45a39 None admin] RBAC: Authorizing `identity:get_user(user_id=93f57b7aebbc42b0a21165dea56bf049)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:35.930633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee6308-b5b2-4403-95db-8eba10d45a39 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:35.934987 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 144/287] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:35 2022] GET /identity/v3/users/93f57b7aebbc42b0a21165dea56bf049 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:35.937854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee6308-b5b2-4403-95db-8eba10d45a39 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:35.977205 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee82d91-8a55-4791-b138-7bf5f73a74b9 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:36.045763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3767f7-bab6-4411-9c39-319fddb738fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:36.046478 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3767f7-bab6-4411-9c39-319fddb738fd None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:36.046764 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3767f7-bab6-4411-9c39-319fddb738fd None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:36.047035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3767f7-bab6-4411-9c39-319fddb738fd None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:36.047701 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3767f7-bab6-4411-9c39-319fddb738fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:36.048004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3767f7-bab6-4411-9c39-319fddb738fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:36.049399 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3767f7-bab6-4411-9c39-319fddb738fd None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:36.069826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 144/288] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:36.074746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3767f7-bab6-4411-9c39-319fddb738fd None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:36.123804 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee6308-b5b2-4403-95db-8eba10d45a39 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:36.191215 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d2ded-ff45-4e4b-8e32-c7b7625ec2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:36.191849 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d2ded-ff45-4e4b-8e32-c7b7625ec2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:36.192127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d2ded-ff45-4e4b-8e32-c7b7625ec2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:36.192399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d2ded-ff45-4e4b-8e32-c7b7625ec2c7 None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:36.195927 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d2ded-ff45-4e4b-8e32-c7b7625ec2c7 None admin] RBAC: Authorizing `identity:get_project(project_id=54b4a073d17c4838b5377059540ead2e)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:36.197382 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d2ded-ff45-4e4b-8e32-c7b7625ec2c7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:36.204848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 145/289] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:35 2022] GET /identity/v3/projects/54b4a073d17c4838b5377059540ead2e => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:36.205712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d2ded-ff45-4e4b-8e32-c7b7625ec2c7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:36.250964 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3767f7-bab6-4411-9c39-319fddb738fd None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:36.252265 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:36.265737 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:36.287341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2294d4-c42a-4cae-942f-c6453e8739e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:36.287985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2294d4-c42a-4cae-942f-c6453e8739e6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:36.288266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2294d4-c42a-4cae-942f-c6453e8739e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:36.288539 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2294d4-c42a-4cae-942f-c6453e8739e6 None admin] PATH_INFO: `/v3/users/fa268966c9a04aa09432699193450288` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:36.289801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2294d4-c42a-4cae-942f-c6453e8739e6 None admin] RBAC: Authorizing `identity:get_user(user_id=fa268966c9a04aa09432699193450288)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:36.291250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2294d4-c42a-4cae-942f-c6453e8739e6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:36.293153 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 145/290] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:36 2022] GET /identity/v3/users/fa268966c9a04aa09432699193450288 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:36.298602 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2294d4-c42a-4cae-942f-c6453e8739e6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:36.426641 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2294d4-c42a-4cae-942f-c6453e8739e6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:36.463644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234726cf-4309-416a-832c-eae56a0038c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:36.464260 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234726cf-4309-416a-832c-eae56a0038c2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:36.464544 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234726cf-4309-416a-832c-eae56a0038c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:36.464816 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234726cf-4309-416a-832c-eae56a0038c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:36.480606 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d2ded-ff45-4e4b-8e32-c7b7625ec2c7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:36.536270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:36.550193 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234726cf-4309-416a-832c-eae56a0038c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:36.554726 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234726cf-4309-416a-832c-eae56a0038c2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:36.581761 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d248931-5c22-428f-b9c8-5b68b6463748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:36.582526 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d248931-5c22-428f-b9c8-5b68b6463748 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:36.582804 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d248931-5c22-428f-b9c8-5b68b6463748 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:36.583078 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d248931-5c22-428f-b9c8-5b68b6463748 None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e/users/93f57b7aebbc42b0a21165dea56bf049/roles/55b7e38eaf134f788a30329b137436ec` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:36.586062 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d248931-5c22-428f-b9c8-5b68b6463748 None admin] RBAC: Authorizing `identity:create_grant(project_id=54b4a073d17c4838b5377059540ead2e, user_id=93f57b7aebbc42b0a21165dea56bf049, role_id=55b7e38eaf134f788a30329b137436ec)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:36.587513 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d248931-5c22-428f-b9c8-5b68b6463748 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:36.668617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 146/291] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 18:59:36.674278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234726cf-4309-416a-832c-eae56a0038c2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:36.696319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 146/292] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 18:59:36 2022] PUT /identity/v3/projects/54b4a073d17c4838b5377059540ead2e/users/93f57b7aebbc42b0a21165dea56bf049/roles/55b7e38eaf134f788a30329b137436ec => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 18:59:36.768543 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:36.788602 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234726cf-4309-416a-832c-eae56a0038c2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:36.826095 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cb687-445f-4e86-a8af-90e31e7184ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:36.826789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cb687-445f-4e86-a8af-90e31e7184ed None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:36.827073 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cb687-445f-4e86-a8af-90e31e7184ed None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:36.827345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cb687-445f-4e86-a8af-90e31e7184ed None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:36.828545 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cb687-445f-4e86-a8af-90e31e7184ed None admin] RBAC: Authorizing `identity:get_project(project_id=54b4a073d17c4838b5377059540ead2e)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:36.830102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cb687-445f-4e86-a8af-90e31e7184ed None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:36.836741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 147/293] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:36 2022] GET /identity/v3/projects/54b4a073d17c4838b5377059540ead2e => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:36.838463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d248931-5c22-428f-b9c8-5b68b6463748 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:36.939386 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:36.970808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d248931-5c22-428f-b9c8-5b68b6463748 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:37.016246 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb36e6f-2ee3-4018-b9d5-162fa862c22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:37.016883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb36e6f-2ee3-4018-b9d5-162fa862c22f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:37.017260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb36e6f-2ee3-4018-b9d5-162fa862c22f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:37.017615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb36e6f-2ee3-4018-b9d5-162fa862c22f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:37.018375 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb36e6f-2ee3-4018-b9d5-162fa862c22f None admin] RBAC: Adding query filter params (role.id=ead9959857d24ec6bea3b7556da18ce5, scope.project.id=54b4a073d17c4838b5377059540ead2e, user.id=fa268966c9a04aa09432699193450288) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:37.019271 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb36e6f-2ee3-4018-b9d5-162fa862c22f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:37.020747 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb36e6f-2ee3-4018-b9d5-162fa862c22f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:37.031094 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 147/294] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 18:59:36 2022] GET /identity/v3/role_assignments?user.id=fa268966c9a04aa09432699193450288&scope.project.id=54b4a073d17c4838b5377059540ead2e&role.id=ead9959857d24ec6bea3b7556da18ce5 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:37.437721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f31582-f7c9-4661-a5dd-8432af2e6692 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:37.438268 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f31582-f7c9-4661-a5dd-8432af2e6692 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:37.438268 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f31582-f7c9-4661-a5dd-8432af2e6692 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:37.439644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 148/295] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:37.445779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aba6d5-bab0-4409-ba34-91130e6d9150 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:37.446105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aba6d5-bab0-4409-ba34-91130e6d9150 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:37.446419 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aba6d5-bab0-4409-ba34-91130e6d9150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:37.470693 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-99aba6d5-bab0-4409-ba34-91130e6d9150 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:37.472413 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-99aba6d5-bab0-4409-ba34-91130e6d9150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:37.564219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 148/296] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:37.589822 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f31582-f7c9-4661-a5dd-8432af2e6692 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:37.619039 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fd50c-869c-40fd-becf-6e4ce4a5b59f None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:37.619674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fd50c-869c-40fd-becf-6e4ce4a5b59f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:37.620155 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fd50c-869c-40fd-becf-6e4ce4a5b59f None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:37.622053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 149/297] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:37.629663 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f1a38-053c-46f5-abb5-658ed5272626 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:37.629988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f1a38-053c-46f5-abb5-658ed5272626 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:37.630299 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f1a38-053c-46f5-abb5-658ed5272626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:37.649964 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a91f1a38-053c-46f5-abb5-658ed5272626 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:37.651151 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a91f1a38-053c-46f5-abb5-658ed5272626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:37.705387 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f31582-f7c9-4661-a5dd-8432af2e6692 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:37.726323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 150/298] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:37.745522 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31083b66-f05c-4369-b53d-24c412d78d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:37.746162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31083b66-f05c-4369-b53d-24c412d78d33 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:37.746494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31083b66-f05c-4369-b53d-24c412d78d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:37.746769 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31083b66-f05c-4369-b53d-24c412d78d33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:37.749766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f1a38-053c-46f5-abb5-658ed5272626 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:37.752302 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:37.758957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31083b66-f05c-4369-b53d-24c412d78d33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:37.763943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-31083b66-f05c-4369-b53d-24c412d78d33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 18:59:37.763943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:37.763943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:37.763943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:37.763943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:37.763943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:37.763943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:37.763943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:37.763943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:37.763943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:37.763943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:37.763943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:37.763943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:37.763943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:37.763943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:37.763943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:37.771777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:37.771777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:37.771777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:37.771777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:37.771777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:37.771777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:37.771777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:37.771777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:37.771777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:37.771777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:37.771777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:37.771777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:37.771777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:37.771777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:37.771777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:37.771777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:37.772758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:37.772758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:37.772758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:37.772758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:37.772758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:37.772758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:37.772758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:37.772758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:37.772758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:37.772758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:37.772758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 18:59:37.772758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:37.772758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 149/299] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:37.774627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31083b66-f05c-4369-b53d-24c412d78d33 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:37.787832 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:37.865272 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f1a38-053c-46f5-abb5-658ed5272626 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:37.880260 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31083b66-f05c-4369-b53d-24c412d78d33 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:37.904316 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de4ae7-e47d-4995-ad54-1dd2682397c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:37.905271 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de4ae7-e47d-4995-ad54-1dd2682397c6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:37.905576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de4ae7-e47d-4995-ad54-1dd2682397c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:37.905852 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de4ae7-e47d-4995-ad54-1dd2682397c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:37.906964 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de4ae7-e47d-4995-ad54-1dd2682397c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:37.908446 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de4ae7-e47d-4995-ad54-1dd2682397c6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:37.910918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 151/300] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 18:59:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:37.911748 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cace39-d990-4b75-b92b-97fdd0846590 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:37.912048 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cace39-d990-4b75-b92b-97fdd0846590 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:37.912321 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cace39-d990-4b75-b92b-97fdd0846590 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:37.913679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 152/301] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:37.918248 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cace39-d990-4b75-b92b-97fdd0846590 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:37.921223 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4196f-838d-4938-ad86-a9851f790fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:37.923010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4196f-838d-4938-ad86-a9851f790fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:37.923529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4196f-838d-4938-ad86-a9851f790fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:37.923994 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4196f-838d-4938-ad86-a9851f790fd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:37.925013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4196f-838d-4938-ad86-a9851f790fd9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:37.925785 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4196f-838d-4938-ad86-a9851f790fd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:37.927878 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4196f-838d-4938-ad86-a9851f790fd9 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:37.941762 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 150/302] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:37.943196 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef522b-ff1c-4c26-80bb-b09d81702e29 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:37.943801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef522b-ff1c-4c26-80bb-b09d81702e29 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:37.944084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef522b-ff1c-4c26-80bb-b09d81702e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:37.962687 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-e2ef522b-ff1c-4c26-80bb-b09d81702e29 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:37.964072 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e2ef522b-ff1c-4c26-80bb-b09d81702e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:37.992746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:38.026302 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cace39-d990-4b75-b92b-97fdd0846590 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:38.040297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 151/303] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:38.041437 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef522b-ff1c-4c26-80bb-b09d81702e29 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:38.043806 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:38.068186 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d87e8b-8609-4e4c-8ccc-06e6f5fa7717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:38.068894 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d87e8b-8609-4e4c-8ccc-06e6f5fa7717 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:38.069207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d87e8b-8609-4e4c-8ccc-06e6f5fa7717 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:38.069501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d87e8b-8609-4e4c-8ccc-06e6f5fa7717 None admin] PATH_INFO: `/v3/groups` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:38.070129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d87e8b-8609-4e4c-8ccc-06e6f5fa7717 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:38.071550 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d87e8b-8609-4e4c-8ccc-06e6f5fa7717 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:38.149483 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 153/304] 10.222.0.65 () {60 vars in 1134 bytes} [Tue Aug 9 18:59:37 2022] POST /identity/v3/groups => generated 229 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 18:59:38.149483 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d87e8b-8609-4e4c-8ccc-06e6f5fa7717 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:38.152584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef522b-ff1c-4c26-80bb-b09d81702e29 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:38.205134 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43122a-ace7-4496-9489-a174d6cf2ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:38.205836 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43122a-ace7-4496-9489-a174d6cf2ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:38.206693 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43122a-ace7-4496-9489-a174d6cf2ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:38.206975 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43122a-ace7-4496-9489-a174d6cf2ef2 None admin] PATH_INFO: `/v3/users/8210b496808442829830975c27fe65d2` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:38.228917 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43122a-ace7-4496-9489-a174d6cf2ef2 None admin] RBAC: Authorizing `identity:get_user(user_id=8210b496808442829830975c27fe65d2)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:38.231566 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43122a-ace7-4496-9489-a174d6cf2ef2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:38.237723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 152/305] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:38 2022] GET /identity/v3/users/8210b496808442829830975c27fe65d2 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:38.241636 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43122a-ace7-4496-9489-a174d6cf2ef2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:38.279369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d87e8b-8609-4e4c-8ccc-06e6f5fa7717 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:38.312743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:38.321903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff45ac-f64c-450f-b864-72f5e988e9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:38.322568 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:38.322833 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff45ac-f64c-450f-b864-72f5e988e9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:38.323176 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff45ac-f64c-450f-b864-72f5e988e9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:38.323627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff45ac-f64c-450f-b864-72f5e988e9a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:38.335761 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff45ac-f64c-450f-b864-72f5e988e9a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:38.341841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-0aff45ac-f64c-450f-b864-72f5e988e9a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:38.341841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:38.341841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:38.341841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:38.341841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:38.341841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:38.341841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:38.341841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:38.341841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:38.341841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:38.341841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:38.341841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:38.341841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:38.341841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:38.341841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:38.341841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:38.350420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:38.350420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:38.350420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:38.350420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:38.350420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:38.350420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:38.350420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:38.350420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:38.350420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:38.350420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:38.350420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:38.350420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:38.350420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:38.350420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:38.350420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:38.350420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:38.351204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:38.351204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:38.351204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:38.351204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:38.351204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:38.351204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:38.351204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:38.351204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:38.351204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:38.351204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:38.351204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:38.351204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:38.351204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 154/306] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:38.355823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff45ac-f64c-450f-b864-72f5e988e9a3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:38.379716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43122a-ace7-4496-9489-a174d6cf2ef2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:38.418888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109880e-561b-49dd-b33f-90f14d3def61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:38.420280 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109880e-561b-49dd-b33f-90f14d3def61 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:38.421050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109880e-561b-49dd-b33f-90f14d3def61 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:38.421587 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109880e-561b-49dd-b33f-90f14d3def61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:38.423104 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109880e-561b-49dd-b33f-90f14d3def61 None admin] RBAC: Adding query filter params (role.id=55b7e38eaf134f788a30329b137436ec, user.id=8210b496808442829830975c27fe65d2, scope.system=all) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:38.423623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109880e-561b-49dd-b33f-90f14d3def61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:38.426568 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109880e-561b-49dd-b33f-90f14d3def61 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:38.433530 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 153/307] 10.222.0.65 () {56 vars in 1308 bytes} [Tue Aug 9 18:59:38 2022] GET /identity/v3/role_assignments?user.id=8210b496808442829830975c27fe65d2&scope.system=all&role.id=55b7e38eaf134f788a30329b137436ec => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:38.479331 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff45ac-f64c-450f-b864-72f5e988e9a3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:38.522936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1da17-aeae-4bea-b9cb-12e0ddadc7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:38.523568 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1da17-aeae-4bea-b9cb-12e0ddadc7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:38.523852 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1da17-aeae-4bea-b9cb-12e0ddadc7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:38.524127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1da17-aeae-4bea-b9cb-12e0ddadc7d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:38.524812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1da17-aeae-4bea-b9cb-12e0ddadc7d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:38.525120 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1da17-aeae-4bea-b9cb-12e0ddadc7d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:38.527425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1da17-aeae-4bea-b9cb-12e0ddadc7d4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:38.539095 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 155/308] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:38.544744 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109880e-561b-49dd-b33f-90f14d3def61 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:38.661308 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109880e-561b-49dd-b33f-90f14d3def61 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:38.692076 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:38.705144 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753cb84-1547-4283-995b-0732cc1af2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:38.706342 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753cb84-1547-4283-995b-0732cc1af2cb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:38.714987 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753cb84-1547-4283-995b-0732cc1af2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:38.714987 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753cb84-1547-4283-995b-0732cc1af2cb None admin] PATH_INFO: `/v3/users/9cc097df36cb4d229083319a2a11c489` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:38.714987 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753cb84-1547-4283-995b-0732cc1af2cb None admin] RBAC: Authorizing `identity:get_user(user_id=9cc097df36cb4d229083319a2a11c489)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:38.714987 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753cb84-1547-4283-995b-0732cc1af2cb None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:38.714987 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 154/309] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:38 2022] GET /identity/v3/users/9cc097df36cb4d229083319a2a11c489 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:38.717045 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1da17-aeae-4bea-b9cb-12e0ddadc7d4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:38.774694 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:38.824874 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1da17-aeae-4bea-b9cb-12e0ddadc7d4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:38.860442 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65ddbe-9dc9-4a4c-b8fa-0d2d58e038cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:38.861123 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65ddbe-9dc9-4a4c-b8fa-0d2d58e038cd None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:38.861408 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65ddbe-9dc9-4a4c-b8fa-0d2d58e038cd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:38.861733 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65ddbe-9dc9-4a4c-b8fa-0d2d58e038cd None admin] PATH_INFO: `/v3/system/users/9cc097df36cb4d229083319a2a11c489/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:38.863734 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65ddbe-9dc9-4a4c-b8fa-0d2d58e038cd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9cc097df36cb4d229083319a2a11c489, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:38.865121 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65ddbe-9dc9-4a4c-b8fa-0d2d58e038cd None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:38.950782 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 156/310] 10.222.0.65 () {58 vars in 1334 bytes} [Tue Aug 9 18:59:38 2022] PUT /identity/v3/system/users/9cc097df36cb4d229083319a2a11c489/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 18:59:39.133896 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f5494-c06c-4817-9257-ee007feb8776 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:39.134207 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f5494-c06c-4817-9257-ee007feb8776 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:39.134448 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f5494-c06c-4817-9257-ee007feb8776 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:39.135915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 155/311] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:39.142325 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1769bee-fd9d-4136-871a-689813b62135 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:39.142325 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1769bee-fd9d-4136-871a-689813b62135 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:39.142325 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1769bee-fd9d-4136-871a-689813b62135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:39.161084 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a1769bee-fd9d-4136-871a-689813b62135 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:39.162585 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a1769bee-fd9d-4136-871a-689813b62135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:39.234543 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 157/312] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:39.258159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f5494-c06c-4817-9257-ee007feb8776 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:39.363243 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f5494-c06c-4817-9257-ee007feb8776 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:39.400300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a986c19-0c72-401f-b14b-44321d849c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:39.400856 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a986c19-0c72-401f-b14b-44321d849c2d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:39.401130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a986c19-0c72-401f-b14b-44321d849c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:39.401396 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a986c19-0c72-401f-b14b-44321d849c2d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:39.412773 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a986c19-0c72-401f-b14b-44321d849c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:39.417496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-7a986c19-0c72-401f-b14b-44321d849c2d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 18:59:39.417496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:39.417496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:39.417496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:39.417496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:39.417496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:39.417496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:39.417496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:39.417496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:39.417496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:39.417496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:39.417496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:39.417496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:39.417496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:39.417496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:39.417496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:39.418374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:39.418374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:39.418374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:39.418374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:39.418374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:39.418374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:39.418374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:39.418374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:39.418374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:39.418374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:39.418374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:39.418374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:39.418374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:39.418374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:39.418374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:39.418374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:39.419156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:39.419156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:39.419156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:39.419156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:39.419156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:39.419156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:39.419156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:39.419156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:39.419156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:39.419156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:39.419156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 18:59:39.419156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:39.419156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 156/313] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:39.424998 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1769bee-fd9d-4136-871a-689813b62135 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:39.472799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:39.527039 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1769bee-fd9d-4136-871a-689813b62135 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:39.561541 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb28b44-f19a-4f68-a79c-97f3bceeb318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:39.562153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb28b44-f19a-4f68-a79c-97f3bceeb318 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:39.562433 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb28b44-f19a-4f68-a79c-97f3bceeb318 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:39.562703 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb28b44-f19a-4f68-a79c-97f3bceeb318 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:39.563363 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb28b44-f19a-4f68-a79c-97f3bceeb318 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:39.563658 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb28b44-f19a-4f68-a79c-97f3bceeb318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:39.565042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb28b44-f19a-4f68-a79c-97f3bceeb318 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:39.573679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 158/314] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:39.579179 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a986c19-0c72-401f-b14b-44321d849c2d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:39.636627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:39.691782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a986c19-0c72-401f-b14b-44321d849c2d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:39.726016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec30aa2-7cdb-4928-9307-f2e090c6daa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:39.726645 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec30aa2-7cdb-4928-9307-f2e090c6daa2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:39.726921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec30aa2-7cdb-4928-9307-f2e090c6daa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:39.727188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec30aa2-7cdb-4928-9307-f2e090c6daa2 None admin] PATH_INFO: `/v3/users/93f57b7aebbc42b0a21165dea56bf049` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:39.728311 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec30aa2-7cdb-4928-9307-f2e090c6daa2 None admin] RBAC: Authorizing `identity:get_user(user_id=93f57b7aebbc42b0a21165dea56bf049)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:39.729770 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec30aa2-7cdb-4928-9307-f2e090c6daa2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:39.731331 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 157/315] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:39 2022] GET /identity/v3/users/93f57b7aebbc42b0a21165dea56bf049 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:39.736842 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb28b44-f19a-4f68-a79c-97f3bceeb318 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:39.838962 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb28b44-f19a-4f68-a79c-97f3bceeb318 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:39.848037 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:39.872885 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91d156-33a5-46a8-b706-c8d59e969249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:39.873507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91d156-33a5-46a8-b706-c8d59e969249 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:39.873787 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91d156-33a5-46a8-b706-c8d59e969249 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:39.874056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91d156-33a5-46a8-b706-c8d59e969249 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:39.952085 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91d156-33a5-46a8-b706-c8d59e969249 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:39.953554 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91d156-33a5-46a8-b706-c8d59e969249 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:40.055761 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 159/316] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:40.061345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec30aa2-7cdb-4928-9307-f2e090c6daa2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:40.171563 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec30aa2-7cdb-4928-9307-f2e090c6daa2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:40.193804 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:40.208654 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d69e7c-ede6-4b06-8996-ca2222736e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:40.209211 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d69e7c-ede6-4b06-8996-ca2222736e27 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:40.209511 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d69e7c-ede6-4b06-8996-ca2222736e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:40.209837 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d69e7c-ede6-4b06-8996-ca2222736e27 None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:40.211019 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d69e7c-ede6-4b06-8996-ca2222736e27 None admin] RBAC: Authorizing `identity:get_project(project_id=54b4a073d17c4838b5377059540ead2e)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:40.212475 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d69e7c-ede6-4b06-8996-ca2222736e27 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:40.214486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 158/317] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:40 2022] GET /identity/v3/projects/54b4a073d17c4838b5377059540ead2e => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:40.220284 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91d156-33a5-46a8-b706-c8d59e969249 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:40.231242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:40.322815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91d156-33a5-46a8-b706-c8d59e969249 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:40.357359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098af69b-949b-4dcf-8fd2-95785f5416fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:40.358017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098af69b-949b-4dcf-8fd2-95785f5416fa None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:40.358293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098af69b-949b-4dcf-8fd2-95785f5416fa None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:40.358565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098af69b-949b-4dcf-8fd2-95785f5416fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:40.359288 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098af69b-949b-4dcf-8fd2-95785f5416fa None admin] RBAC: Adding query filter params (role.id=55b7e38eaf134f788a30329b137436ec, scope.project.id=54b4a073d17c4838b5377059540ead2e, user.id=93f57b7aebbc42b0a21165dea56bf049) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:40.359602 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098af69b-949b-4dcf-8fd2-95785f5416fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:40.361021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098af69b-949b-4dcf-8fd2-95785f5416fa None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:40.367395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de83ff0-cee2-4129-b011-469ad6230005 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:40.367678 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de83ff0-cee2-4129-b011-469ad6230005 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:40.367778 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 160/318] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 18:59:40 2022] GET /identity/v3/role_assignments?user.id=93f57b7aebbc42b0a21165dea56bf049&scope.project.id=54b4a073d17c4838b5377059540ead2e&role.id=55b7e38eaf134f788a30329b137436ec => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:40.367951 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de83ff0-cee2-4129-b011-469ad6230005 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:40.369526 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 159/319] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 18:59:40.375296 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87beb9b-c733-4587-970d-cc7a98b5ee6d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:40.375620 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87beb9b-c733-4587-970d-cc7a98b5ee6d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:40.375851 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87beb9b-c733-4587-970d-cc7a98b5ee6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:40.396578 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b87beb9b-c733-4587-970d-cc7a98b5ee6d None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:40.397839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b87beb9b-c733-4587-970d-cc7a98b5ee6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:40.479076 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 161/320] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:40.501755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de83ff0-cee2-4129-b011-469ad6230005 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:40.539011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a036a-8668-469a-88c5-834b14dc450c None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:40.539316 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a036a-8668-469a-88c5-834b14dc450c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:40.539571 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a036a-8668-469a-88c5-834b14dc450c None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:40.541235 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 162/321] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 18:59:40.546380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3df4d-94db-4bcf-863e-d0405a3833e4 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:40.546666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3df4d-94db-4bcf-863e-d0405a3833e4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:40.546935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3df4d-94db-4bcf-863e-d0405a3833e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:40.553924 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:40.567353 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-57b3df4d-94db-4bcf-863e-d0405a3833e4 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:40.568709 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-57b3df4d-94db-4bcf-863e-d0405a3833e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:40.631153 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de83ff0-cee2-4129-b011-469ad6230005 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:40.662457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 163/322] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:40.676837 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e1a29-92cd-44ea-90ee-8740dfa8632c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:40.677810 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e1a29-92cd-44ea-90ee-8740dfa8632c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:40.678411 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e1a29-92cd-44ea-90ee-8740dfa8632c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:40.678870 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e1a29-92cd-44ea-90ee-8740dfa8632c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:40.680177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e1a29-92cd-44ea-90ee-8740dfa8632c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:40.681879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e1a29-92cd-44ea-90ee-8740dfa8632c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:40.683928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 160/323] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 18:59:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:40.685055 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3df4d-94db-4bcf-863e-d0405a3833e4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:40.689408 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e1a29-92cd-44ea-90ee-8740dfa8632c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:40.749683 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:40.792185 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3df4d-94db-4bcf-863e-d0405a3833e4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:40.795325 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e1a29-92cd-44ea-90ee-8740dfa8632c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:40.823785 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:40.829447 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2c909-1732-4b1f-b8eb-26dd9f87ac03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:40.830108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2c909-1732-4b1f-b8eb-26dd9f87ac03 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:40.830446 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2c909-1732-4b1f-b8eb-26dd9f87ac03 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:40.831321 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2c909-1732-4b1f-b8eb-26dd9f87ac03 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:40.832288 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae9dc5-4f08-4e0f-b3a0-525f2a00e052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:40.832893 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae9dc5-4f08-4e0f-b3a0-525f2a00e052 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:40.833166 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae9dc5-4f08-4e0f-b3a0-525f2a00e052 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:40.833435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae9dc5-4f08-4e0f-b3a0-525f2a00e052 None admin] PATH_INFO: `/v3/groups` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:40.834074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae9dc5-4f08-4e0f-b3a0-525f2a00e052 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:40.835495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae9dc5-4f08-4e0f-b3a0-525f2a00e052 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:40.841476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2c909-1732-4b1f-b8eb-26dd9f87ac03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:40.847164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9ab2c909-1732-4b1f-b8eb-26dd9f87ac03 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 18:59:40.847164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:40.847164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:40.847164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:40.847164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:40.847164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:40.847164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:40.847164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:40.847164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:40.847164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:40.847164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:40.847164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:40.847164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:40.847164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:40.847164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:40.847164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:40.860011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:40.860011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:40.860011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:40.860011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:40.860011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:40.860011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:40.860011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:40.860011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:40.860011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:40.860011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:40.860011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:40.860011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:40.860011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:40.860011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:40.860011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:40.860011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:40.860808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:40.860808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:40.860808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:40.860808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:40.860808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:40.860808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:40.860808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:40.860808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:40.860808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:40.860808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:40.860808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 18:59:40.860808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:40.860808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 164/324] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:40.860808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2c909-1732-4b1f-b8eb-26dd9f87ac03 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:40.923776 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 161/325] 10.222.0.65 () {60 vars in 1134 bytes} [Tue Aug 9 18:59:40 2022] POST /identity/v3/groups => generated 226 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 18:59:40.959545 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2c909-1732-4b1f-b8eb-26dd9f87ac03 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:40.998270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed019f2-7d31-476b-be33-a14da073b618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:40.998883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed019f2-7d31-476b-be33-a14da073b618 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:40.999162 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed019f2-7d31-476b-be33-a14da073b618 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:40.999433 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed019f2-7d31-476b-be33-a14da073b618 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:41.000165 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed019f2-7d31-476b-be33-a14da073b618 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:41.000416 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed019f2-7d31-476b-be33-a14da073b618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:41.001845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed019f2-7d31-476b-be33-a14da073b618 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:41.016605 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 165/326] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:41.017904 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae9dc5-4f08-4e0f-b3a0-525f2a00e052 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:41.043689 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f90174-4b0a-4ed9-9286-100d924ddda2 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:41.044012 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f90174-4b0a-4ed9-9286-100d924ddda2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:41.044229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f90174-4b0a-4ed9-9286-100d924ddda2 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:41.046500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 166/327] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 18:59:41.052393 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67216401-f51a-4c23-bc7b-5c10cfd91525 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:41.052670 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67216401-f51a-4c23-bc7b-5c10cfd91525 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:41.052935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67216401-f51a-4c23-bc7b-5c10cfd91525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:41.072212 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-67216401-f51a-4c23-bc7b-5c10cfd91525 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:41.073432 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-67216401-f51a-4c23-bc7b-5c10cfd91525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:41.131053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:41.139988 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae9dc5-4f08-4e0f-b3a0-525f2a00e052 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:41.150780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 167/328] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:41.160691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:41.175278 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67216401-f51a-4c23-bc7b-5c10cfd91525 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:41.182824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9d8f7-ba69-419a-b354-5e0abbf81c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:41.184038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9d8f7-ba69-419a-b354-5e0abbf81c8f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:41.184326 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9d8f7-ba69-419a-b354-5e0abbf81c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:41.184599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9d8f7-ba69-419a-b354-5e0abbf81c8f None admin] PATH_INFO: `/v3/users/8210b496808442829830975c27fe65d2` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:41.186277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9d8f7-ba69-419a-b354-5e0abbf81c8f None admin] RBAC: Authorizing `identity:get_user(user_id=8210b496808442829830975c27fe65d2)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:41.188170 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9d8f7-ba69-419a-b354-5e0abbf81c8f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:41.190989 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 162/329] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:41 2022] GET /identity/v3/users/8210b496808442829830975c27fe65d2 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:41.197652 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9d8f7-ba69-419a-b354-5e0abbf81c8f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:41.303646 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67216401-f51a-4c23-bc7b-5c10cfd91525 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:41.324289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9d8f7-ba69-419a-b354-5e0abbf81c8f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:41.342378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a4e8b-d0a8-4923-a714-c327465bc260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:41.343125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a4e8b-d0a8-4923-a714-c327465bc260 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:41.343403 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a4e8b-d0a8-4923-a714-c327465bc260 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:41.343677 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a4e8b-d0a8-4923-a714-c327465bc260 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:41.359597 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a4e8b-d0a8-4923-a714-c327465bc260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:41.366614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-3d5a4e8b-d0a8-4923-a714-c327465bc260 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:41.366614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:41.366614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:41.366614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:41.366614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:41.366614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:41.366614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:41.366614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:41.366614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:41.366614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:41.366614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:41.366614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:41.366614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:41.366614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:41.366614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:41.366614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:41.367516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:41.367516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:41.367516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:41.367516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:41.367516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:41.367516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:41.367516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:41.367516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:41.367516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:41.367516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:41.367516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:41.367516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:41.367516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:41.367516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:41.367516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:41.367516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:41.368310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:41.368310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:41.368310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:41.368310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:41.368310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:41.368310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:41.368310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:41.368310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:41.368310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:41.368310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:41.368310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:41.368310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:41.370702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 168/330] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:41.370813 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2005b6-f85f-480e-85cd-1f55c8dbe70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:41.371416 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2005b6-f85f-480e-85cd-1f55c8dbe70f None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:41.371726 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2005b6-f85f-480e-85cd-1f55c8dbe70f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:41.372004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2005b6-f85f-480e-85cd-1f55c8dbe70f None admin] PATH_INFO: `/v3/system/users/8210b496808442829830975c27fe65d2/roles/55b7e38eaf134f788a30329b137436ec` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:41.373430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2005b6-f85f-480e-85cd-1f55c8dbe70f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8210b496808442829830975c27fe65d2, role_id=55b7e38eaf134f788a30329b137436ec)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:41.379127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2005b6-f85f-480e-85cd-1f55c8dbe70f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:41.381309 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a4e8b-d0a8-4923-a714-c327465bc260 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:41.433482 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:41.488134 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 163/331] 10.222.0.65 () {58 vars in 1334 bytes} [Tue Aug 9 18:59:41 2022] PUT /identity/v3/system/users/8210b496808442829830975c27fe65d2/roles/55b7e38eaf134f788a30329b137436ec => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 18:59:41.495829 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a4e8b-d0a8-4923-a714-c327465bc260 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:41.546718 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b850c87-5bb7-40ef-aa8d-d4f44d76ffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:41.547875 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b850c87-5bb7-40ef-aa8d-d4f44d76ffd2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:41.548406 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b850c87-5bb7-40ef-aa8d-d4f44d76ffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:41.548912 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b850c87-5bb7-40ef-aa8d-d4f44d76ffd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:41.550418 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b850c87-5bb7-40ef-aa8d-d4f44d76ffd2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:41.550996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b850c87-5bb7-40ef-aa8d-d4f44d76ffd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:41.552635 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b850c87-5bb7-40ef-aa8d-d4f44d76ffd2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:41.563250 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 169/332] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:41.570163 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2005b6-f85f-480e-85cd-1f55c8dbe70f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:41.628505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:41.690711 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2005b6-f85f-480e-85cd-1f55c8dbe70f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:41.732031 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e02836-b215-4030-b210-38d6b18bf099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:41.732672 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e02836-b215-4030-b210-38d6b18bf099 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:41.732954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e02836-b215-4030-b210-38d6b18bf099 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:41.733230 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e02836-b215-4030-b210-38d6b18bf099 None admin] PATH_INFO: `/v3/users/9cc097df36cb4d229083319a2a11c489` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:41.734466 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e02836-b215-4030-b210-38d6b18bf099 None admin] RBAC: Authorizing `identity:get_user(user_id=9cc097df36cb4d229083319a2a11c489)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:41.735998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e02836-b215-4030-b210-38d6b18bf099 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:41.738705 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 164/333] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:41 2022] GET /identity/v3/users/9cc097df36cb4d229083319a2a11c489 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:41.744276 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b850c87-5bb7-40ef-aa8d-d4f44d76ffd2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:41.858344 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b850c87-5bb7-40ef-aa8d-d4f44d76ffd2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:41.867472 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:41.902181 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefbc99-c2b7-4173-8395-6482f80a76c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:41.902797 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefbc99-c2b7-4173-8395-6482f80a76c4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:41.903083 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefbc99-c2b7-4173-8395-6482f80a76c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:41.903359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefbc99-c2b7-4173-8395-6482f80a76c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:41.904095 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cefbc99-c2b7-4173-8395-6482f80a76c4 None admin] RBAC: Adding query filter params (role.id=ead9959857d24ec6bea3b7556da18ce5, user.id=9cc097df36cb4d229083319a2a11c489, scope.system=all) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:41.904406 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cefbc99-c2b7-4173-8395-6482f80a76c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:41.905945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cefbc99-c2b7-4173-8395-6482f80a76c4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:41.919143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 170/334] 10.222.0.65 () {56 vars in 1308 bytes} [Tue Aug 9 18:59:41 2022] GET /identity/v3/role_assignments?user.id=9cc097df36cb4d229083319a2a11c489&scope.system=all&role.id=ead9959857d24ec6bea3b7556da18ce5 => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:43.353427 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ce788-aeb6-4995-bda8-7d555e014ec1 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:43.354006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ce788-aeb6-4995-bda8-7d555e014ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:43.354006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ce788-aeb6-4995-bda8-7d555e014ec1 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:43.355722 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 165/335] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:43.361611 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de692420-5897-4dd4-a917-cb7b89502bcc None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:43.362107 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de692420-5897-4dd4-a917-cb7b89502bcc None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:43.362289 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de692420-5897-4dd4-a917-cb7b89502bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:43.387058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-de692420-5897-4dd4-a917-cb7b89502bcc None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:43.388265 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-de692420-5897-4dd4-a917-cb7b89502bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:43.484053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 171/336] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:43.530771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ce788-aeb6-4995-bda8-7d555e014ec1 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:43.680816 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ce788-aeb6-4995-bda8-7d555e014ec1 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:43.702249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:43.725286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945494d1-9863-4548-8e2b-fe5e366c692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:43.725952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945494d1-9863-4548-8e2b-fe5e366c692a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:43.726235 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945494d1-9863-4548-8e2b-fe5e366c692a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:43.726510 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945494d1-9863-4548-8e2b-fe5e366c692a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:43.746451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945494d1-9863-4548-8e2b-fe5e366c692a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:43.751234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-945494d1-9863-4548-8e2b-fe5e366c692a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:43.751234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:43.751234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:43.751234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:43.751234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:43.751234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:43.751234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:43.751234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:43.751234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:43.751234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:43.751234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:43.751234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:43.751234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:43.751234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:43.751234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:43.751234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:43.752113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:43.752113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:43.752113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:43.752113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:43.752113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:43.752113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:43.752113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:43.752113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:43.752113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:43.752113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:43.752113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:43.752113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:43.752113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:43.752113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:43.752113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:43.752113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:43.753594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:43.753594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:43.753594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:43.753594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:43.753594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:43.753594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:43.753594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:43.753594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:43.753594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:43.753594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:43.753594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:43.753594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:43.753594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 166/337] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:43.762943 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de692420-5897-4dd4-a917-cb7b89502bcc None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:43.875806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:43.887656 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de692420-5897-4dd4-a917-cb7b89502bcc None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:43.933090 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573fb3a-d28b-489f-b894-63985843fdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:43.933655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573fb3a-d28b-489f-b894-63985843fdaf None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:43.933933 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573fb3a-d28b-489f-b894-63985843fdaf None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:43.934209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573fb3a-d28b-489f-b894-63985843fdaf None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:43.934888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573fb3a-d28b-489f-b894-63985843fdaf None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:43.935193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573fb3a-d28b-489f-b894-63985843fdaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:43.936657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573fb3a-d28b-489f-b894-63985843fdaf None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:43.951211 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 172/338] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:43.957116 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945494d1-9863-4548-8e2b-fe5e366c692a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:44.103545 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945494d1-9863-4548-8e2b-fe5e366c692a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:44.150446 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912c64f-955f-4c24-b77f-cf8564201a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:44.151065 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912c64f-955f-4c24-b77f-cf8564201a5d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:44.151346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912c64f-955f-4c24-b77f-cf8564201a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:44.151617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912c64f-955f-4c24-b77f-cf8564201a5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:44.210634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:44.234087 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912c64f-955f-4c24-b77f-cf8564201a5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:44.235576 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912c64f-955f-4c24-b77f-cf8564201a5d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:44.269771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8aacc-2c3f-441a-93dc-3cc2d00d5c7d None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:44.270082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8aacc-2c3f-441a-93dc-3cc2d00d5c7d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:44.270326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8aacc-2c3f-441a-93dc-3cc2d00d5c7d None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:44.271940 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 173/339] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:44.273392 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9f7ed-da00-42fc-8772-4da04e69832b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:44.273719 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9f7ed-da00-42fc-8772-4da04e69832b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:44.273990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9f7ed-da00-42fc-8772-4da04e69832b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:44.275217 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 174/340] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:44.279425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be545d0b-3c1f-4a08-be76-85c7cbbdae41 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:44.280087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be545d0b-3c1f-4a08-be76-85c7cbbdae41 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:44.280375 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be545d0b-3c1f-4a08-be76-85c7cbbdae41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:44.307384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-be545d0b-3c1f-4a08-be76-85c7cbbdae41 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:44.309296 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-be545d0b-3c1f-4a08-be76-85c7cbbdae41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:44.393870 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 167/341] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:44.395142 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a96624-8689-4618-b0a0-408fad0e9942 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:44.395489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a96624-8689-4618-b0a0-408fad0e9942 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:44.395774 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a96624-8689-4618-b0a0-408fad0e9942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:44.404118 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 175/342] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:44.405002 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be545d0b-3c1f-4a08-be76-85c7cbbdae41 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:44.420950 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-36a96624-8689-4618-b0a0-408fad0e9942 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:44.422202 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-36a96624-8689-4618-b0a0-408fad0e9942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:44.497968 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 168/343] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:44.499042 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b64bc-b08c-4e8b-8e29-338a477e2400 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:44.499328 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b64bc-b08c-4e8b-8e29-338a477e2400 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:44.499786 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b64bc-b08c-4e8b-8e29-338a477e2400 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:44.500887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 169/344] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:44.501703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b64bc-b08c-4e8b-8e29-338a477e2400 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:44.515462 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:44.545813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:44.548619 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be545d0b-3c1f-4a08-be76-85c7cbbdae41 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:44.585691 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e7d75-7aa3-4b48-9c94-56c6386a2016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:44.586332 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e7d75-7aa3-4b48-9c94-56c6386a2016 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:44.586609 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e7d75-7aa3-4b48-9c94-56c6386a2016 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:44.586881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e7d75-7aa3-4b48-9c94-56c6386a2016 None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:44.588433 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e7d75-7aa3-4b48-9c94-56c6386a2016 None admin] RBAC: Authorizing `identity:get_project(project_id=e906580203f24a3787efe33c12436d59)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:44.589905 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e7d75-7aa3-4b48-9c94-56c6386a2016 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:44.591550 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 176/345] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:44 2022] GET /identity/v3/projects/e906580203f24a3787efe33c12436d59 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:44.592667 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cc2a8-59f2-4aa2-a30e-79afb85be5c2 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:44.592942 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cc2a8-59f2-4aa2-a30e-79afb85be5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:44.593209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cc2a8-59f2-4aa2-a30e-79afb85be5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:44.620515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-719cc2a8-59f2-4aa2-a30e-79afb85be5c2 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:44.622434 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-719cc2a8-59f2-4aa2-a30e-79afb85be5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:44.635280 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b64bc-b08c-4e8b-8e29-338a477e2400 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:44.682651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabf329-cbf1-4199-8918-4a5dcc201523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:44.683384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabf329-cbf1-4199-8918-4a5dcc201523 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:44.683794 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabf329-cbf1-4199-8918-4a5dcc201523 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:44.684133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cabf329-cbf1-4199-8918-4a5dcc201523 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:44.697851 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cabf329-cbf1-4199-8918-4a5dcc201523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:44.704390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-3cabf329-cbf1-4199-8918-4a5dcc201523 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 18:59:44.704390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:44.704390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:44.704390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:44.704390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:44.704390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:44.704390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:44.704390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:44.704390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:44.704390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:44.704390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:44.704390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:44.704390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:44.704390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:44.704390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:44.704390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:44.705262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:44.705262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:44.705262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:44.705262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:44.705262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:44.705262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:44.705262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:44.705262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:44.705262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:44.705262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:44.705262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:44.705262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:44.705262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:44.705262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:44.705262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:44.705262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:44.706493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:44.706493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:44.706493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:44.706493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:44.706493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:44.706493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:44.706493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:44.706493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:44.706493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:44.706493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:44.706493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 18:59:44.706493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:44.706493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 170/346] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:44.708693 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabf329-cbf1-4199-8918-4a5dcc201523 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:44.709824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 177/347] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:44.710673 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cc2a8-59f2-4aa2-a30e-79afb85be5c2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:44.798128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:44.820978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:44.836449 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cabf329-cbf1-4199-8918-4a5dcc201523 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:44.841399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cc2a8-59f2-4aa2-a30e-79afb85be5c2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:44.875806 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a067e-160c-4da2-974a-b47925cafb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:44.876452 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a067e-160c-4da2-974a-b47925cafb27 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:44.876782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a067e-160c-4da2-974a-b47925cafb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:44.877067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a067e-160c-4da2-974a-b47925cafb27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:44.890495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a067e-160c-4da2-974a-b47925cafb27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:44.894444 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11884eb-8445-4cd8-b8f9-bf43c6b28ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:44.895261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11884eb-8445-4cd8-b8f9-bf43c6b28ebd None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:44.895687 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11884eb-8445-4cd8-b8f9-bf43c6b28ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:44.896126 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11884eb-8445-4cd8-b8f9-bf43c6b28ebd None admin] PATH_INFO: `/v3/groups/8d3fd1478813447c8be580dca24141b9` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:44.896237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-594a067e-160c-4da2-974a-b47925cafb27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:44.896237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:44.896237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:44.896237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:44.896237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:44.896237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:44.896237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:44.896237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:44.896237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:44.896237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:44.896237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:44.896237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:44.896237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:44.896237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:44.896237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:44.896237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:44.897366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:44.897366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:44.897366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:44.897366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:44.897366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:44.897366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:44.897366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:44.897366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:44.897366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:44.897366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:44.897366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:44.897366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:44.897366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:44.897366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:44.897366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:44.897366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:44.898400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:44.898400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:44.898400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:44.898400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:44.898400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:44.898400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:44.898400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:44.898400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:44.898400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:44.898400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:44.898400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:44.898400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:44.898400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 171/348] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:44.898400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a067e-160c-4da2-974a-b47925cafb27 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:44.906879 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11884eb-8445-4cd8-b8f9-bf43c6b28ebd None admin] RBAC: Authorizing `identity:get_group(group_id=8d3fd1478813447c8be580dca24141b9)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:44.909922 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11884eb-8445-4cd8-b8f9-bf43c6b28ebd None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:44.912021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 178/349] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Aug 9 18:59:44 2022] GET /identity/v3/groups/8d3fd1478813447c8be580dca24141b9 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:44.912935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11884eb-8445-4cd8-b8f9-bf43c6b28ebd None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:45.023860 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a067e-160c-4da2-974a-b47925cafb27 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:45.043688 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11884eb-8445-4cd8-b8f9-bf43c6b28ebd None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:45.058043 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:45.070584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfab1d6-187a-41ba-9c38-aa52b6f6cf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:45.070981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfab1d6-187a-41ba-9c38-aa52b6f6cf5e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:45.071277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfab1d6-187a-41ba-9c38-aa52b6f6cf5e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:45.071555 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfab1d6-187a-41ba-9c38-aa52b6f6cf5e None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:45.072253 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfab1d6-187a-41ba-9c38-aa52b6f6cf5e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:45.072551 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfab1d6-187a-41ba-9c38-aa52b6f6cf5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:45.075564 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfab1d6-187a-41ba-9c38-aa52b6f6cf5e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:45.086515 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 172/350] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:45.087346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfab1d6-187a-41ba-9c38-aa52b6f6cf5e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:45.088726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686a78d-4c41-4aaf-8788-465a8a0d8b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:45.089603 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686a78d-4c41-4aaf-8788-465a8a0d8b9f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:45.090251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686a78d-4c41-4aaf-8788-465a8a0d8b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:45.090704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686a78d-4c41-4aaf-8788-465a8a0d8b9f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:45.105708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686a78d-4c41-4aaf-8788-465a8a0d8b9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:45.112516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-3686a78d-4c41-4aaf-8788-465a8a0d8b9f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:45.112516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:45.112516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:45.112516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:45.112516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:45.112516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:45.112516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:45.112516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:45.112516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:45.112516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:45.112516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:45.112516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:45.112516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:45.112516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:45.112516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:45.112516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:45.113409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:45.113409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:45.113409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:45.113409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:45.113409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:45.113409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:45.113409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:45.113409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:45.113409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:45.113409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:45.113409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:45.113409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:45.113409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:45.113409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:45.113409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:45.113409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:45.114251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:45.114251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:45.114251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:45.114251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:45.114251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:45.114251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:45.114251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:45.114251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:45.114251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:45.114251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:45.114251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:45.114251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:45.115453 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 179/351] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 18:59:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:45.117937 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686a78d-4c41-4aaf-8788-465a8a0d8b9f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:45.131310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:45.214126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfab1d6-187a-41ba-9c38-aa52b6f6cf5e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:45.246562 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686a78d-4c41-4aaf-8788-465a8a0d8b9f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:45.256501 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cd603-fda7-4625-9b59-3c63d6679743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:45.258435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cd603-fda7-4625-9b59-3c63d6679743 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:45.258998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cd603-fda7-4625-9b59-3c63d6679743 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:45.259413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cd603-fda7-4625-9b59-3c63d6679743 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:45.260222 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cd603-fda7-4625-9b59-3c63d6679743 None admin] RBAC: Adding query filter params (name=member) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:45.260746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cd603-fda7-4625-9b59-3c63d6679743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:45.262404 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cd603-fda7-4625-9b59-3c63d6679743 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:45.272562 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 173/352] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:45.278897 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cd603-fda7-4625-9b59-3c63d6679743 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:45.290098 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1eb1b2-41fd-4dcf-ab66-9ee097f18422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:45.290098 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1eb1b2-41fd-4dcf-ab66-9ee097f18422 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:45.290098 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1eb1b2-41fd-4dcf-ab66-9ee097f18422 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:45.290098 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1eb1b2-41fd-4dcf-ab66-9ee097f18422 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:45.290535 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1eb1b2-41fd-4dcf-ab66-9ee097f18422 None admin] RBAC: Adding query filter params (group.id=8d3fd1478813447c8be580dca24141b9, role.id=ead9959857d24ec6bea3b7556da18ce5, scope.project.id=e906580203f24a3787efe33c12436d59) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:45.290535 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1eb1b2-41fd-4dcf-ab66-9ee097f18422 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:45.292113 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1eb1b2-41fd-4dcf-ab66-9ee097f18422 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:45.300602 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 180/353] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Aug 9 18:59:45 2022] GET /identity/v3/role_assignments?group.id=8d3fd1478813447c8be580dca24141b9&scope.project.id=e906580203f24a3787efe33c12436d59&role.id=ead9959857d24ec6bea3b7556da18ce5 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:45.300602 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1eb1b2-41fd-4dcf-ab66-9ee097f18422 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:45.397857 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:45.398831 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:45.421014 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cd603-fda7-4625-9b59-3c63d6679743 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:45.438632 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1eb1b2-41fd-4dcf-ab66-9ee097f18422 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:45.467147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b9d57-7b7e-4393-97e5-c641ff5d1e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:45.468299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b9d57-7b7e-4393-97e5-c641ff5d1e1d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:45.468781 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b9d57-7b7e-4393-97e5-c641ff5d1e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:45.469250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b9d57-7b7e-4393-97e5-c641ff5d1e1d None admin] PATH_INFO: `/v3/users/8210b496808442829830975c27fe65d2` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:45.470847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b9d57-7b7e-4393-97e5-c641ff5d1e1d None admin] RBAC: Authorizing `identity:get_user(user_id=8210b496808442829830975c27fe65d2)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:45.473395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b9d57-7b7e-4393-97e5-c641ff5d1e1d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:45.476232 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 174/354] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 18:59:45 2022] GET /identity/v3/users/8210b496808442829830975c27fe65d2 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:45.477379 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b9d57-7b7e-4393-97e5-c641ff5d1e1d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:45.485400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e6143-3ec8-4db2-8919-d2c87b1e80e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:45.486090 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e6143-3ec8-4db2-8919-d2c87b1e80e1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:45.486364 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e6143-3ec8-4db2-8919-d2c87b1e80e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:45.486670 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e6143-3ec8-4db2-8919-d2c87b1e80e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:45.487359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e6143-3ec8-4db2-8919-d2c87b1e80e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:45.487828 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e6143-3ec8-4db2-8919-d2c87b1e80e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:45.489266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e6143-3ec8-4db2-8919-d2c87b1e80e1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:45.500711 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 181/355] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 18:59:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:45.504639 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaefb17-136e-402f-a704-588cea45d41e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:45.504639 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaefb17-136e-402f-a704-588cea45d41e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:45.504639 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaefb17-136e-402f-a704-588cea45d41e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:45.504639 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 182/356] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:45.505411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaefb17-136e-402f-a704-588cea45d41e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:45.617671 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b9d57-7b7e-4393-97e5-c641ff5d1e1d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:45.637757 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:45.646544 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaefb17-136e-402f-a704-588cea45d41e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:45.667666 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb2609-c9b9-481c-b5fb-66d95b30709f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:45.668614 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb2609-c9b9-481c-b5fb-66d95b30709f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:45.669113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb2609-c9b9-481c-b5fb-66d95b30709f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:45.669624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb2609-c9b9-481c-b5fb-66d95b30709f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:45.688210 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c07a92-88a1-4b9d-a165-8a4ebd4cb56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:45.688834 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c07a92-88a1-4b9d-a165-8a4ebd4cb56a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:45.689115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c07a92-88a1-4b9d-a165-8a4ebd4cb56a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:45.689388 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c07a92-88a1-4b9d-a165-8a4ebd4cb56a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:45.690679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c07a92-88a1-4b9d-a165-8a4ebd4cb56a None admin] RBAC: Adding query filter params (role.id=55b7e38eaf134f788a30329b137436ec, user.id=8210b496808442829830975c27fe65d2, scope.system=all) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:45.691160 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c07a92-88a1-4b9d-a165-8a4ebd4cb56a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:45.693088 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c07a92-88a1-4b9d-a165-8a4ebd4cb56a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:45.695144 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:45.715959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 183/357] 10.222.0.65 () {56 vars in 1308 bytes} [Tue Aug 9 18:59:45 2022] GET /identity/v3/role_assignments?user.id=8210b496808442829830975c27fe65d2&scope.system=all&role.id=55b7e38eaf134f788a30329b137436ec => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:45.717483 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c07a92-88a1-4b9d-a165-8a4ebd4cb56a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:45.765708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb2609-c9b9-481c-b5fb-66d95b30709f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:45.767562 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb2609-c9b9-481c-b5fb-66d95b30709f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:45.877989 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c07a92-88a1-4b9d-a165-8a4ebd4cb56a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:45.883495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 175/358] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:45.885084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582c02c-4e4b-4fff-8a19-fc349562eb27 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:45.885658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582c02c-4e4b-4fff-8a19-fc349562eb27 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:45.886134 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582c02c-4e4b-4fff-8a19-fc349562eb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:45.910547 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-5582c02c-4e4b-4fff-8a19-fc349562eb27 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:45.912112 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5582c02c-4e4b-4fff-8a19-fc349562eb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:45.920507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387574a-21e6-4a03-8650-ed43d0e3d2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:45.921066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387574a-21e6-4a03-8650-ed43d0e3d2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:45.921347 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387574a-21e6-4a03-8650-ed43d0e3d2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:45.921645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387574a-21e6-4a03-8650-ed43d0e3d2d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:45.932154 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:46.006726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:46.013487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 176/359] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:46.013487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b4a65-ebc1-4c5a-8511-1c6145532b4b None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:46.013703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b4a65-ebc1-4c5a-8511-1c6145532b4b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:46.013919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b4a65-ebc1-4c5a-8511-1c6145532b4b None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:46.015302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 177/360] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:46.015998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b4a65-ebc1-4c5a-8511-1c6145532b4b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:46.024692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387574a-21e6-4a03-8650-ed43d0e3d2d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:46.026208 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387574a-21e6-4a03-8650-ed43d0e3d2d6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:46.152091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b4a65-ebc1-4c5a-8511-1c6145532b4b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:46.171375 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 184/361] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:46.172651 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9abb8-47bf-4d35-82f9-f2e20cfd8c4f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:46.172964 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9abb8-47bf-4d35-82f9-f2e20cfd8c4f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:46.173238 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9abb8-47bf-4d35-82f9-f2e20cfd8c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:46.193271 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4bf9abb8-47bf-4d35-82f9-f2e20cfd8c4f None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:46.193750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95735ca3-4f66-4fcf-a24c-b040d03a3e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:46.194395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95735ca3-4f66-4fcf-a24c-b040d03a3e0d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:46.194499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4bf9abb8-47bf-4d35-82f9-f2e20cfd8c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:46.194673 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95735ca3-4f66-4fcf-a24c-b040d03a3e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:46.194950 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95735ca3-4f66-4fcf-a24c-b040d03a3e0d None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:46.196089 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95735ca3-4f66-4fcf-a24c-b040d03a3e0d None admin] RBAC: Authorizing `identity:get_project(project_id=54b4a073d17c4838b5377059540ead2e)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:46.197581 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95735ca3-4f66-4fcf-a24c-b040d03a3e0d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:46.199228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 178/362] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:46 2022] GET /identity/v3/projects/54b4a073d17c4838b5377059540ead2e => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:46.199988 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95735ca3-4f66-4fcf-a24c-b040d03a3e0d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:46.219390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:46.286241 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 185/363] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:46.287089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9abb8-47bf-4d35-82f9-f2e20cfd8c4f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:46.321831 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:46.341221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95735ca3-4f66-4fcf-a24c-b040d03a3e0d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:46.385124 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d87957-4beb-48aa-904b-f8f9bf43d5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:46.386222 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d87957-4beb-48aa-904b-f8f9bf43d5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:46.386222 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d87957-4beb-48aa-904b-f8f9bf43d5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:46.386649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d87957-4beb-48aa-904b-f8f9bf43d5d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:46.398807 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d87957-4beb-48aa-904b-f8f9bf43d5d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:46.404367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-34d87957-4beb-48aa-904b-f8f9bf43d5d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:46.404367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:46.404367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:46.404367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:46.404367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:46.404367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:46.404367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:46.404367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:46.404367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:46.404367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:46.404367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:46.404367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:46.404367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:46.404367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:46.404367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:46.404367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:46.405279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:46.405279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:46.405279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:46.405279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:46.405279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:46.405279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:46.405279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:46.405279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:46.405279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:46.405279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:46.405279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:46.405279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:46.405279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:46.405279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:46.405279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:46.405279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:46.406192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:46.406192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:46.406192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:46.406192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:46.406192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:46.406192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:46.406192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:46.406192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:46.406192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:46.406192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:46.406192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:46.406192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:46.406192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 179/364] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 18:59:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:46.406870 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d87957-4beb-48aa-904b-f8f9bf43d5d8 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:46.422652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9abb8-47bf-4d35-82f9-f2e20cfd8c4f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:46.468762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f380d-5967-45df-9bbd-c2f9ed1b0c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:46.469619 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f380d-5967-45df-9bbd-c2f9ed1b0c09 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:46.469884 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f380d-5967-45df-9bbd-c2f9ed1b0c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:46.470187 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f380d-5967-45df-9bbd-c2f9ed1b0c09 None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:46.472117 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f380d-5967-45df-9bbd-c2f9ed1b0c09 None admin] RBAC: Authorizing `identity:get_project(project_id=e906580203f24a3787efe33c12436d59)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:46.474165 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f380d-5967-45df-9bbd-c2f9ed1b0c09 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:46.476151 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 186/365] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:46 2022] GET /identity/v3/projects/e906580203f24a3787efe33c12436d59 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:46.478506 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f380d-5967-45df-9bbd-c2f9ed1b0c09 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:46.509531 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:46.533086 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d87957-4beb-48aa-904b-f8f9bf43d5d8 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:46.587646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608abdb-5ebc-4c70-82a9-1b5087f1fb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:46.588286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608abdb-5ebc-4c70-82a9-1b5087f1fb80 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:46.588564 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608abdb-5ebc-4c70-82a9-1b5087f1fb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:46.588831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608abdb-5ebc-4c70-82a9-1b5087f1fb80 None admin] PATH_INFO: `/v3/groups/8d3fd1478813447c8be580dca24141b9` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:46.590102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608abdb-5ebc-4c70-82a9-1b5087f1fb80 None admin] RBAC: Authorizing `identity:get_group(group_id=8d3fd1478813447c8be580dca24141b9)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:46.591532 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608abdb-5ebc-4c70-82a9-1b5087f1fb80 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:46.593679 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 180/366] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Aug 9 18:59:46 2022] GET /identity/v3/groups/8d3fd1478813447c8be580dca24141b9 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:46.594251 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608abdb-5ebc-4c70-82a9-1b5087f1fb80 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:46.604213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:46.618693 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f380d-5967-45df-9bbd-c2f9ed1b0c09 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:46.675280 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e30266-40cd-4fc4-b146-e5a973e04fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:46.675838 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e30266-40cd-4fc4-b146-e5a973e04fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:46.676114 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e30266-40cd-4fc4-b146-e5a973e04fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:46.676383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e30266-40cd-4fc4-b146-e5a973e04fd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:46.692116 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e30266-40cd-4fc4-b146-e5a973e04fd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:46.695105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-53e30266-40cd-4fc4-b146-e5a973e04fd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:46.695105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:46.695105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:46.695105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:46.695105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:46.695105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:46.695105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:46.695105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:46.695105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:46.695105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:46.695105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:46.695105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:46.695105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:46.695105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:46.695105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:46.695105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:46.695985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:46.695985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:46.695985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:46.695985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:46.695985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:46.695985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:46.695985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:46.695985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:46.695985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:46.695985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:46.695985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:46.695985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:46.695985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:46.695985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:46.695985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:46.695985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:46.696779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:46.696779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:46.696779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:46.696779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:46.696779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:46.696779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:46.696779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:46.696779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:46.696779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:46.696779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:46.696779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:46.696779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:46.701211 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 187/367] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 18:59:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:46.702429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e30266-40cd-4fc4-b146-e5a973e04fd1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:46.734151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608abdb-5ebc-4c70-82a9-1b5087f1fb80 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:46.775198 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773e43f-5dd3-49c3-a17d-03fa929da73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:46.775922 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773e43f-5dd3-49c3-a17d-03fa929da73a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:46.776209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773e43f-5dd3-49c3-a17d-03fa929da73a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:46.776482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773e43f-5dd3-49c3-a17d-03fa929da73a None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:46.777151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773e43f-5dd3-49c3-a17d-03fa929da73a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:46.777478 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773e43f-5dd3-49c3-a17d-03fa929da73a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:46.779330 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773e43f-5dd3-49c3-a17d-03fa929da73a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:46.788719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 181/368] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 18:59:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:46.790338 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773e43f-5dd3-49c3-a17d-03fa929da73a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:46.803118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:46.836905 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e30266-40cd-4fc4-b146-e5a973e04fd1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:46.875161 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74383c05-2b16-4d39-a181-1da71f134824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:46.875794 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74383c05-2b16-4d39-a181-1da71f134824 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:46.876072 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74383c05-2b16-4d39-a181-1da71f134824 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:46.876341 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74383c05-2b16-4d39-a181-1da71f134824 None admin] PATH_INFO: `/v3/groups/8d3fd1478813447c8be580dca24141b9` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:46.878179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74383c05-2b16-4d39-a181-1da71f134824 None admin] RBAC: Authorizing `identity:get_group(group_id=8d3fd1478813447c8be580dca24141b9)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:46.879697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74383c05-2b16-4d39-a181-1da71f134824 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:46.881495 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 188/369] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Aug 9 18:59:46 2022] GET /identity/v3/groups/8d3fd1478813447c8be580dca24141b9 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:46.886273 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74383c05-2b16-4d39-a181-1da71f134824 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:46.915128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:46.917014 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773e43f-5dd3-49c3-a17d-03fa929da73a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:46.959441 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c7b4d-b919-4ecb-9fe4-532a7a562a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:46.959975 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c7b4d-b919-4ecb-9fe4-532a7a562a34 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:46.960252 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c7b4d-b919-4ecb-9fe4-532a7a562a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:46.960522 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c7b4d-b919-4ecb-9fe4-532a7a562a34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:46.961241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c7b4d-b919-4ecb-9fe4-532a7a562a34 None admin] RBAC: Adding query filter params (group.id=8d3fd1478813447c8be580dca24141b9, role.id=ead9959857d24ec6bea3b7556da18ce5, scope.project.id=54b4a073d17c4838b5377059540ead2e) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:46.961592 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c7b4d-b919-4ecb-9fe4-532a7a562a34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:46.963147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c7b4d-b919-4ecb-9fe4-532a7a562a34 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:46.973564 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 182/370] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Aug 9 18:59:46 2022] GET /identity/v3/role_assignments?group.id=8d3fd1478813447c8be580dca24141b9&scope.project.id=54b4a073d17c4838b5377059540ead2e&role.id=ead9959857d24ec6bea3b7556da18ce5 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:46.975128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c7b4d-b919-4ecb-9fe4-532a7a562a34 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:47.029291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74383c05-2b16-4d39-a181-1da71f134824 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:47.068931 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:47.069869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e45fb-7a39-4076-9192-d1ac5b2743b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:47.070724 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e45fb-7a39-4076-9192-d1ac5b2743b8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:47.071217 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e45fb-7a39-4076-9192-d1ac5b2743b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:47.071743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e45fb-7a39-4076-9192-d1ac5b2743b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:47.072652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e45fb-7a39-4076-9192-d1ac5b2743b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:47.073183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e45fb-7a39-4076-9192-d1ac5b2743b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:47.074931 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e45fb-7a39-4076-9192-d1ac5b2743b8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:47.084815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 189/371] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:47.086215 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e45fb-7a39-4076-9192-d1ac5b2743b8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:47.106664 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c7b4d-b919-4ecb-9fe4-532a7a562a34 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:47.156841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74ca1c-868f-454e-aaff-ab12c86c2019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:47.157870 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74ca1c-868f-454e-aaff-ab12c86c2019 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:47.158933 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74ca1c-868f-454e-aaff-ab12c86c2019 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:47.159493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74ca1c-868f-454e-aaff-ab12c86c2019 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:47.195753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:47.219087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e45fb-7a39-4076-9192-d1ac5b2743b8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:47.241413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74ca1c-868f-454e-aaff-ab12c86c2019 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:47.243064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74ca1c-868f-454e-aaff-ab12c86c2019 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:47.257965 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfdcf3-52c2-4573-8e6f-e4ffb84c1cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:47.258681 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfdcf3-52c2-4573-8e6f-e4ffb84c1cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:47.258958 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfdcf3-52c2-4573-8e6f-e4ffb84c1cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:47.259228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfdcf3-52c2-4573-8e6f-e4ffb84c1cf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:47.260073 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfdcf3-52c2-4573-8e6f-e4ffb84c1cf1 None admin] RBAC: Adding query filter params (group.id=8d3fd1478813447c8be580dca24141b9, role.id=e4ff1977289a44cea73b844f8ad102a1, scope.project.id=e906580203f24a3787efe33c12436d59) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:47.260380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfdcf3-52c2-4573-8e6f-e4ffb84c1cf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:47.261847 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfdcf3-52c2-4573-8e6f-e4ffb84c1cf1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:47.268356 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 190/372] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Aug 9 18:59:47 2022] GET /identity/v3/role_assignments?group.id=8d3fd1478813447c8be580dca24141b9&scope.project.id=e906580203f24a3787efe33c12436d59&role.id=e4ff1977289a44cea73b844f8ad102a1 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:47.269484 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfdcf3-52c2-4573-8e6f-e4ffb84c1cf1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:47.351446 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:47.388126 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfdcf3-52c2-4573-8e6f-e4ffb84c1cf1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:47.411494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 183/373] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:47.417509 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74ca1c-868f-454e-aaff-ab12c86c2019 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:47.428525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a94d8-a6ca-495e-aec6-8a71e7604f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:47.429494 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a94d8-a6ca-495e-aec6-8a71e7604f5e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:47.429947 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a94d8-a6ca-495e-aec6-8a71e7604f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:47.430355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a94d8-a6ca-495e-aec6-8a71e7604f5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:47.447577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:47.513759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a94d8-a6ca-495e-aec6-8a71e7604f5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:47.513759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a94d8-a6ca-495e-aec6-8a71e7604f5e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:47.642322 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74ca1c-868f-454e-aaff-ab12c86c2019 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:47.680126 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 191/374] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:47.685727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a94d8-a6ca-495e-aec6-8a71e7604f5e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:47.709091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c67f26-3396-4534-a03c-98cc4505dd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:47.709857 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c67f26-3396-4534-a03c-98cc4505dd7c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:47.710203 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c67f26-3396-4534-a03c-98cc4505dd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:47.710639 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c67f26-3396-4534-a03c-98cc4505dd7c None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:47.711831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c67f26-3396-4534-a03c-98cc4505dd7c None admin] RBAC: Authorizing `identity:get_project(project_id=54b4a073d17c4838b5377059540ead2e)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:47.713329 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c67f26-3396-4534-a03c-98cc4505dd7c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:47.715481 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 184/375] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:47 2022] GET /identity/v3/projects/54b4a073d17c4838b5377059540ead2e => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:47.716540 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477850b-4640-4e08-8976-dfa31693c3cb None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:47.716891 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477850b-4640-4e08-8976-dfa31693c3cb None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:47.717226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477850b-4640-4e08-8976-dfa31693c3cb None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:47.718883 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 185/376] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:47.724368 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477850b-4640-4e08-8976-dfa31693c3cb None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:47.746989 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:47.780233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:47.827625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a94d8-a6ca-495e-aec6-8a71e7604f5e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:47.862000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477850b-4640-4e08-8976-dfa31693c3cb None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:47.875771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85332274-86b3-4ccf-8c3d-b1fce41c54ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:47.878121 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85332274-86b3-4ccf-8c3d-b1fce41c54ed None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:47.878121 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85332274-86b3-4ccf-8c3d-b1fce41c54ed None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:47.878300 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85332274-86b3-4ccf-8c3d-b1fce41c54ed None admin] PATH_INFO: `/v3/projects/fc0f9bf2f261408aa0230daf03acb9d1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:47.879840 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85332274-86b3-4ccf-8c3d-b1fce41c54ed None admin] RBAC: Authorizing `identity:get_project(project_id=fc0f9bf2f261408aa0230daf03acb9d1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:47.881680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85332274-86b3-4ccf-8c3d-b1fce41c54ed None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:47.885012 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 192/377] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:47 2022] GET /identity/v3/projects/fc0f9bf2f261408aa0230daf03acb9d1 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:47.886915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4cd1d-f283-4416-8992-0deb723af245 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:47.887309 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4cd1d-f283-4416-8992-0deb723af245 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:47.887720 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4cd1d-f283-4416-8992-0deb723af245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:47.909546 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befc5a6-64e3-4b35-bb40-f02c8c047740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:47.910645 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befc5a6-64e3-4b35-bb40-f02c8c047740 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:47.911098 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befc5a6-64e3-4b35-bb40-f02c8c047740 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:47.911535 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befc5a6-64e3-4b35-bb40-f02c8c047740 None admin] PATH_INFO: `/v3/groups/8d3fd1478813447c8be580dca24141b9` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:47.912229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d8b4cd1d-f283-4416-8992-0deb723af245 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:47.913003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befc5a6-64e3-4b35-bb40-f02c8c047740 None admin] RBAC: Authorizing `identity:get_group(group_id=8d3fd1478813447c8be580dca24141b9)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:47.913629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d8b4cd1d-f283-4416-8992-0deb723af245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:47.914831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befc5a6-64e3-4b35-bb40-f02c8c047740 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:47.917208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 186/378] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Aug 9 18:59:47 2022] GET /identity/v3/groups/8d3fd1478813447c8be580dca24141b9 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:47.918215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befc5a6-64e3-4b35-bb40-f02c8c047740 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:48.019414 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 193/379] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:48.019414 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4cd1d-f283-4416-8992-0deb723af245 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:48.075401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befc5a6-64e3-4b35-bb40-f02c8c047740 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:48.075977 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:48.084590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:48.116515 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b92529-a20d-4550-9230-1497db6ffab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:48.117259 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b92529-a20d-4550-9230-1497db6ffab5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:48.117708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b92529-a20d-4550-9230-1497db6ffab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:48.118063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b92529-a20d-4550-9230-1497db6ffab5 None admin] PATH_INFO: `/v3/groups/3de4c0e9fbe84fd382c41abb53301349` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:48.125373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b92529-a20d-4550-9230-1497db6ffab5 None admin] RBAC: Authorizing `identity:get_group(group_id=3de4c0e9fbe84fd382c41abb53301349)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:48.127131 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b92529-a20d-4550-9230-1497db6ffab5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:48.129838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 187/380] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Aug 9 18:59:47 2022] GET /identity/v3/groups/3de4c0e9fbe84fd382c41abb53301349 => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:48.130780 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b92529-a20d-4550-9230-1497db6ffab5 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:48.152454 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4cd1d-f283-4416-8992-0deb723af245 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:48.193896 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18161dc9-d13c-402e-8aff-ad8606339026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:48.194941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18161dc9-d13c-402e-8aff-ad8606339026 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:48.195401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18161dc9-d13c-402e-8aff-ad8606339026 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:48.195847 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18161dc9-d13c-402e-8aff-ad8606339026 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:48.196756 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18161dc9-d13c-402e-8aff-ad8606339026 None admin] RBAC: Adding query filter params (group.id=8d3fd1478813447c8be580dca24141b9, role.id=e4ff1977289a44cea73b844f8ad102a1, scope.project.id=54b4a073d17c4838b5377059540ead2e) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:48.197254 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18161dc9-d13c-402e-8aff-ad8606339026 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:48.199040 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18161dc9-d13c-402e-8aff-ad8606339026 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:48.206231 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 194/381] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Aug 9 18:59:48 2022] GET /identity/v3/role_assignments?group.id=8d3fd1478813447c8be580dca24141b9&scope.project.id=54b4a073d17c4838b5377059540ead2e&role.id=e4ff1977289a44cea73b844f8ad102a1 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:48.207591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18161dc9-d13c-402e-8aff-ad8606339026 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:48.256205 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b92529-a20d-4550-9230-1497db6ffab5 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:48.295582 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f4044-e88b-4ae5-9942-f6cce651d5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:48.296343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4044-e88b-4ae5-9942-f6cce651d5fb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:48.296694 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4044-e88b-4ae5-9942-f6cce651d5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:48.297036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4044-e88b-4ae5-9942-f6cce651d5fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:48.310347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f4044-e88b-4ae5-9942-f6cce651d5fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:48.319151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-206f4044-e88b-4ae5-9942-f6cce651d5fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:48.319151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:48.319151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:48.319151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:48.319151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:48.319151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:48.319151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:48.319151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:48.319151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:48.319151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:48.319151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:48.319151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:48.319151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:48.319151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:48.319151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:48.319151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:48.320145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:48.320145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:48.320145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:48.320145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:48.320145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:48.320145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:48.320145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:48.320145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:48.320145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:48.320145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:48.320145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:48.320145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:48.320145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:48.320145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:48.320145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:48.320145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:48.321254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:48.321254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:48.321254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:48.321254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:48.321254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:48.321254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:48.321254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:48.321254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:48.321254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:48.321254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:48.321254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:48.321254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:48.321254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 188/382] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:48.326762 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f4044-e88b-4ae5-9942-f6cce651d5fb None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:48.331099 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18161dc9-d13c-402e-8aff-ad8606339026 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:48.339785 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:48.366875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:48.372524 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ace40-e469-4a5f-9b40-43780be347f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:48.373272 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ace40-e469-4a5f-9b40-43780be347f1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:48.374419 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ace40-e469-4a5f-9b40-43780be347f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:48.374419 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ace40-e469-4a5f-9b40-43780be347f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:48.375783 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ace40-e469-4a5f-9b40-43780be347f1 None admin] RBAC: Adding query filter params (group.id=3de4c0e9fbe84fd382c41abb53301349, role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.project.id=fc0f9bf2f261408aa0230daf03acb9d1) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:48.376407 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ace40-e469-4a5f-9b40-43780be347f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:48.379023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ace40-e469-4a5f-9b40-43780be347f1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:48.386819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 195/383] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Aug 9 18:59:48 2022] GET /identity/v3/role_assignments?group.id=3de4c0e9fbe84fd382c41abb53301349&scope.project.id=fc0f9bf2f261408aa0230daf03acb9d1&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:48.462809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f4044-e88b-4ae5-9942-f6cce651d5fb None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:48.517854 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397664b-ad8a-433a-9ac2-87e042a113ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:48.518774 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397664b-ad8a-433a-9ac2-87e042a113ac None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:48.519201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397664b-ad8a-433a-9ac2-87e042a113ac None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:48.519623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397664b-ad8a-433a-9ac2-87e042a113ac None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:48.520485 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397664b-ad8a-433a-9ac2-87e042a113ac None admin] RBAC: Adding query filter params (name=member) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:48.520946 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397664b-ad8a-433a-9ac2-87e042a113ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:48.522540 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397664b-ad8a-433a-9ac2-87e042a113ac None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:48.532327 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 189/384] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:48.538836 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ace40-e469-4a5f-9b40-43780be347f1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:48.651195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ace40-e469-4a5f-9b40-43780be347f1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:48.686025 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608096fe-0178-49ca-a045-63ff3d4eadc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:48.686661 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608096fe-0178-49ca-a045-63ff3d4eadc7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:48.686938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608096fe-0178-49ca-a045-63ff3d4eadc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:48.687206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608096fe-0178-49ca-a045-63ff3d4eadc7 None admin] PATH_INFO: `/v3/groups/8d3fd1478813447c8be580dca24141b9` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:48.688309 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608096fe-0178-49ca-a045-63ff3d4eadc7 None admin] RBAC: Authorizing `identity:get_group(group_id=8d3fd1478813447c8be580dca24141b9)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:48.690336 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608096fe-0178-49ca-a045-63ff3d4eadc7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:48.691984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 196/385] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Aug 9 18:59:48 2022] GET /identity/v3/groups/8d3fd1478813447c8be580dca24141b9 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:48.698377 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397664b-ad8a-433a-9ac2-87e042a113ac None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:48.839699 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:48.852034 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397664b-ad8a-433a-9ac2-87e042a113ac None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:48.894655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f9ba4-9442-496c-9e92-286c606c3744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:48.895630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f9ba4-9442-496c-9e92-286c606c3744 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:48.896122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f9ba4-9442-496c-9e92-286c606c3744 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:48.896584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f9ba4-9442-496c-9e92-286c606c3744 None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:48.897973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f9ba4-9442-496c-9e92-286c606c3744 None admin] RBAC: Authorizing `identity:get_project(project_id=e906580203f24a3787efe33c12436d59)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:48.899624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f9ba4-9442-496c-9e92-286c606c3744 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:48.901591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 190/386] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:48 2022] GET /identity/v3/projects/e906580203f24a3787efe33c12436d59 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:48.907496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608096fe-0178-49ca-a045-63ff3d4eadc7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:48.956421 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:49.035414 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608096fe-0178-49ca-a045-63ff3d4eadc7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:49.073302 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d69f63-ddcd-4dd5-8ff2-cc4855a3567b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:49.074349 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d69f63-ddcd-4dd5-8ff2-cc4855a3567b None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:49.074818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d69f63-ddcd-4dd5-8ff2-cc4855a3567b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:49.081799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d69f63-ddcd-4dd5-8ff2-cc4855a3567b None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59/groups/8d3fd1478813447c8be580dca24141b9/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:49.084109 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d69f63-ddcd-4dd5-8ff2-cc4855a3567b None admin] RBAC: Authorizing `identity:create_grant(project_id=e906580203f24a3787efe33c12436d59, group_id=8d3fd1478813447c8be580dca24141b9, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:49.085767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d69f63-ddcd-4dd5-8ff2-cc4855a3567b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:49.158509 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 197/387] 10.222.0.65 () {58 vars in 1442 bytes} [Tue Aug 9 18:59:48 2022] PUT /identity/v3/projects/e906580203f24a3787efe33c12436d59/groups/8d3fd1478813447c8be580dca24141b9/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 18:59:49.557546 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135c23d-c036-4978-8f82-9984db7c3b51 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:49.558080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135c23d-c036-4978-8f82-9984db7c3b51 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:49.558080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135c23d-c036-4978-8f82-9984db7c3b51 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:49.559716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 191/388] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:49.565406 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939210e5-a542-405c-9fb5-5055362abb51 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:49.565894 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939210e5-a542-405c-9fb5-5055362abb51 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:49.565992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939210e5-a542-405c-9fb5-5055362abb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:49.585329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-939210e5-a542-405c-9fb5-5055362abb51 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:49.586583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-939210e5-a542-405c-9fb5-5055362abb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:49.673123 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 198/389] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:49.707713 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135c23d-c036-4978-8f82-9984db7c3b51 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:49.838979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135c23d-c036-4978-8f82-9984db7c3b51 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:49.880633 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b250d-2203-41bc-b6b4-6bc972c3a8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:49.881281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b250d-2203-41bc-b6b4-6bc972c3a8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:49.881593 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b250d-2203-41bc-b6b4-6bc972c3a8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:49.881866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b250d-2203-41bc-b6b4-6bc972c3a8c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:49.894779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b250d-2203-41bc-b6b4-6bc972c3a8c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:49.901371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-9a5b250d-2203-41bc-b6b4-6bc972c3a8c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:49.901371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:49.901371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:49.901371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:49.901371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:49.901371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:49.901371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:49.901371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:49.901371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:49.901371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:49.901371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:49.901371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:49.901371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:49.901371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:49.901371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:49.901371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:49.902284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:49.902284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:49.902284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:49.902284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:49.902284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:49.902284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:49.902284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:49.902284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:49.902284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:49.902284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:49.902284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:49.902284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:49.902284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:49.902284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:49.902284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:49.902284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:49.903081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:49.903081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:49.903081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:49.903081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:49.903081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:49.903081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:49.903081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:49.903081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:49.903081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:49.903081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:49.903081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:49.903081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:49.903081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 192/390] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:49.909496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939210e5-a542-405c-9fb5-5055362abb51 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:49.943907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:50.002580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fd268-d73d-4a26-a21b-b1dac0e31bc0 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:50.002888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fd268-d73d-4a26-a21b-b1dac0e31bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:50.003096 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fd268-d73d-4a26-a21b-b1dac0e31bc0 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:50.004428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 193/391] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:50.012747 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646163a4-856c-4f0a-addd-02baa1ecfffb None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:50.013047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646163a4-856c-4f0a-addd-02baa1ecfffb None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:50.013309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646163a4-856c-4f0a-addd-02baa1ecfffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:50.036437 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939210e5-a542-405c-9fb5-5055362abb51 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:50.052854 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-646163a4-856c-4f0a-addd-02baa1ecfffb None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:50.054076 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-646163a4-856c-4f0a-addd-02baa1ecfffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:50.085089 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:50.109072 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5659b7b-f245-4329-98ee-1fcb47ed53f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:50.109644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5659b7b-f245-4329-98ee-1fcb47ed53f0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:50.109928 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5659b7b-f245-4329-98ee-1fcb47ed53f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:50.110202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5659b7b-f245-4329-98ee-1fcb47ed53f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:50.110884 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5659b7b-f245-4329-98ee-1fcb47ed53f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:50.111241 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5659b7b-f245-4329-98ee-1fcb47ed53f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:50.113150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5659b7b-f245-4329-98ee-1fcb47ed53f0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:50.124999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 199/392] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:50.130642 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5659b7b-f245-4329-98ee-1fcb47ed53f0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:50.201643 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 194/393] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:50.227339 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:50.237499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5659b7b-f245-4329-98ee-1fcb47ed53f0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:50.240174 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646163a4-856c-4f0a-addd-02baa1ecfffb None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:50.273530 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c58154-617d-4507-b620-1e6e7a178740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:50.274185 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c58154-617d-4507-b620-1e6e7a178740 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:50.274852 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c58154-617d-4507-b620-1e6e7a178740 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:50.275446 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c58154-617d-4507-b620-1e6e7a178740 None admin] PATH_INFO: `/v3/groups/8d3fd1478813447c8be580dca24141b9` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:50.277056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c58154-617d-4507-b620-1e6e7a178740 None admin] RBAC: Authorizing `identity:get_group(group_id=8d3fd1478813447c8be580dca24141b9)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:50.278696 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c58154-617d-4507-b620-1e6e7a178740 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:50.280759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 200/394] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Aug 9 18:59:50 2022] GET /identity/v3/groups/8d3fd1478813447c8be580dca24141b9 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:50.286804 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c58154-617d-4507-b620-1e6e7a178740 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:50.390626 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c58154-617d-4507-b620-1e6e7a178740 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:50.427130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f4c7c-a3d0-4eaa-9786-5a789079fc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:50.427864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f4c7c-a3d0-4eaa-9786-5a789079fc51 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:50.428218 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f4c7c-a3d0-4eaa-9786-5a789079fc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:50.428564 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f4c7c-a3d0-4eaa-9786-5a789079fc51 None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:50.429808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f4c7c-a3d0-4eaa-9786-5a789079fc51 None admin] RBAC: Authorizing `identity:get_project(project_id=54b4a073d17c4838b5377059540ead2e)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:50.431329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f4c7c-a3d0-4eaa-9786-5a789079fc51 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:50.433341 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 201/395] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:50 2022] GET /identity/v3/projects/54b4a073d17c4838b5377059540ead2e => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:50.439149 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f4c7c-a3d0-4eaa-9786-5a789079fc51 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:50.451855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646163a4-856c-4f0a-addd-02baa1ecfffb None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:50.470146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:50.544803 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f4c7c-a3d0-4eaa-9786-5a789079fc51 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:50.553831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a695cfb-da83-44fb-b989-0d82c3d9d307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:50.554732 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a695cfb-da83-44fb-b989-0d82c3d9d307 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:50.555158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a695cfb-da83-44fb-b989-0d82c3d9d307 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:50.555690 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a695cfb-da83-44fb-b989-0d82c3d9d307 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:50.575243 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a695cfb-da83-44fb-b989-0d82c3d9d307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:50.581542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-3a695cfb-da83-44fb-b989-0d82c3d9d307 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:50.581542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:50.581542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:50.581542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:50.581542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:50.581542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:50.581542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:50.581542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:50.581542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:50.581542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:50.581542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:50.581542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:50.581542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:50.581542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:50.581542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:50.581542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:50.582631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:50.582631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:50.582631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:50.582631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:50.582631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:50.582631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:50.582631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:50.582631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:50.582631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:50.582631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:50.582631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:50.582631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:50.582631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:50.582631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:50.582631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:50.582631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:50.583647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:50.583647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:50.583647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:50.583647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:50.583647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:50.583647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:50.583647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:50.583647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:50.583647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:50.583647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:50.583647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:50.583647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:50.584406 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f1aa9-c0db-4365-a8be-dcfb1065fb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:50.584799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f1aa9-c0db-4365-a8be-dcfb1065fb30 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:50.587603 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f1aa9-c0db-4365-a8be-dcfb1065fb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:50.587603 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f1aa9-c0db-4365-a8be-dcfb1065fb30 None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e/groups/8d3fd1478813447c8be580dca24141b9/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:50.587940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 195/396] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 18:59:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 18:59:50.592199 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f1aa9-c0db-4365-a8be-dcfb1065fb30 None admin] RBAC: Authorizing `identity:create_grant(project_id=54b4a073d17c4838b5377059540ead2e, group_id=8d3fd1478813447c8be580dca24141b9, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:50.592199 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f1aa9-c0db-4365-a8be-dcfb1065fb30 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:50.593671 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a695cfb-da83-44fb-b989-0d82c3d9d307 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:50.608683 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:50.692323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 202/397] 10.222.0.65 () {58 vars in 1442 bytes} [Tue Aug 9 18:59:50 2022] PUT /identity/v3/projects/54b4a073d17c4838b5377059540ead2e/groups/8d3fd1478813447c8be580dca24141b9/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 18:59:50.701340 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a695cfb-da83-44fb-b989-0d82c3d9d307 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:50.760116 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5756df-1f3a-4b91-b85e-9c8022ce41ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:50.760750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5756df-1f3a-4b91-b85e-9c8022ce41ac None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:50.761034 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5756df-1f3a-4b91-b85e-9c8022ce41ac None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:50.761306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5756df-1f3a-4b91-b85e-9c8022ce41ac None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:50.762013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5756df-1f3a-4b91-b85e-9c8022ce41ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:50.762317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5756df-1f3a-4b91-b85e-9c8022ce41ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:50.763841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5756df-1f3a-4b91-b85e-9c8022ce41ac None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:50.777697 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 196/398] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 18:59:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:50.779252 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f1aa9-c0db-4365-a8be-dcfb1065fb30 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:50.906765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:50.922133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f1aa9-c0db-4365-a8be-dcfb1065fb30 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:50.962033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90b9a5-cd2f-46e4-93c8-fe554f0a12ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:50.963210 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90b9a5-cd2f-46e4-93c8-fe554f0a12ec None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:50.963647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90b9a5-cd2f-46e4-93c8-fe554f0a12ec None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:50.964071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90b9a5-cd2f-46e4-93c8-fe554f0a12ec None admin] PATH_INFO: `/v3/groups/8d3fd1478813447c8be580dca24141b9` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:50.965523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90b9a5-cd2f-46e4-93c8-fe554f0a12ec None admin] RBAC: Authorizing `identity:get_group(group_id=8d3fd1478813447c8be580dca24141b9)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:50.967330 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90b9a5-cd2f-46e4-93c8-fe554f0a12ec None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:50.969572 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 203/399] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Aug 9 18:59:50 2022] GET /identity/v3/groups/8d3fd1478813447c8be580dca24141b9 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:50.976638 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5756df-1f3a-4b91-b85e-9c8022ce41ac None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:50.980668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce860767-f2a8-482f-8cd4-926d307d72fb None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:50.981147 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce860767-f2a8-482f-8cd4-926d307d72fb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:50.981603 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce860767-f2a8-482f-8cd4-926d307d72fb None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:50.983137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 204/400] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 18:59:50.989801 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceec84-2334-4137-94a7-fbc546e42225 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:50.990149 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceec84-2334-4137-94a7-fbc546e42225 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:50.990429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceec84-2334-4137-94a7-fbc546e42225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:51.011425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a3ceec84-2334-4137-94a7-fbc546e42225 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:51.012730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a3ceec84-2334-4137-94a7-fbc546e42225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:51.080962 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:51.117066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 205/401] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:51.140622 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5756df-1f3a-4b91-b85e-9c8022ce41ac None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:51.167460 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceec84-2334-4137-94a7-fbc546e42225 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:51.202268 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d824b34-2463-4730-9496-fba6ec727bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:51.202914 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d824b34-2463-4730-9496-fba6ec727bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:51.203202 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d824b34-2463-4730-9496-fba6ec727bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:51.203475 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d824b34-2463-4730-9496-fba6ec727bc4 None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:51.204724 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d824b34-2463-4730-9496-fba6ec727bc4 None admin] RBAC: Authorizing `identity:get_project(project_id=e906580203f24a3787efe33c12436d59)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:51.206919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d824b34-2463-4730-9496-fba6ec727bc4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:51.208576 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 197/402] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:50 2022] GET /identity/v3/projects/e906580203f24a3787efe33c12436d59 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:51.222531 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d824b34-2463-4730-9496-fba6ec727bc4 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:51.281549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:51.300823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceec84-2334-4137-94a7-fbc546e42225 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:51.342278 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65858459-8a88-44d7-8abb-e70f61427835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:51.343273 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65858459-8a88-44d7-8abb-e70f61427835 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:51.343552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65858459-8a88-44d7-8abb-e70f61427835 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:51.343821 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65858459-8a88-44d7-8abb-e70f61427835 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:51.356941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65858459-8a88-44d7-8abb-e70f61427835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:51.363935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-65858459-8a88-44d7-8abb-e70f61427835 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:51.363935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:51.363935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:51.363935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:51.363935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:51.363935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:51.363935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:51.363935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:51.363935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:51.363935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:51.363935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:51.363935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:51.363935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:51.363935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:51.363935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:51.363935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:51.364859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:51.364859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:51.364859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:51.364859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:51.364859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:51.364859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:51.364859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:51.364859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:51.364859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:51.364859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:51.364859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:51.364859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:51.364859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:51.364859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:51.364859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:51.364859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:51.365784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:51.365784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:51.365784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:51.365784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:51.365784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:51.365784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:51.365784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:51.365784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:51.365784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:51.365784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:51.365784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:51.365784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:51.366447 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 206/403] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 18:59:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 18:59:51.367138 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d824b34-2463-4730-9496-fba6ec727bc4 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:51.367245 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cec94-96d2-44fa-b5b7-749a8dde8fa9 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:51.371741 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cec94-96d2-44fa-b5b7-749a8dde8fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:51.371741 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0cec94-96d2-44fa-b5b7-749a8dde8fa9 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:51.373552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 207/404] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:51.374983 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d12e1b-253b-4297-bb51-115c92dbde62 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:51.375264 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d12e1b-253b-4297-bb51-115c92dbde62 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:51.375541 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d12e1b-253b-4297-bb51-115c92dbde62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:51.394657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a4d12e1b-253b-4297-bb51-115c92dbde62 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:51.395844 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a4d12e1b-253b-4297-bb51-115c92dbde62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:51.411547 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c3275-9614-4c9c-a5fa-470c0b841fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:51.412278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c3275-9614-4c9c-a5fa-470c0b841fa7 None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:51.412560 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c3275-9614-4c9c-a5fa-470c0b841fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:51.412831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c3275-9614-4c9c-a5fa-470c0b841fa7 None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59/groups/8d3fd1478813447c8be580dca24141b9/roles/e4ff1977289a44cea73b844f8ad102a1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:51.415066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c3275-9614-4c9c-a5fa-470c0b841fa7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e906580203f24a3787efe33c12436d59, group_id=8d3fd1478813447c8be580dca24141b9, role_id=e4ff1977289a44cea73b844f8ad102a1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:51.416510 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c3275-9614-4c9c-a5fa-470c0b841fa7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:51.473613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 208/405] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:51.474484 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d12e1b-253b-4297-bb51-115c92dbde62 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:51.516865 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:51.521398 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 198/406] 10.222.0.65 () {58 vars in 1442 bytes} [Tue Aug 9 18:59:51 2022] PUT /identity/v3/projects/e906580203f24a3787efe33c12436d59/groups/8d3fd1478813447c8be580dca24141b9/roles/e4ff1977289a44cea73b844f8ad102a1 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 18:59:51.522563 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c3275-9614-4c9c-a5fa-470c0b841fa7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:51.570495 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:51.598863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d12e1b-253b-4297-bb51-115c92dbde62 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:51.633349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c3275-9614-4c9c-a5fa-470c0b841fa7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:51.638690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b0254-1a11-4620-8c73-9ee4f79ecd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:51.639314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b0254-1a11-4620-8c73-9ee4f79ecd2e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:51.639650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b0254-1a11-4620-8c73-9ee4f79ecd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:51.639928 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b0254-1a11-4620-8c73-9ee4f79ecd2e None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:51.640611 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b0254-1a11-4620-8c73-9ee4f79ecd2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:51.640915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b0254-1a11-4620-8c73-9ee4f79ecd2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:51.642386 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b0254-1a11-4620-8c73-9ee4f79ecd2e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:51.660039 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 209/407] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:51.666120 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b0254-1a11-4620-8c73-9ee4f79ecd2e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:51.672250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312ac9f-de5b-4c70-992d-8f6e53ee2115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:51.672902 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312ac9f-de5b-4c70-992d-8f6e53ee2115 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:51.673229 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312ac9f-de5b-4c70-992d-8f6e53ee2115 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:51.673541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312ac9f-de5b-4c70-992d-8f6e53ee2115 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:51.685192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312ac9f-de5b-4c70-992d-8f6e53ee2115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:51.691156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-f312ac9f-de5b-4c70-992d-8f6e53ee2115 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:51.691156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:51.691156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:51.691156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:51.691156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:51.691156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:51.691156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:51.691156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:51.691156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:51.691156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:51.691156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:51.691156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:51.691156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:51.691156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:51.691156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:51.691156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:51.692056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:51.692056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:51.692056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:51.692056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:51.692056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:51.692056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:51.692056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:51.692056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:51.692056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:51.692056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:51.692056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:51.692056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:51.692056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:51.692056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:51.692056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:51.692056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:51.692862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:51.692862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:51.692862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:51.692862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:51.692862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:51.692862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:51.692862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:51.692862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:51.692862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:51.692862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:51.692862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:51.692862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:51.692862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 199/408] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 18:59:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:51.698613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312ac9f-de5b-4c70-992d-8f6e53ee2115 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:51.789957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:51.823634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312ac9f-de5b-4c70-992d-8f6e53ee2115 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:51.852787 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b0254-1a11-4620-8c73-9ee4f79ecd2e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:51.869290 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bfa35f-c9ae-49bc-a34a-d293c2094eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:51.869950 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfa35f-c9ae-49bc-a34a-d293c2094eae None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:51.870229 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfa35f-c9ae-49bc-a34a-d293c2094eae None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:51.870495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfa35f-c9ae-49bc-a34a-d293c2094eae None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:51.871165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bfa35f-c9ae-49bc-a34a-d293c2094eae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:51.871470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bfa35f-c9ae-49bc-a34a-d293c2094eae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:51.872870 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bfa35f-c9ae-49bc-a34a-d293c2094eae None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:51.883730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 200/409] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 18:59:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:51.889392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bfa35f-c9ae-49bc-a34a-d293c2094eae None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:51.893021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaba0bb-504c-4a90-9c64-0967a2b4173c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:51.893727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaba0bb-504c-4a90-9c64-0967a2b4173c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:51.893998 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaba0bb-504c-4a90-9c64-0967a2b4173c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:51.894275 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaba0bb-504c-4a90-9c64-0967a2b4173c None admin] PATH_INFO: `/v3/groups/3de4c0e9fbe84fd382c41abb53301349` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:51.895898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaba0bb-504c-4a90-9c64-0967a2b4173c None admin] RBAC: Authorizing `identity:get_group(group_id=3de4c0e9fbe84fd382c41abb53301349)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:51.897420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaba0bb-504c-4a90-9c64-0967a2b4173c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:51.899422 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 210/410] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Aug 9 18:59:51 2022] GET /identity/v3/groups/3de4c0e9fbe84fd382c41abb53301349 => generated 229 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:51.906341 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaba0bb-504c-4a90-9c64-0967a2b4173c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:51.911803 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:52.011049 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bfa35f-c9ae-49bc-a34a-d293c2094eae None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:52.047106 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:52.051424 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498082df-8100-4f6a-b1cc-65eb39f47c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:52.052735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498082df-8100-4f6a-b1cc-65eb39f47c09 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:52.053177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498082df-8100-4f6a-b1cc-65eb39f47c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:52.053964 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498082df-8100-4f6a-b1cc-65eb39f47c09 None admin] PATH_INFO: `/v3/groups/8d3fd1478813447c8be580dca24141b9` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:52.055878 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498082df-8100-4f6a-b1cc-65eb39f47c09 None admin] RBAC: Authorizing `identity:get_group(group_id=8d3fd1478813447c8be580dca24141b9)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:52.058286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498082df-8100-4f6a-b1cc-65eb39f47c09 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:52.060312 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 201/411] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Aug 9 18:59:51 2022] GET /identity/v3/groups/8d3fd1478813447c8be580dca24141b9 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:52.061611 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39a1dc-2763-4610-a2b9-8e1681ad3867 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:52.075450 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39a1dc-2763-4610-a2b9-8e1681ad3867 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:52.075450 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39a1dc-2763-4610-a2b9-8e1681ad3867 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:52.075450 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 202/412] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:52.075450 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39a1dc-2763-4610-a2b9-8e1681ad3867 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:52.094426 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaba0bb-504c-4a90-9c64-0967a2b4173c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:52.136468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22593722-73b7-436e-a6be-3b7c2596129a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:52.137471 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22593722-73b7-436e-a6be-3b7c2596129a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:52.137958 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22593722-73b7-436e-a6be-3b7c2596129a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:52.138423 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22593722-73b7-436e-a6be-3b7c2596129a None admin] PATH_INFO: `/v3/projects/fc0f9bf2f261408aa0230daf03acb9d1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:52.139877 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22593722-73b7-436e-a6be-3b7c2596129a None admin] RBAC: Authorizing `identity:get_project(project_id=fc0f9bf2f261408aa0230daf03acb9d1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:52.141644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22593722-73b7-436e-a6be-3b7c2596129a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:52.148002 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 211/413] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:51 2022] GET /identity/v3/projects/fc0f9bf2f261408aa0230daf03acb9d1 => generated 344 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:52.148002 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7028f9c-a489-493f-bb34-a77b0eb48e0b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:52.148002 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7028f9c-a489-493f-bb34-a77b0eb48e0b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:52.148002 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7028f9c-a489-493f-bb34-a77b0eb48e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:52.164181 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b7028f9c-a489-493f-bb34-a77b0eb48e0b None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:52.165525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b7028f9c-a489-493f-bb34-a77b0eb48e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:52.213502 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39a1dc-2763-4610-a2b9-8e1681ad3867 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:52.245475 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 212/414] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:52.245475 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7028f9c-a489-493f-bb34-a77b0eb48e0b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:52.246273 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:52.273481 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d09341-7318-499b-9c90-91409f39c9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:52.274807 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d09341-7318-499b-9c90-91409f39c9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:52.275504 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d09341-7318-499b-9c90-91409f39c9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:52.275919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d09341-7318-499b-9c90-91409f39c9c7 None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:52.277741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d09341-7318-499b-9c90-91409f39c9c7 None admin] RBAC: Authorizing `identity:get_project(project_id=54b4a073d17c4838b5377059540ead2e)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:52.279913 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d09341-7318-499b-9c90-91409f39c9c7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:52.282751 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 203/415] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:52 2022] GET /identity/v3/projects/54b4a073d17c4838b5377059540ead2e => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:52.284877 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d09341-7318-499b-9c90-91409f39c9c7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:52.360210 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:52.384576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7028f9c-a489-493f-bb34-a77b0eb48e0b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:52.405544 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d09341-7318-499b-9c90-91409f39c9c7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:52.426894 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bce024-702b-42ec-998a-21c285ce693f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:52.427909 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bce024-702b-42ec-998a-21c285ce693f None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:52.428380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bce024-702b-42ec-998a-21c285ce693f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:52.428852 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bce024-702b-42ec-998a-21c285ce693f None admin] PATH_INFO: `/v3/projects/fc0f9bf2f261408aa0230daf03acb9d1/groups/3de4c0e9fbe84fd382c41abb53301349/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:52.430966 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bce024-702b-42ec-998a-21c285ce693f None admin] RBAC: Authorizing `identity:create_grant(project_id=fc0f9bf2f261408aa0230daf03acb9d1, group_id=3de4c0e9fbe84fd382c41abb53301349, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:52.432623 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bce024-702b-42ec-998a-21c285ce693f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:52.448365 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0bf00-cde4-4fa9-acca-de8b193353ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:52.449006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0bf00-cde4-4fa9-acca-de8b193353ab None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:52.449287 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0bf00-cde4-4fa9-acca-de8b193353ab None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:52.449593 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0bf00-cde4-4fa9-acca-de8b193353ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:52.460207 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0bf00-cde4-4fa9-acca-de8b193353ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:52.465487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-0cf0bf00-cde4-4fa9-acca-de8b193353ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:52.465487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:52.465487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:52.465487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:52.465487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:52.465487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:52.465487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:52.465487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:52.465487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:52.465487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:52.465487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:52.465487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:52.465487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:52.465487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:52.465487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:52.465487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:52.466413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:52.466413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:52.466413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:52.466413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:52.466413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:52.466413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:52.466413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:52.466413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:52.466413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:52.466413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:52.466413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:52.466413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:52.466413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:52.466413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:52.466413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:52.466413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:52.467208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:52.467208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:52.467208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:52.467208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:52.467208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:52.467208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:52.467208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:52.467208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:52.467208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:52.467208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:52.467208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:52.467208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:52.467208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 204/416] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:52.468276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0bf00-cde4-4fa9-acca-de8b193353ab None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:52.504874 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 213/417] 10.222.0.65 () {58 vars in 1442 bytes} [Tue Aug 9 18:59:52 2022] PUT /identity/v3/projects/fc0f9bf2f261408aa0230daf03acb9d1/groups/3de4c0e9fbe84fd382c41abb53301349/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 18:59:52.506287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bce024-702b-42ec-998a-21c285ce693f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:52.652751 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:52.663655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0bf00-cde4-4fa9-acca-de8b193353ab None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:52.696631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:52.719266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b27a0-76a9-40ad-9de7-e3e8788c54e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:52.720236 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b27a0-76a9-40ad-9de7-e3e8788c54e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:52.720788 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b27a0-76a9-40ad-9de7-e3e8788c54e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:52.721229 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b27a0-76a9-40ad-9de7-e3e8788c54e7 None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e/groups/8d3fd1478813447c8be580dca24141b9/roles/e4ff1977289a44cea73b844f8ad102a1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:52.723626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b27a0-76a9-40ad-9de7-e3e8788c54e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=54b4a073d17c4838b5377059540ead2e, group_id=8d3fd1478813447c8be580dca24141b9, role_id=e4ff1977289a44cea73b844f8ad102a1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:52.725907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b27a0-76a9-40ad-9de7-e3e8788c54e7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:52.728726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bce024-702b-42ec-998a-21c285ce693f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:52.774529 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7d927-6d37-4ddf-9f2a-e2cb0b2fa240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:52.775151 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7d927-6d37-4ddf-9f2a-e2cb0b2fa240 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:52.775433 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7d927-6d37-4ddf-9f2a-e2cb0b2fa240 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:52.775759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7d927-6d37-4ddf-9f2a-e2cb0b2fa240 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:52.776444 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7d927-6d37-4ddf-9f2a-e2cb0b2fa240 None admin] RBAC: Adding query filter params (name=member) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:52.776752 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7d927-6d37-4ddf-9f2a-e2cb0b2fa240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:52.778220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7d927-6d37-4ddf-9f2a-e2cb0b2fa240 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:52.787776 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 214/418] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:52.790866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 205/419] 10.222.0.65 () {58 vars in 1442 bytes} [Tue Aug 9 18:59:52 2022] PUT /identity/v3/projects/54b4a073d17c4838b5377059540ead2e/groups/8d3fd1478813447c8be580dca24141b9/roles/e4ff1977289a44cea73b844f8ad102a1 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 18:59:52.796852 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7d927-6d37-4ddf-9f2a-e2cb0b2fa240 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:52.916939 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7d927-6d37-4ddf-9f2a-e2cb0b2fa240 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:52.944715 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:52.957244 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca668fc-bfdf-46fa-ae1e-f75214f4464f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:52.960595 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca668fc-bfdf-46fa-ae1e-f75214f4464f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:52.960595 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca668fc-bfdf-46fa-ae1e-f75214f4464f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:52.960595 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca668fc-bfdf-46fa-ae1e-f75214f4464f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:53.044841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca668fc-bfdf-46fa-ae1e-f75214f4464f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:53.046638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca668fc-bfdf-46fa-ae1e-f75214f4464f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:53.125068 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1e7a-e05c-4cfa-8299-d0ee22de6d80 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:53.125753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1e7a-e05c-4cfa-8299-d0ee22de6d80 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:53.126249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1e7a-e05c-4cfa-8299-d0ee22de6d80 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:53.128304 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 206/420] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 18:59:53.134544 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08a79f-860e-4913-ab7a-e3b8a10882cc None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:53.135092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08a79f-860e-4913-ab7a-e3b8a10882cc None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:53.135563 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08a79f-860e-4913-ab7a-e3b8a10882cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:53.156688 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1d08a79f-860e-4913-ab7a-e3b8a10882cc None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:53.158800 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1d08a79f-860e-4913-ab7a-e3b8a10882cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:53.177014 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 215/421] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:53.184316 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca668fc-bfdf-46fa-ae1e-f75214f4464f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:53.214799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:53.243404 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 207/422] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:53.288974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08a79f-860e-4913-ab7a-e3b8a10882cc None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:53.324588 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca668fc-bfdf-46fa-ae1e-f75214f4464f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:53.360858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fe945-94c2-44dc-a909-53a0130e7a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:53.362044 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fe945-94c2-44dc-a909-53a0130e7a2c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:53.362323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fe945-94c2-44dc-a909-53a0130e7a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:53.362597 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fe945-94c2-44dc-a909-53a0130e7a2c None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:53.363777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fe945-94c2-44dc-a909-53a0130e7a2c None admin] RBAC: Authorizing `identity:get_project(project_id=e906580203f24a3787efe33c12436d59)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:53.365237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fe945-94c2-44dc-a909-53a0130e7a2c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:53.369733 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 216/423] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:53 2022] GET /identity/v3/projects/e906580203f24a3787efe33c12436d59 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:53.375193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fe945-94c2-44dc-a909-53a0130e7a2c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:53.483869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08a79f-860e-4913-ab7a-e3b8a10882cc None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:53.493999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:53.502656 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:53.515602 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fe945-94c2-44dc-a909-53a0130e7a2c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:53.553674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fa6ad-863f-4475-b4e1-14fddafd0766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:53.557773 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fa6ad-863f-4475-b4e1-14fddafd0766 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:53.558261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fa6ad-863f-4475-b4e1-14fddafd0766 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:53.558729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fa6ad-863f-4475-b4e1-14fddafd0766 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:53.578843 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015fa6ad-863f-4475-b4e1-14fddafd0766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:53.584944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-015fa6ad-863f-4475-b4e1-14fddafd0766 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:53.584944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:53.584944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:53.584944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:53.584944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:53.584944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:53.584944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:53.584944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:53.584944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:53.584944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:53.584944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:53.584944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:53.584944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:53.584944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:53.584944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:53.584944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:53.585954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:53.585954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:53.585954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:53.585954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:53.585954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:53.585954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:53.585954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:53.585954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:53.585954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:53.585954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:53.585954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:53.585954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:53.585954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:53.585954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:53.585954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:53.585954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:53.586749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:53.586749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:53.586749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:53.586749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:53.586749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:53.586749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:53.586749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:53.586749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:53.586749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:53.586749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:53.586749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 18:59:53.586749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:53.589031 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 208/424] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 18:59:53.594992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fa6ad-863f-4475-b4e1-14fddafd0766 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:53.602183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac6a83-a78b-4bfa-8606-913dd9d7a269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:53.602932 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac6a83-a78b-4bfa-8606-913dd9d7a269 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:53.603218 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac6a83-a78b-4bfa-8606-913dd9d7a269 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:53.603490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac6a83-a78b-4bfa-8606-913dd9d7a269 None admin] PATH_INFO: `/v3/groups/8d3fd1478813447c8be580dca24141b9` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:53.604665 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac6a83-a78b-4bfa-8606-913dd9d7a269 None admin] RBAC: Authorizing `identity:get_group(group_id=8d3fd1478813447c8be580dca24141b9)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:53.606227 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac6a83-a78b-4bfa-8606-913dd9d7a269 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:53.608213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 217/425] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Aug 9 18:59:53 2022] GET /identity/v3/groups/8d3fd1478813447c8be580dca24141b9 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:53.617215 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac6a83-a78b-4bfa-8606-913dd9d7a269 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:53.731901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fa6ad-863f-4475-b4e1-14fddafd0766 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:53.772360 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dec91-7115-4b93-a72b-610c95053265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:53.773225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dec91-7115-4b93-a72b-610c95053265 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:53.773708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dec91-7115-4b93-a72b-610c95053265 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:53.774131 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dec91-7115-4b93-a72b-610c95053265 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:53.775698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093dec91-7115-4b93-a72b-610c95053265 None admin] RBAC: Adding query filter params (name=member) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:53.776165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093dec91-7115-4b93-a72b-610c95053265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:53.778014 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093dec91-7115-4b93-a72b-610c95053265 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:53.788313 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 209/426] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 18:59:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:53.794167 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dec91-7115-4b93-a72b-610c95053265 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:53.831576 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:53.869518 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac6a83-a78b-4bfa-8606-913dd9d7a269 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:53.918389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899533b-7846-4b0e-a8f8-10fde73d5644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:53.919007 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899533b-7846-4b0e-a8f8-10fde73d5644 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:53.919292 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899533b-7846-4b0e-a8f8-10fde73d5644 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:53.919568 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899533b-7846-4b0e-a8f8-10fde73d5644 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:53.920303 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899533b-7846-4b0e-a8f8-10fde73d5644 None admin] RBAC: Adding query filter params (group.id=8d3fd1478813447c8be580dca24141b9, role.id=ead9959857d24ec6bea3b7556da18ce5, scope.project.id=e906580203f24a3787efe33c12436d59) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:53.920615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899533b-7846-4b0e-a8f8-10fde73d5644 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:53.922109 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899533b-7846-4b0e-a8f8-10fde73d5644 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:53.942963 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 218/427] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Aug 9 18:59:53 2022] GET /identity/v3/role_assignments?group.id=8d3fd1478813447c8be580dca24141b9&scope.project.id=e906580203f24a3787efe33c12436d59&role.id=ead9959857d24ec6bea3b7556da18ce5 => generated 611 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:53.983181 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dec91-7115-4b93-a72b-610c95053265 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:54.034057 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed492ec9-b5a2-46f4-b526-1b1c42852f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:54.034817 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed492ec9-b5a2-46f4-b526-1b1c42852f69 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:54.035106 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed492ec9-b5a2-46f4-b526-1b1c42852f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:54.035383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed492ec9-b5a2-46f4-b526-1b1c42852f69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:54.152041 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e265941-4951-4841-9515-305511729a22 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:54.152412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e265941-4951-4841-9515-305511729a22 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:54.152600 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e265941-4951-4841-9515-305511729a22 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:54.153420 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed492ec9-b5a2-46f4-b526-1b1c42852f69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:54.154251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 219/428] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 18:59:54.154948 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed492ec9-b5a2-46f4-b526-1b1c42852f69 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:54.159906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b99366-fddd-47a7-afe5-e58104adc8f0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:54.160192 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b99366-fddd-47a7-afe5-e58104adc8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:54.160468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b99366-fddd-47a7-afe5-e58104adc8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:54.179929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-41b99366-fddd-47a7-afe5-e58104adc8f0 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:54.181229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-41b99366-fddd-47a7-afe5-e58104adc8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:54.196483 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:54.207714 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:54.273902 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 220/429] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 18:59:54.288263 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 210/430] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 18:59:54.293942 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b99366-fddd-47a7-afe5-e58104adc8f0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:54.303285 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed492ec9-b5a2-46f4-b526-1b1c42852f69 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:54.416595 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b99366-fddd-47a7-afe5-e58104adc8f0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:54.434551 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed492ec9-b5a2-46f4-b526-1b1c42852f69 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:54.467182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142962be-6c9f-4dda-8cea-9045233e9fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:54.468122 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142962be-6c9f-4dda-8cea-9045233e9fdd None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:54.468583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142962be-6c9f-4dda-8cea-9045233e9fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:54.469066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142962be-6c9f-4dda-8cea-9045233e9fdd None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:54.470549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142962be-6c9f-4dda-8cea-9045233e9fdd None admin] RBAC: Authorizing `identity:get_project(project_id=54b4a073d17c4838b5377059540ead2e)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:54.472232 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142962be-6c9f-4dda-8cea-9045233e9fdd None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:54.474476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 221/431] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:54 2022] GET /identity/v3/projects/54b4a073d17c4838b5377059540ead2e => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:54.478689 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:54.479521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142962be-6c9f-4dda-8cea-9045233e9fdd None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:54.488191 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4438b-3a08-4960-b3a7-13594525074c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:54.488911 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4438b-3a08-4960-b3a7-13594525074c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:54.489285 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4438b-3a08-4960-b3a7-13594525074c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:54.489650 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4438b-3a08-4960-b3a7-13594525074c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:54.506325 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4438b-3a08-4960-b3a7-13594525074c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:54.513842 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:54.517333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-16f4438b-3a08-4960-b3a7-13594525074c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:54.517333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:54.517333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:54.517333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:54.517333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:54.517333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:54.517333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:54.517333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:54.517333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:54.517333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:54.517333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:54.517333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:54.517333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:54.517333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:54.517333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:54.517333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:54.518286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:54.518286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:54.518286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:54.518286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:54.518286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:54.518286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:54.518286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:54.518286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:54.518286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:54.518286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:54.518286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:54.518286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:54.518286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:54.518286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:54.518286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:54.518286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:54.519444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:54.519444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:54.519444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:54.519444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:54.519444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:54.519444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:54.519444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:54.519444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:54.519444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:54.519444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:54.519444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:54.519444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:54.524415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 211/432] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 18:59:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 18:59:54.525340 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4438b-3a08-4960-b3a7-13594525074c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:54.634736 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142962be-6c9f-4dda-8cea-9045233e9fdd None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:54.676015 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4438b-3a08-4960-b3a7-13594525074c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:54.684806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365befd-62f2-4618-8c72-4cb8ab9eab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:54.685676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365befd-62f2-4618-8c72-4cb8ab9eab11 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:54.686117 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365befd-62f2-4618-8c72-4cb8ab9eab11 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:54.686525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365befd-62f2-4618-8c72-4cb8ab9eab11 None admin] PATH_INFO: `/v3/groups/8d3fd1478813447c8be580dca24141b9` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:54.687796 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365befd-62f2-4618-8c72-4cb8ab9eab11 None admin] RBAC: Authorizing `identity:get_group(group_id=8d3fd1478813447c8be580dca24141b9)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:54.689400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365befd-62f2-4618-8c72-4cb8ab9eab11 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:54.691485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 222/433] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Aug 9 18:59:54 2022] GET /identity/v3/groups/8d3fd1478813447c8be580dca24141b9 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:54.696936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365befd-62f2-4618-8c72-4cb8ab9eab11 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:54.724811 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713727c-f692-41ae-8e75-1074e22d3b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:54.725429 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713727c-f692-41ae-8e75-1074e22d3b85 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:54.725761 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713727c-f692-41ae-8e75-1074e22d3b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:54.726172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713727c-f692-41ae-8e75-1074e22d3b85 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:54.726992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713727c-f692-41ae-8e75-1074e22d3b85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:54.727300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713727c-f692-41ae-8e75-1074e22d3b85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:54.729152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713727c-f692-41ae-8e75-1074e22d3b85 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:54.740056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 212/434] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 18:59:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:54.745370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713727c-f692-41ae-8e75-1074e22d3b85 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:54.805320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:54.816610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365befd-62f2-4618-8c72-4cb8ab9eab11 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:54.819061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:54.860489 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bbb2e-12df-4ba2-99d9-4d2750c6635c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:54.861974 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bbb2e-12df-4ba2-99d9-4d2750c6635c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:54.862427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bbb2e-12df-4ba2-99d9-4d2750c6635c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:54.862889 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bbb2e-12df-4ba2-99d9-4d2750c6635c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:54.863849 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bbb2e-12df-4ba2-99d9-4d2750c6635c None admin] RBAC: Adding query filter params (group.id=8d3fd1478813447c8be580dca24141b9, role.id=ead9959857d24ec6bea3b7556da18ce5, scope.project.id=54b4a073d17c4838b5377059540ead2e) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:54.864410 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bbb2e-12df-4ba2-99d9-4d2750c6635c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:54.867300 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bbb2e-12df-4ba2-99d9-4d2750c6635c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:54.874844 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 223/435] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Aug 9 18:59:54 2022] GET /identity/v3/role_assignments?group.id=8d3fd1478813447c8be580dca24141b9&scope.project.id=54b4a073d17c4838b5377059540ead2e&role.id=ead9959857d24ec6bea3b7556da18ce5 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:54.877126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713727c-f692-41ae-8e75-1074e22d3b85 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:54.917120 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a241bf5-0595-4b86-87d2-8254d46917ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:54.917701 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a241bf5-0595-4b86-87d2-8254d46917ba None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:54.917986 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a241bf5-0595-4b86-87d2-8254d46917ba None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:54.918261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a241bf5-0595-4b86-87d2-8254d46917ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:54.971319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678c380-5926-4779-9d03-1bd4f921b816 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:54.971652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678c380-5926-4779-9d03-1bd4f921b816 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:54.971875 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678c380-5926-4779-9d03-1bd4f921b816 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:54.973443 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 224/436] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:54.982975 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04998724-664b-4399-b5f3-5be14c0a634c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:54.983286 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04998724-664b-4399-b5f3-5be14c0a634c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:54.983523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04998724-664b-4399-b5f3-5be14c0a634c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:54.994955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a241bf5-0595-4b86-87d2-8254d46917ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:54.997446 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a241bf5-0595-4b86-87d2-8254d46917ba None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:55.010873 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-04998724-664b-4399-b5f3-5be14c0a634c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:55.013250 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-04998724-664b-4399-b5f3-5be14c0a634c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:55.067968 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:55.112499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 225/437] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:55.133215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 213/438] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:55.136500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04998724-664b-4399-b5f3-5be14c0a634c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:55.138383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a241bf5-0595-4b86-87d2-8254d46917ba None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:55.234604 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:55.242953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a241bf5-0595-4b86-87d2-8254d46917ba None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:55.243898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04998724-664b-4399-b5f3-5be14c0a634c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:55.280919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ecc52-c540-4d5e-a22a-c5e572ecbcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:55.281694 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ecc52-c540-4d5e-a22a-c5e572ecbcdb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:55.282062 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ecc52-c540-4d5e-a22a-c5e572ecbcdb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:55.282404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ecc52-c540-4d5e-a22a-c5e572ecbcdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:55.283783 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fe1b2-58f0-48f8-a83f-b6a4dcac32ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:55.284664 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fe1b2-58f0-48f8-a83f-b6a4dcac32ae None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:55.285202 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fe1b2-58f0-48f8-a83f-b6a4dcac32ae None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:55.285571 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fe1b2-58f0-48f8-a83f-b6a4dcac32ae None admin] PATH_INFO: `/v3/projects/e906580203f24a3787efe33c12436d59` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:55.287065 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fe1b2-58f0-48f8-a83f-b6a4dcac32ae None admin] RBAC: Authorizing `identity:get_project(project_id=e906580203f24a3787efe33c12436d59)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:55.288865 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fe1b2-58f0-48f8-a83f-b6a4dcac32ae None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:55.293619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 214/439] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:55 2022] GET /identity/v3/projects/e906580203f24a3787efe33c12436d59 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:55.296373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ecc52-c540-4d5e-a22a-c5e572ecbcdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:55.296492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fe1b2-58f0-48f8-a83f-b6a4dcac32ae None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:55.302380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-0c9ecc52-c540-4d5e-a22a-c5e572ecbcdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:55.302380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:55.302380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:55.302380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:55.302380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:55.302380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:55.302380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:55.302380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:55.302380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:55.302380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:55.302380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:55.302380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:55.302380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:55.302380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:55.302380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:55.302380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:55.303499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:55.303499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:55.303499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:55.303499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:55.303499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:55.303499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:55.303499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:55.303499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:55.303499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:55.303499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:55.303499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:55.303499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:55.303499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:55.303499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:55.303499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:55.303499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:55.304490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:55.304490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:55.304490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:55.304490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:55.304490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:55.304490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:55.304490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:55.304490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:55.304490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:55.304490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:55.304490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 18:59:55.304490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:55.306741 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 226/440] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 18:59:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:55.312662 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ecc52-c540-4d5e-a22a-c5e572ecbcdb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:55.320219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:55.407371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fe1b2-58f0-48f8-a83f-b6a4dcac32ae None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:55.420071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ecc52-c540-4d5e-a22a-c5e572ecbcdb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:55.449709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398d7d6-ee89-479f-b007-5fdde2191cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:55.450810 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398d7d6-ee89-479f-b007-5fdde2191cec None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:55.451421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398d7d6-ee89-479f-b007-5fdde2191cec None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:55.451869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398d7d6-ee89-479f-b007-5fdde2191cec None admin] PATH_INFO: `/v3/groups/8d3fd1478813447c8be580dca24141b9` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:55.453188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398d7d6-ee89-479f-b007-5fdde2191cec None admin] RBAC: Authorizing `identity:get_group(group_id=8d3fd1478813447c8be580dca24141b9)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:55.455305 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398d7d6-ee89-479f-b007-5fdde2191cec None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:55.455856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da889460-f304-4008-b155-2dc990a131c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:55.456470 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da889460-f304-4008-b155-2dc990a131c1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:55.456751 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da889460-f304-4008-b155-2dc990a131c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:55.461607 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da889460-f304-4008-b155-2dc990a131c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:55.461739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 215/441] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Aug 9 18:59:55 2022] GET /identity/v3/groups/8d3fd1478813447c8be580dca24141b9 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:55.461828 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da889460-f304-4008-b155-2dc990a131c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:55.461828 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da889460-f304-4008-b155-2dc990a131c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:55.462001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd9825-eff1-48ed-9279-6803149ff197 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:55.462001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd9825-eff1-48ed-9279-6803149ff197 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:55.462001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd9825-eff1-48ed-9279-6803149ff197 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:55.462219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da889460-f304-4008-b155-2dc990a131c1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:55.462306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 216/442] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:55.464392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd9825-eff1-48ed-9279-6803149ff197 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:55.469297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 227/443] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 18:59:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:55.473486 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9353a0-8a35-4363-acca-5976dd2f3166 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:55.473486 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9353a0-8a35-4363-acca-5976dd2f3166 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:55.473486 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9353a0-8a35-4363-acca-5976dd2f3166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:55.485006 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:55.492905 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7b9353a0-8a35-4363-acca-5976dd2f3166 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:55.494129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7b9353a0-8a35-4363-acca-5976dd2f3166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:55.552108 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:55.562210 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 228/444] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:55.563148 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9353a0-8a35-4363-acca-5976dd2f3166 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:55.567211 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd9825-eff1-48ed-9279-6803149ff197 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:55.601718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2397c-d210-4386-b38e-1bb4abdbf7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:55.602312 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2397c-d210-4386-b38e-1bb4abdbf7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:55.602590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2397c-d210-4386-b38e-1bb4abdbf7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:55.602856 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2397c-d210-4386-b38e-1bb4abdbf7e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:55.603572 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2397c-d210-4386-b38e-1bb4abdbf7e2 None admin] RBAC: Adding query filter params (group.id=8d3fd1478813447c8be580dca24141b9, role.id=e4ff1977289a44cea73b844f8ad102a1, scope.project.id=e906580203f24a3787efe33c12436d59) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:55.603874 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2397c-d210-4386-b38e-1bb4abdbf7e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:55.605305 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2397c-d210-4386-b38e-1bb4abdbf7e2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:55.611706 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 217/445] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Aug 9 18:59:55 2022] GET /identity/v3/role_assignments?group.id=8d3fd1478813447c8be580dca24141b9&scope.project.id=e906580203f24a3787efe33c12436d59&role.id=e4ff1977289a44cea73b844f8ad102a1 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:55.612705 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2397c-d210-4386-b38e-1bb4abdbf7e2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:55.681400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9353a0-8a35-4363-acca-5976dd2f3166 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:55.720074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2397c-d210-4386-b38e-1bb4abdbf7e2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:55.720891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1e947-f886-4b76-8a8d-ba3db1a737cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:55.721440 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1e947-f886-4b76-8a8d-ba3db1a737cf None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:55.721759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1e947-f886-4b76-8a8d-ba3db1a737cf None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:55.722060 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1e947-f886-4b76-8a8d-ba3db1a737cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:55.726186 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:55.760373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba23185-07a4-42e7-917d-1fd5d446b94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:55.760928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba23185-07a4-42e7-917d-1fd5d446b94f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:55.761177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba23185-07a4-42e7-917d-1fd5d446b94f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:55.761477 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba23185-07a4-42e7-917d-1fd5d446b94f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:55.777169 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba23185-07a4-42e7-917d-1fd5d446b94f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 18:59:55.781990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-cba23185-07a4-42e7-917d-1fd5d446b94f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:55.781990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:55.781990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:55.781990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:55.781990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:55.781990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:55.781990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:55.781990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:55.781990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:55.781990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:55.781990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:55.781990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:55.781990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 18:59:55.781990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 18:59:55.781990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 18:59:55.781990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 18:59:55.784040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 18:59:55.784040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 18:59:55.784040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 18:59:55.784040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 18:59:55.784040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:55.784040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:55.784040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:55.784040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:55.784040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:55.784040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:55.784040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:55.784040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:55.784040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:55.784040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:55.784040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:55.784040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:55.785066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:55.785066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:55.785066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:55.785066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:55.785066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 18:59:55.785066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 18:59:55.785066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 18:59:55.785066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 18:59:55.785066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 18:59:55.785066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 18:59:55.785066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 18:59:55.785066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 18:59:55.785066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 218/446] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 18:59:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:55.790554 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba23185-07a4-42e7-917d-1fd5d446b94f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:55.806106 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1e947-f886-4b76-8a8d-ba3db1a737cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:55.807636 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1e947-f886-4b76-8a8d-ba3db1a737cf None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:55.811435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:55.913049 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba23185-07a4-42e7-917d-1fd5d446b94f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:55.921988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 229/447] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:55.928037 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1e947-f886-4b76-8a8d-ba3db1a737cf None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:55.951345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e718af-97fe-4629-974f-343d29365676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:55.952201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e718af-97fe-4629-974f-343d29365676 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:55.952482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e718af-97fe-4629-974f-343d29365676 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:55.952752 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e718af-97fe-4629-974f-343d29365676 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:55.953419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e718af-97fe-4629-974f-343d29365676 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:55.953760 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e718af-97fe-4629-974f-343d29365676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:55.956025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e718af-97fe-4629-974f-343d29365676 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:55.965073 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 219/448] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 18:59:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:55.970006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e718af-97fe-4629-974f-343d29365676 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:55.972743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:56.044401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1e947-f886-4b76-8a8d-ba3db1a737cf None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:56.068201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:56.087846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40046c22-8104-405f-8286-ad1c2d7c284e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:56.088591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40046c22-8104-405f-8286-ad1c2d7c284e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:56.089063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40046c22-8104-405f-8286-ad1c2d7c284e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:56.089362 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40046c22-8104-405f-8286-ad1c2d7c284e None admin] PATH_INFO: `/v3/projects/fc0f9bf2f261408aa0230daf03acb9d1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:56.090673 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40046c22-8104-405f-8286-ad1c2d7c284e None admin] RBAC: Authorizing `identity:get_project(project_id=fc0f9bf2f261408aa0230daf03acb9d1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:56.092288 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40046c22-8104-405f-8286-ad1c2d7c284e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:56.094557 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 230/449] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:55 2022] GET /identity/v3/projects/fc0f9bf2f261408aa0230daf03acb9d1 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:56.099698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e718af-97fe-4629-974f-343d29365676 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:56.100646 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40046c22-8104-405f-8286-ad1c2d7c284e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:56.141291 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25716dc8-8d48-4287-9e13-a246444f48f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:56.142133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25716dc8-8d48-4287-9e13-a246444f48f7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:56.142533 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25716dc8-8d48-4287-9e13-a246444f48f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:56.143096 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25716dc8-8d48-4287-9e13-a246444f48f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:56.207262 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40046c22-8104-405f-8286-ad1c2d7c284e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:56.209490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:56.211188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25716dc8-8d48-4287-9e13-a246444f48f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:56.212648 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25716dc8-8d48-4287-9e13-a246444f48f7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:56.242381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31988ced-1a17-40b8-80f0-b29c67301a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:56.243004 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31988ced-1a17-40b8-80f0-b29c67301a66 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:56.243280 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31988ced-1a17-40b8-80f0-b29c67301a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:56.243553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31988ced-1a17-40b8-80f0-b29c67301a66 None admin] PATH_INFO: `/v3/groups/3de4c0e9fbe84fd382c41abb53301349` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:56.244659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31988ced-1a17-40b8-80f0-b29c67301a66 None admin] RBAC: Authorizing `identity:get_group(group_id=3de4c0e9fbe84fd382c41abb53301349)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:56.246135 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31988ced-1a17-40b8-80f0-b29c67301a66 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:56.247703 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 231/450] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Aug 9 18:59:56 2022] GET /identity/v3/groups/3de4c0e9fbe84fd382c41abb53301349 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:56.253808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31988ced-1a17-40b8-80f0-b29c67301a66 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:56.293315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:56.321683 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 220/451] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 18:59:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 18:59:56.323770 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25716dc8-8d48-4287-9e13-a246444f48f7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:56.351282 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31988ced-1a17-40b8-80f0-b29c67301a66 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:56.384560 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057500c-604c-435d-87ce-e054a439eb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:56.385156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057500c-604c-435d-87ce-e054a439eb32 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:56.385434 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057500c-604c-435d-87ce-e054a439eb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:56.385738 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057500c-604c-435d-87ce-e054a439eb32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:56.386492 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057500c-604c-435d-87ce-e054a439eb32 None admin] RBAC: Adding query filter params (group.id=3de4c0e9fbe84fd382c41abb53301349, role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.project.id=fc0f9bf2f261408aa0230daf03acb9d1) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:56.386796 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057500c-604c-435d-87ce-e054a439eb32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:56.388237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057500c-604c-435d-87ce-e054a439eb32 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:56.394486 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 232/452] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Aug 9 18:59:56 2022] GET /identity/v3/role_assignments?group.id=3de4c0e9fbe84fd382c41abb53301349&scope.project.id=fc0f9bf2f261408aa0230daf03acb9d1&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:56.428826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25716dc8-8d48-4287-9e13-a246444f48f7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:56.465269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded571d-2462-4f5a-8204-166092d96fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:56.465951 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded571d-2462-4f5a-8204-166092d96fad None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:56.466226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded571d-2462-4f5a-8204-166092d96fad None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:56.466495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded571d-2462-4f5a-8204-166092d96fad None admin] PATH_INFO: `/v3/projects/54b4a073d17c4838b5377059540ead2e` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:56.467658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded571d-2462-4f5a-8204-166092d96fad None admin] RBAC: Authorizing `identity:get_project(project_id=54b4a073d17c4838b5377059540ead2e)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:56.469135 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded571d-2462-4f5a-8204-166092d96fad None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:56.471036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 221/453] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 18:59:56 2022] GET /identity/v3/projects/54b4a073d17c4838b5377059540ead2e => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 18:59:56.476880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057500c-604c-435d-87ce-e054a439eb32 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:56.519779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:56.584960 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057500c-604c-435d-87ce-e054a439eb32 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:56.618193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e37b0-7020-48dc-ba49-937fb8830d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:56.618820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e37b0-7020-48dc-ba49-937fb8830d2d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:56.619100 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e37b0-7020-48dc-ba49-937fb8830d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:56.619372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e37b0-7020-48dc-ba49-937fb8830d2d None admin] PATH_INFO: `/v3/groups/8d3fd1478813447c8be580dca24141b9` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:56.620459 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e37b0-7020-48dc-ba49-937fb8830d2d None admin] RBAC: Authorizing `identity:get_group(group_id=8d3fd1478813447c8be580dca24141b9)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:56.621942 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e37b0-7020-48dc-ba49-937fb8830d2d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:56.623505 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 233/454] 10.222.0.65 () {56 vars in 1180 bytes} [Tue Aug 9 18:59:56 2022] GET /identity/v3/groups/8d3fd1478813447c8be580dca24141b9 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:56.630063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded571d-2462-4f5a-8204-166092d96fad None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:56.671317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:56.726437 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded571d-2462-4f5a-8204-166092d96fad None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:56.760057 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4023e-fa64-4846-97f0-7cc051dff12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:56.760641 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4023e-fa64-4846-97f0-7cc051dff12d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:56.761219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4023e-fa64-4846-97f0-7cc051dff12d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:56.761219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4023e-fa64-4846-97f0-7cc051dff12d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:56.761902 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4023e-fa64-4846-97f0-7cc051dff12d None admin] RBAC: Adding query filter params (group.id=8d3fd1478813447c8be580dca24141b9, role.id=e4ff1977289a44cea73b844f8ad102a1, scope.project.id=54b4a073d17c4838b5377059540ead2e) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:56.762210 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4023e-fa64-4846-97f0-7cc051dff12d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:56.763634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4023e-fa64-4846-97f0-7cc051dff12d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:56.769252 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 222/455] 10.222.0.65 () {56 vars in 1376 bytes} [Tue Aug 9 18:59:56 2022] GET /identity/v3/role_assignments?group.id=8d3fd1478813447c8be580dca24141b9&scope.project.id=54b4a073d17c4838b5377059540ead2e&role.id=e4ff1977289a44cea73b844f8ad102a1 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 18:59:59.395847 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cace3-a2b6-4ebf-b21d-6af33a72c445 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:59.396366 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cace3-a2b6-4ebf-b21d-6af33a72c445 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:59.396366 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cace3-a2b6-4ebf-b21d-6af33a72c445 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:59.398048 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 234/456] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:59.403490 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca019a7-9ce0-41a1-b06c-533f42eac1d5 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:59.403884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca019a7-9ce0-41a1-b06c-533f42eac1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:59.404063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca019a7-9ce0-41a1-b06c-533f42eac1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:59.430708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-fca019a7-9ce0-41a1-b06c-533f42eac1d5 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:59.431894 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fca019a7-9ce0-41a1-b06c-533f42eac1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:59.533968 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 223/457] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:59.583091 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cace3-a2b6-4ebf-b21d-6af33a72c445 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:59.625697 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff7bda-eca2-4609-a9b5-d0ffbaa2924b None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:59.626046 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff7bda-eca2-4609-a9b5-d0ffbaa2924b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:59.626901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff7bda-eca2-4609-a9b5-d0ffbaa2924b None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:59.628525 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 224/458] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 18:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 18:59:59.650328 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e7cfa-8401-4f06-b4f3-5ea3cda3d8f7 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:59.650591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e7cfa-8401-4f06-b4f3-5ea3cda3d8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:59.650798 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e7cfa-8401-4f06-b4f3-5ea3cda3d8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:59.679316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3d1e7cfa-8401-4f06-b4f3-5ea3cda3d8f7 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 18:59:59.680509 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3d1e7cfa-8401-4f06-b4f3-5ea3cda3d8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 18:59:59.705558 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cace3-a2b6-4ebf-b21d-6af33a72c445 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:59.729868 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:59.740927 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c2006-3432-4b77-a221-c72b8559bc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:59.741703 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c2006-3432-4b77-a221-c72b8559bc8d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:59.741965 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c2006-3432-4b77-a221-c72b8559bc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:59.752011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c2006-3432-4b77-a221-c72b8559bc8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:59.752139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 18:59:59.753946 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c2006-3432-4b77-a221-c72b8559bc8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:59.755414 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c2006-3432-4b77-a221-c72b8559bc8d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 18:59:59.771089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ef7c2006-3432-4b77-a221-c72b8559bc8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 18:59:59.771089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 18:59:59.771089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 18:59:59.771089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 18:59:59.771089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 18:59:59.771089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 18:59:59.771089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 18:59:59.771089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 18:59:59.771089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 18:59:59.771089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 18:59:59.771089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 18:59:59.771089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 18:59:59.771089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 18:59:59.771089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 18:59:59.771089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 18:59:59.771089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 18:59:59.772043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 18:59:59.772043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 18:59:59.772043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 18:59:59.772043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 18:59:59.772043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 18:59:59.772043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 18:59:59.772043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 18:59:59.772043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 18:59:59.772043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 18:59:59.772043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 18:59:59.772043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 18:59:59.772043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 18:59:59.772043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 18:59:59.772043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 18:59:59.772043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 18:59:59.772043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 18:59:59.772043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 18:59:59.772910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 18:59:59.772910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 18:59:59.772910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 18:59:59.777190 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 235/459] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 18:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 18:59:59.782102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c2006-3432-4b77-a221-c72b8559bc8d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:59.823205 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 225/460] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 18:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 18:59:59.913663 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e7cfa-8401-4f06-b4f3-5ea3cda3d8f7 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 18:59:59.935842 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c2006-3432-4b77-a221-c72b8559bc8d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 18:59:59.986570 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a0500-cd08-4d5a-af43-4e54856d095f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 18:59:59.987191 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a0500-cd08-4d5a-af43-4e54856d095f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 18:59:59.987474 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a0500-cd08-4d5a-af43-4e54856d095f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 18:59:59.987748 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a0500-cd08-4d5a-af43-4e54856d095f None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 18:59:59.988388 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a0500-cd08-4d5a-af43-4e54856d095f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 18:59:59.988692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a0500-cd08-4d5a-af43-4e54856d095f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 18:59:59.990922 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a0500-cd08-4d5a-af43-4e54856d095f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:00.011430 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 236/461] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 18:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:00.011430 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013185f-ce90-4c4a-9e65-a65dbe9f6621 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:00.011430 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013185f-ce90-4c4a-9e65-a65dbe9f6621 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:00.011430 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013185f-ce90-4c4a-9e65-a65dbe9f6621 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:00.011430 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 237/462] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:00.016565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013185f-ce90-4c4a-9e65-a65dbe9f6621 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:00.035609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e7cfa-8401-4f06-b4f3-5ea3cda3d8f7 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:00.041725 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:00.073588 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e26d3c-0c83-4115-85ea-f397f4f52b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:00.074679 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e26d3c-0c83-4115-85ea-f397f4f52b36 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:00.075189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e26d3c-0c83-4115-85ea-f397f4f52b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:00.075660 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e26d3c-0c83-4115-85ea-f397f4f52b36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:00.086967 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e26d3c-0c83-4115-85ea-f397f4f52b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:00.088696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e26d3c-0c83-4115-85ea-f397f4f52b36 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:00.106182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-c8e26d3c-0c83-4115-85ea-f397f4f52b36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:00.106182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:00.106182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:00.106182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:00.106182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:00.106182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:00.106182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:00.106182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:00.106182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:00.106182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:00.106182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:00.106182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:00.106182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:00.106182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:00.106182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:00.106182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:00.107162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:00.107162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:00.107162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:00.107162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:00.107162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:00.107162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:00.107162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:00.107162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:00.107162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:00.107162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:00.107162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:00.107162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:00.107162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:00.107162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:00.107162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:00.107162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:00.107162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:00.108025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:00.108025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:00.108025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:00.110189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 226/463] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 18:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:00.111857 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e81892-a383-4341-93bb-3af48dc81a55 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:00.112352 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e81892-a383-4341-93bb-3af48dc81a55 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:00.112840 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e81892-a383-4341-93bb-3af48dc81a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:00.132938 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-72e81892-a383-4341-93bb-3af48dc81a55 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:00.134577 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-72e81892-a383-4341-93bb-3af48dc81a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:00.149985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:00.154594 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013185f-ce90-4c4a-9e65-a65dbe9f6621 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:00.196580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7200d8-7a45-48d6-93ee-420497d51521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:00.197116 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7200d8-7a45-48d6-93ee-420497d51521 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:00.197393 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7200d8-7a45-48d6-93ee-420497d51521 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:00.197710 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7200d8-7a45-48d6-93ee-420497d51521 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:00.198347 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7200d8-7a45-48d6-93ee-420497d51521 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:00.199800 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7200d8-7a45-48d6-93ee-420497d51521 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:00.221485 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 227/464] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:00.221485 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e81892-a383-4341-93bb-3af48dc81a55 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:00.289733 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 238/465] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Aug 9 19:00:00 2022] POST /identity/v3/users => generated 246 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:00:00.290899 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cae61-afee-448b-86c3-e22b72ecbecf None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:00.291256 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cae61-afee-448b-86c3-e22b72ecbecf None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:00.291640 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cae61-afee-448b-86c3-e22b72ecbecf None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:00.293146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 239/466] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:00.298599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cae61-afee-448b-86c3-e22b72ecbecf None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:00.332119 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e81892-a383-4341-93bb-3af48dc81a55 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:00.374373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f756e2b-87ad-46e7-a89a-0fb72372d0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:00.375350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f756e2b-87ad-46e7-a89a-0fb72372d0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:00.375892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f756e2b-87ad-46e7-a89a-0fb72372d0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:00.376402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f756e2b-87ad-46e7-a89a-0fb72372d0d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:00.377505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f756e2b-87ad-46e7-a89a-0fb72372d0d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:00.378006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f756e2b-87ad-46e7-a89a-0fb72372d0d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:00.379728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f756e2b-87ad-46e7-a89a-0fb72372d0d8 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:00.390916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:00.398338 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 228/467] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:00.398338 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e87a39-2a0d-424a-9951-ac3f9a05791e None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:00.398338 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e87a39-2a0d-424a-9951-ac3f9a05791e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:00.398338 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e87a39-2a0d-424a-9951-ac3f9a05791e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:00.419639 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-72e87a39-2a0d-424a-9951-ac3f9a05791e None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:00.421699 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-72e87a39-2a0d-424a-9951-ac3f9a05791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:00.424352 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:00.428464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cae61-afee-448b-86c3-e22b72ecbecf None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:00.467095 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a866a0-f6f3-4517-bbc4-bd93d3f158cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:00.467774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a866a0-f6f3-4517-bbc4-bd93d3f158cb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:00.467945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a866a0-f6f3-4517-bbc4-bd93d3f158cb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:00.468221 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a866a0-f6f3-4517-bbc4-bd93d3f158cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:00.482336 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a866a0-f6f3-4517-bbc4-bd93d3f158cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:00.483806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a866a0-f6f3-4517-bbc4-bd93d3f158cb None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:00.503182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-66a866a0-f6f3-4517-bbc4-bd93d3f158cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:00.503182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:00.503182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:00.503182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:00.503182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:00.503182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:00.503182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:00.503182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:00.503182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:00.503182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:00.503182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:00.503182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:00.503182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:00.503182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:00.503182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:00.503182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:00.508893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:00.508893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:00.508893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:00.508893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:00.508893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:00.508893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:00.508893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:00.508893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:00.508893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:00.508893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:00.508893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:00.508893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:00.508893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:00.508893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:00.508893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:00.508893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:00.508893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:00.509896 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:00.509896 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:00.509896 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:00.510059 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 229/468] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:00.510059 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e87a39-2a0d-424a-9951-ac3f9a05791e None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:00.510192 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 240/469] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:00.517786 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a866a0-f6f3-4517-bbc4-bd93d3f158cb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:00.625615 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e87a39-2a0d-424a-9951-ac3f9a05791e None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:00.627023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a866a0-f6f3-4517-bbc4-bd93d3f158cb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:00.660785 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:00.664434 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765846e4-16a0-4935-9690-0241cb00e875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:00.665042 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765846e4-16a0-4935-9690-0241cb00e875 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:00.665350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765846e4-16a0-4935-9690-0241cb00e875 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:00.665648 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765846e4-16a0-4935-9690-0241cb00e875 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:00.666279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765846e4-16a0-4935-9690-0241cb00e875 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:00.667758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765846e4-16a0-4935-9690-0241cb00e875 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:00.671838 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d9aa0-5532-49da-87c0-f94f164d2167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:00.673809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d9aa0-5532-49da-87c0-f94f164d2167 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:00.673809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d9aa0-5532-49da-87c0-f94f164d2167 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:00.673809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d9aa0-5532-49da-87c0-f94f164d2167 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:00.674257 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d9aa0-5532-49da-87c0-f94f164d2167 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:00.674564 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d9aa0-5532-49da-87c0-f94f164d2167 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:00.675959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d9aa0-5532-49da-87c0-f94f164d2167 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:00.680056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:00.687901 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 241/470] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:00.688873 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d9aa0-5532-49da-87c0-f94f164d2167 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:00.766987 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 230/471] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Aug 9 19:00:00 2022] POST /identity/v3/users => generated 248 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:00:00.768345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1592ed6-d087-4a74-a88b-82dab3c9aa24 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:00.777601 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1592ed6-d087-4a74-a88b-82dab3c9aa24 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:00.778049 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1592ed6-d087-4a74-a88b-82dab3c9aa24 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:00.779688 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 231/472] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:00 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:00.780429 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1592ed6-d087-4a74-a88b-82dab3c9aa24 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:00.808876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d9aa0-5532-49da-87c0-f94f164d2167 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:00.857162 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a69f2-00b9-472c-9fba-c80e018e83fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:00.857956 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a69f2-00b9-472c-9fba-c80e018e83fd None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:00.858311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a69f2-00b9-472c-9fba-c80e018e83fd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:00.858656 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a69f2-00b9-472c-9fba-c80e018e83fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:00.873890 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a69f2-00b9-472c-9fba-c80e018e83fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:00.875782 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a69f2-00b9-472c-9fba-c80e018e83fd None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:00.898425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ec9a69f2-00b9-472c-9fba-c80e018e83fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:00.898425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:00.898425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:00.898425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:00.898425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:00.898425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:00.898425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:00.898425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:00.898425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:00.898425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:00.898425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:00.898425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:00.898425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:00.898425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:00.898425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:00.898425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:00.899450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:00.899450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:00.899450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:00.899450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:00.899450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:00.899450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:00.899450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:00.899450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:00.899450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:00.899450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:00.899450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:00.899450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:00.899450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:00.899450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:00.899450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:00.899450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:00.899450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:00.900318 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:00.900318 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:00.900318 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:00.902345 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 242/473] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:00.903901 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d35db-5bf1-47b3-a2ad-facacfa3d695 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:00.904378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d35db-5bf1-47b3-a2ad-facacfa3d695 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:00.904825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d35db-5bf1-47b3-a2ad-facacfa3d695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:00.924422 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1592ed6-d087-4a74-a88b-82dab3c9aa24 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:00.926455 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-0e0d35db-5bf1-47b3-a2ad-facacfa3d695 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:00.928544 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0e0d35db-5bf1-47b3-a2ad-facacfa3d695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:00.962634 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:00.971671 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b13b0-8705-4ea6-bb64-63f9e893d6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:00.976252 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b13b0-8705-4ea6-bb64-63f9e893d6e6 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:00.976252 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b13b0-8705-4ea6-bb64-63f9e893d6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:00.976252 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b13b0-8705-4ea6-bb64-63f9e893d6e6 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:00.976252 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b13b0-8705-4ea6-bb64-63f9e893d6e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:00.976252 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b13b0-8705-4ea6-bb64-63f9e893d6e6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:01.009504 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 243/474] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:01.010472 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d35db-5bf1-47b3-a2ad-facacfa3d695 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:01.077021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 232/475] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Aug 9 19:00:00 2022] POST /identity/v3/users => generated 248 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:00:01.077864 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b13b0-8705-4ea6-bb64-63f9e893d6e6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:01.171707 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d35db-5bf1-47b3-a2ad-facacfa3d695 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:01.181662 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:01.215134 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743fa0b-5e05-41f4-8eb0-830a1c8ebc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:01.215868 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743fa0b-5e05-41f4-8eb0-830a1c8ebc64 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:01.216147 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743fa0b-5e05-41f4-8eb0-830a1c8ebc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:01.216420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743fa0b-5e05-41f4-8eb0-830a1c8ebc64 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:01.217073 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743fa0b-5e05-41f4-8eb0-830a1c8ebc64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:01.217369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743fa0b-5e05-41f4-8eb0-830a1c8ebc64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:01.218854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743fa0b-5e05-41f4-8eb0-830a1c8ebc64 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:01.233767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 244/476] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:01.240154 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743fa0b-5e05-41f4-8eb0-830a1c8ebc64 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:01.274399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:01.284974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b13b0-8705-4ea6-bb64-63f9e893d6e6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:01.344345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9cb5d-52f3-40e5-8012-3150d5c138e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:01.345826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9cb5d-52f3-40e5-8012-3150d5c138e9 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:01.345826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9cb5d-52f3-40e5-8012-3150d5c138e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:01.346058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9cb5d-52f3-40e5-8012-3150d5c138e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:01.346725 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9cb5d-52f3-40e5-8012-3150d5c138e9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:01.348129 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9cb5d-52f3-40e5-8012-3150d5c138e9 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:01.382973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.sql.core [None req-71d9cb5d-52f3-40e5-8012-3150d5c138e9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 19:00:01.382973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 09 19:00:01.382973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [parameters: {'id': '1dc911e3b6504bd7a2b5c3373913c9ca', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 09 19:00:01.382973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80523) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 19:00:01.393718 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743fa0b-5e05-41f4-8eb0-830a1c8ebc64 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:01.399206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-71d9cb5d-52f3-40e5-8012-3150d5c138e9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 09 19:00:01.399206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:01.399206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 19:00:01.399206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 19:00:01.399206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 19:00:01.399206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 19:00:01.399206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 19:00:01.399206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 19:00:01.399206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 19:00:01.399206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application conn.query(q) Aug 09 19:00:01.399206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 19:00:01.399206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 19:00:01.399206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 19:00:01.399206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application result.read() Aug 09 19:00:01.399206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 19:00:01.400277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 19:00:01.400277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 19:00:01.400277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 19:00:01.400277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 19:00:01.400277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 19:00:01.400277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 19:00:01.400277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 19:00:01.400277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 19:00:01.400277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:01.400277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 19:00:01.400277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:01.400277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:01.400277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 19:00:01.400277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 19:00:01.400277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 09 19:00:01.400277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return ref.to_dict() Aug 09 19:00:01.400277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 19:00:01.400277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application next(self.gen) Aug 09 19:00:01.401405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 19:00:01.401405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application yield resource Aug 09 19:00:01.401405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 19:00:01.401405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application next(self.gen) Aug 09 19:00:01.401405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 19:00:01.401405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 19:00:01.401405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 19:00:01.401405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 19:00:01.401405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 19:00:01.401405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise self.value Aug 09 19:00:01.401405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 19:00:01.401405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 19:00:01.401405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 19:00:01.401405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application session.commit() Aug 09 19:00:01.401405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 19:00:01.401405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 19:00:01.401405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 19:00:01.402419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 19:00:01.402419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 19:00:01.402419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.session.flush() Aug 09 19:00:01.402419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 19:00:01.402419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 19:00:01.402419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 19:00:01.402419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 19:00:01.402419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 19:00:01.402419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application compat.raise_( Aug 09 19:00:01.402419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 19:00:01.402419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception Aug 09 19:00:01.402419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 19:00:01.402419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 19:00:01.402419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 19:00:01.402419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 19:00:01.402419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 19:00:01.402419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 19:00:01.403415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 19:00:01.403415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 19:00:01.403415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 09 19:00:01.403415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 09 19:00:01.403415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 19:00:01.403415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 19:00:01.403415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 19:00:01.403415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 19:00:01.403415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 19:00:01.403415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 19:00:01.403415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 19:00:01.403415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 19:00:01.403415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 19:00:01.403415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 19:00:01.403415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 19:00:01.403415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception Aug 09 19:00:01.404324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 19:00:01.404324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 19:00:01.404324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 19:00:01.404324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 19:00:01.404324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 19:00:01.404324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 19:00:01.404324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 19:00:01.404324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application conn.query(q) Aug 09 19:00:01.404324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 19:00:01.404324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 19:00:01.404324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 19:00:01.404324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application result.read() Aug 09 19:00:01.404324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 19:00:01.404324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 19:00:01.404324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 19:00:01.404324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 19:00:01.405299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 19:00:01.405299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 19:00:01.405299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 19:00:01.405299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 19:00:01.405299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 19:00:01.405299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 09 19:00:01.405299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [parameters: {'id': '1dc911e3b6504bd7a2b5c3373913c9ca', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 09 19:00:01.405299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 19:00:01.405299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:01.405299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:01.405299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:01.405299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:01.405299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:01.405299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:01.405299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:01.405299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:01.406309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:01.406309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:01.406309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:01.406309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:01.406309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:01.406309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:01.406309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 09 19:00:01.406309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 09 19:00:01.406309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:01.406309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:01.406309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 09 19:00:01.406309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 09 19:00:01.406309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 19:00:01.406309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 19:00:01.406309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 09 19:00:01.406309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:01.407841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 233/477] 10.222.0.65 () {60 vars in 1131 bytes} [Tue Aug 9 19:00:01 2022] POST /identity/v3/roles => generated 144 bytes in 324 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:01.409041 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9cb5d-52f3-40e5-8012-3150d5c138e9 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:01.453496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c54405-5d6a-46c6-b9a5-d6c3ae17a659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:01.455316 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c54405-5d6a-46c6-b9a5-d6c3ae17a659 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:01.455880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c54405-5d6a-46c6-b9a5-d6c3ae17a659 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:01.456339 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c54405-5d6a-46c6-b9a5-d6c3ae17a659 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:01.457995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c54405-5d6a-46c6-b9a5-d6c3ae17a659 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:01.459609 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c54405-5d6a-46c6-b9a5-d6c3ae17a659 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:01.542846 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9cb5d-52f3-40e5-8012-3150d5c138e9 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:01.558465 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 245/478] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Aug 9 19:00:01 2022] POST /identity/v3/users => generated 249 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:00:01.560127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:01.585367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca225f-8c1a-4706-8352-b0665510a239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:01.586079 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca225f-8c1a-4706-8352-b0665510a239 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:01.586362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca225f-8c1a-4706-8352-b0665510a239 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:01.586635 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca225f-8c1a-4706-8352-b0665510a239 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:01.604294 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca225f-8c1a-4706-8352-b0665510a239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:01.604969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-39ca225f-8c1a-4706-8352-b0665510a239 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 19:00:01.604969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:01.604969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:01.604969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:01.604969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:01.604969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:01.604969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:01.604969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:01.604969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:01.604969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:01.604969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:01.604969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:01.604969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:01.604969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:01.604969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:01.604969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:01.605905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:01.605905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:01.605905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:01.605905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:01.605905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:01.605905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:01.605905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:01.605905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:01.605905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:01.605905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:01.605905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:01.605905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:01.605905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:01.605905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:01.605905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:01.605905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:01.606739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:01.606739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:01.606739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:01.606739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:01.606739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:01.606739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:01.606739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:01.606739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:01.606739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:01.606739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:01.606739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 19:00:01.606739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:01.607353 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 234/479] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 19:00:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:01.612981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c54405-5d6a-46c6-b9a5-d6c3ae17a659 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:01.757479 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:01.786319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c54405-5d6a-46c6-b9a5-d6c3ae17a659 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:01.823776 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cea839-a73e-46ab-8455-8a306f56e399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:01.824540 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cea839-a73e-46ab-8455-8a306f56e399 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:01.824911 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cea839-a73e-46ab-8455-8a306f56e399 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:01.825283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cea839-a73e-46ab-8455-8a306f56e399 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:01.826073 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cea839-a73e-46ab-8455-8a306f56e399 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:01.826465 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cea839-a73e-46ab-8455-8a306f56e399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:01.827940 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cea839-a73e-46ab-8455-8a306f56e399 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:01.837907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 246/480] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:02.650054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874ab32-c529-4ba7-90ee-9e4b8afee3b4 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:02.650582 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874ab32-c529-4ba7-90ee-9e4b8afee3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:02.650582 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874ab32-c529-4ba7-90ee-9e4b8afee3b4 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:02.652172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 235/481] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:02.662996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc0698-8d72-4297-8d70-f3997a62ce0d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:02.663487 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc0698-8d72-4297-8d70-f3997a62ce0d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:02.663570 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc0698-8d72-4297-8d70-f3997a62ce0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:02.687645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-67cc0698-8d72-4297-8d70-f3997a62ce0d None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:02.688965 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-67cc0698-8d72-4297-8d70-f3997a62ce0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:02.775074 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 247/482] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:02.809769 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874ab32-c529-4ba7-90ee-9e4b8afee3b4 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:02.931063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874ab32-c529-4ba7-90ee-9e4b8afee3b4 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:02.979064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6238d8b-1744-43c0-8be0-d5fcf664f596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:02.979711 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6238d8b-1744-43c0-8be0-d5fcf664f596 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:02.979991 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6238d8b-1744-43c0-8be0-d5fcf664f596 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:02.980261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6238d8b-1744-43c0-8be0-d5fcf664f596 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:02.991329 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6238d8b-1744-43c0-8be0-d5fcf664f596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:02.999343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-c6238d8b-1744-43c0-8be0-d5fcf664f596 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:02.999343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:02.999343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:02.999343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:02.999343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:02.999343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:02.999343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:02.999343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:02.999343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:02.999343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:02.999343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:02.999343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:02.999343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:02.999343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:02.999343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:02.999343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:03.000225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:03.000225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:03.000225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:03.000225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:03.000225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:03.000225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:03.000225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:03.000225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:03.000225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:03.000225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:03.000225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:03.000225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:03.000225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:03.000225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:03.000225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:03.000225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:03.001617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:03.001617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:03.001617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:03.001617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:03.001617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:03.001617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:03.001617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:03.001617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:03.001617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:03.001617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:03.001617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:03.001617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:03.001617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 236/483] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:03.006907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc0698-8d72-4297-8d70-f3997a62ce0d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:03.089230 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:03.115683 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc0698-8d72-4297-8d70-f3997a62ce0d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:03.156386 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b58c1-6922-477d-940b-59567cb51e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:03.156993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b58c1-6922-477d-940b-59567cb51e1a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:03.157322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b58c1-6922-477d-940b-59567cb51e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:03.157618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b58c1-6922-477d-940b-59567cb51e1a None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:03.158276 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b58c1-6922-477d-940b-59567cb51e1a None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:03.158578 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b58c1-6922-477d-940b-59567cb51e1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:03.159952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b58c1-6922-477d-940b-59567cb51e1a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:03.168714 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 248/484] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:00:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:03.174761 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6238d8b-1744-43c0-8be0-d5fcf664f596 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:03.221856 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:03.314672 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6238d8b-1744-43c0-8be0-d5fcf664f596 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:03.360978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6ebdc-8770-43c0-89dd-f87aedb0f9e7 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:03.361270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6ebdc-8770-43c0-89dd-f87aedb0f9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:03.361522 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6ebdc-8770-43c0-89dd-f87aedb0f9e7 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:03.362938 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fc79f-7ed4-4059-89b7-101fd5a34f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:03.363232 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 249/485] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:00:03.363630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fc79f-7ed4-4059-89b7-101fd5a34f69 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:03.363911 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fc79f-7ed4-4059-89b7-101fd5a34f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:03.364249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fc79f-7ed4-4059-89b7-101fd5a34f69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:03.368076 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f732c-a8cd-4d47-a977-eb6cbc6cd21f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:03.368361 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f732c-a8cd-4d47-a977-eb6cbc6cd21f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:03.368638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f732c-a8cd-4d47-a977-eb6cbc6cd21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:03.381803 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fc79f-7ed4-4059-89b7-101fd5a34f69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:03.383519 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fc79f-7ed4-4059-89b7-101fd5a34f69 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:03.391713 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9c4f732c-a8cd-4d47-a977-eb6cbc6cd21f None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:03.393310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9c4f732c-a8cd-4d47-a977-eb6cbc6cd21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:03.409742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-226fc79f-7ed4-4059-89b7-101fd5a34f69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:03.409742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:03.409742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:03.409742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:03.409742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:03.409742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:03.409742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:03.409742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:03.409742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:03.409742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:03.409742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:03.409742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:03.409742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:03.409742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:03.409742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:03.409742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:03.411958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:03.411958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:03.411958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:03.411958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:03.411958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:03.411958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:03.411958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:03.411958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:03.411958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:03.411958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:03.411958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:03.411958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:03.411958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:03.411958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:03.411958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:03.411958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:03.411958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:03.417792 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:03.417792 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:03.417792 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:03.417792 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 237/486] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:03.417792 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fc79f-7ed4-4059-89b7-101fd5a34f69 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:03.512404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 250/487] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 19:00:03.546178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:03.561919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fc79f-7ed4-4059-89b7-101fd5a34f69 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:03.564955 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f732c-a8cd-4d47-a977-eb6cbc6cd21f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:03.632511 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4c729-bf64-4770-820f-f90f7467a6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:03.633123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4c729-bf64-4770-820f-f90f7467a6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:03.633407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4c729-bf64-4770-820f-f90f7467a6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:03.633698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4c729-bf64-4770-820f-f90f7467a6e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:03.634337 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4c729-bf64-4770-820f-f90f7467a6e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:03.634637 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4c729-bf64-4770-820f-f90f7467a6e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:03.636005 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4c729-bf64-4770-820f-f90f7467a6e0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:03.660375 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 238/488] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:03.665549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4c729-bf64-4770-820f-f90f7467a6e0 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:03.672298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:03.735010 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f732c-a8cd-4d47-a977-eb6cbc6cd21f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:03.803226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111b213-575c-4962-b69b-97303e13c283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:03.803868 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111b213-575c-4962-b69b-97303e13c283 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:03.804147 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111b213-575c-4962-b69b-97303e13c283 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:03.804417 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111b213-575c-4962-b69b-97303e13c283 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:03.816873 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111b213-575c-4962-b69b-97303e13c283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:03.821969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-b111b213-575c-4962-b69b-97303e13c283 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:03.821969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:03.821969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:03.821969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:03.821969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:03.821969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:03.821969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:03.821969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:03.821969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:03.821969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:03.821969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:03.821969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:03.821969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:03.821969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:03.821969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:03.821969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:03.822864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:03.822864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:03.822864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:03.822864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:03.822864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:03.822864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:03.822864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:03.822864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:03.822864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:03.822864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:03.822864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:03.822864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:03.822864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:03.822864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:03.822864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:03.822864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:03.823668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:03.823668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:03.823668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:03.823668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:03.823668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:03.823668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:03.823668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:03.823668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:03.823668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:03.823668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:03.823668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:03.823668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:03.823668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 251/489] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:03.830329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111b213-575c-4962-b69b-97303e13c283 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:03.897941 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4c729-bf64-4770-820f-f90f7467a6e0 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:03.932769 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f437f-38c7-4563-b0d7-346c1fbf3f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:03.933552 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f437f-38c7-4563-b0d7-346c1fbf3f88 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:03.933836 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f437f-38c7-4563-b0d7-346c1fbf3f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:03.934108 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f437f-38c7-4563-b0d7-346c1fbf3f88 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:03.941875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f437f-38c7-4563-b0d7-346c1fbf3f88 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:03.943450 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f437f-38c7-4563-b0d7-346c1fbf3f88 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:03.947424 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111b213-575c-4962-b69b-97303e13c283 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:03.957128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-a59f437f-38c7-4563-b0d7-346c1fbf3f88 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 19:00:03.957128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:03.957128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:03.957128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:03.957128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:03.957128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:03.957128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:03.957128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:03.957128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:03.957128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:03.957128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:03.957128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:03.957128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:03.957128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:03.957128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:03.957128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:03.958317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:03.958317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:03.958317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:03.958317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:03.958317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:03.958317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:03.958317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:03.958317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:03.958317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:03.958317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:03.958317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:03.958317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:03.958317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:03.958317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:03.958317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:03.958317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:03.958317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:03.958317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:03.959214 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:03.959214 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:03.959214 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:03.959214 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:03.959214 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:03.959214 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:03.959214 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:03.959214 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:03.959214 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 19:00:03.959214 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:03.959214 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 239/490] 10.222.0.65 () {56 vars in 1093 bytes} [Tue Aug 9 19:00:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:03.959770 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edeb2c-49b5-4440-890c-fd63bdfee6b8 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:03.960175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edeb2c-49b5-4440-890c-fd63bdfee6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:03.960379 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edeb2c-49b5-4440-890c-fd63bdfee6b8 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:03.961632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 240/491] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:03.966312 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edeb2c-49b5-4440-890c-fd63bdfee6b8 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:03.981836 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:03.982757 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:03.994325 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fc986-5393-4516-89a4-98ca662a1321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:03.995328 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fc986-5393-4516-89a4-98ca662a1321 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:03.996064 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fc986-5393-4516-89a4-98ca662a1321 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:03.996805 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fc986-5393-4516-89a4-98ca662a1321 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:03.997839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fc986-5393-4516-89a4-98ca662a1321 None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:04.002807 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fc986-5393-4516-89a4-98ca662a1321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:04.002807 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fc986-5393-4516-89a4-98ca662a1321 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:04.010700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 252/492] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:00:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:04.014688 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cace6-3505-4dc3-b23a-a046e40c2a4e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:04.015180 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cace6-3505-4dc3-b23a-a046e40c2a4e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:04.015614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cace6-3505-4dc3-b23a-a046e40c2a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:04.040614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-204cace6-3505-4dc3-b23a-a046e40c2a4e None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:04.041976 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-204cace6-3505-4dc3-b23a-a046e40c2a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:04.081399 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edeb2c-49b5-4440-890c-fd63bdfee6b8 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:04.117253 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc32cc9-515f-4246-a92a-bd7e5a8853bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:04.118332 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc32cc9-515f-4246-a92a-bd7e5a8853bc None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:04.118617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc32cc9-515f-4246-a92a-bd7e5a8853bc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:04.118893 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc32cc9-515f-4246-a92a-bd7e5a8853bc None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:04.119620 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc32cc9-515f-4246-a92a-bd7e5a8853bc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:04.119931 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc32cc9-515f-4246-a92a-bd7e5a8853bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:04.121541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc32cc9-515f-4246-a92a-bd7e5a8853bc None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:04.127320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 253/493] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:04.128409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cace6-3505-4dc3-b23a-a046e40c2a4e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:04.184649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 241/494] 10.222.0.65 () {56 vars in 1133 bytes} [Tue Aug 9 19:00:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:04.185495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc32cc9-515f-4246-a92a-bd7e5a8853bc None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:04.255249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:04.258866 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cace6-3505-4dc3-b23a-a046e40c2a4e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:04.304159 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:04.320966 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acace9b2-b05a-4290-869e-9382eb7c5958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:04.321700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acace9b2-b05a-4290-869e-9382eb7c5958 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:04.321919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acace9b2-b05a-4290-869e-9382eb7c5958 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:04.322179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acace9b2-b05a-4290-869e-9382eb7c5958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:04.323528 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc32cc9-515f-4246-a92a-bd7e5a8853bc None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:04.332417 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acace9b2-b05a-4290-869e-9382eb7c5958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:04.333904 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acace9b2-b05a-4290-869e-9382eb7c5958 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:04.349624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-acace9b2-b05a-4290-869e-9382eb7c5958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:04.349624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:04.349624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:04.349624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:04.349624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:04.349624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:04.349624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:04.349624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:04.349624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:04.349624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:04.349624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:04.349624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:04.349624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:04.349624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:04.349624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:04.349624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:04.350628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:04.350628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:04.350628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:04.350628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:04.350628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:04.350628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:04.350628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:04.350628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:04.350628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:04.350628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:04.350628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:04.350628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:04.350628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:04.350628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:04.350628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:04.350628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:04.350628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:04.351480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:04.351480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:04.351480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:04.353246 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 254/495] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:04.354278 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acace9b2-b05a-4290-869e-9382eb7c5958 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:04.368711 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fa7a7-93b7-4394-9928-6c34909f8413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:04.369354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fa7a7-93b7-4394-9928-6c34909f8413 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:04.369666 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fa7a7-93b7-4394-9928-6c34909f8413 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:04.369940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fa7a7-93b7-4394-9928-6c34909f8413 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:04.381264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fa7a7-93b7-4394-9928-6c34909f8413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:04.386266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-d34fa7a7-93b7-4394-9928-6c34909f8413 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:04.386266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:04.386266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:04.386266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:04.386266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:04.386266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:04.386266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:04.386266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:04.386266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:04.386266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:04.386266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:04.386266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:04.386266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:04.386266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:04.386266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:04.386266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:04.387161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:04.387161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:04.387161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:04.387161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:04.387161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:04.387161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:04.387161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:04.387161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:04.387161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:04.387161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:04.387161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:04.387161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:04.387161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:04.387161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:04.387161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:04.387161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:04.387957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:04.387957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:04.387957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:04.387957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:04.387957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:04.387957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:04.387957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:04.387957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:04.387957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:04.387957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:04.387957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:04.387957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:04.387957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 242/496] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:04.388612 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243f831-e0b6-4871-afd7-a66a5b89040a None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:04.389434 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243f831-e0b6-4871-afd7-a66a5b89040a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:04.389434 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243f831-e0b6-4871-afd7-a66a5b89040a None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:04.394479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 243/497] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:04.394479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243f831-e0b6-4871-afd7-a66a5b89040a None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:04.476593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acace9b2-b05a-4290-869e-9382eb7c5958 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:04.502807 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243f831-e0b6-4871-afd7-a66a5b89040a None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:04.515951 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f524711-f712-4c65-8807-48b536f4e522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:04.516558 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f524711-f712-4c65-8807-48b536f4e522 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:04.516919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f524711-f712-4c65-8807-48b536f4e522 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:04.517107 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f524711-f712-4c65-8807-48b536f4e522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:04.531562 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:04.542990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b13880-df0a-4c99-b212-0215ec656ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:04.543607 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b13880-df0a-4c99-b212-0215ec656ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:04.543893 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b13880-df0a-4c99-b212-0215ec656ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:04.544166 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b13880-df0a-4c99-b212-0215ec656ef5 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:04.544832 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b13880-df0a-4c99-b212-0215ec656ef5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:04.545133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b13880-df0a-4c99-b212-0215ec656ef5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:04.546546 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b13880-df0a-4c99-b212-0215ec656ef5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:04.562870 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 244/498] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:04.562870 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b13880-df0a-4c99-b212-0215ec656ef5 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:04.568990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:04.598848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f524711-f712-4c65-8807-48b536f4e522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:04.601086 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f524711-f712-4c65-8807-48b536f4e522 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:04.666690 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b13880-df0a-4c99-b212-0215ec656ef5 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:04.700794 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f230238-a223-42e2-91d8-64b7a5c074ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:04.701400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f230238-a223-42e2-91d8-64b7a5c074ef None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:04.701707 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f230238-a223-42e2-91d8-64b7a5c074ef None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:04.701976 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f230238-a223-42e2-91d8-64b7a5c074ef None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:04.702629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f230238-a223-42e2-91d8-64b7a5c074ef None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:04.702932 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f230238-a223-42e2-91d8-64b7a5c074ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:04.703253 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 255/499] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:00:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 19:00:04.704806 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f230238-a223-42e2-91d8-64b7a5c074ef None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:04.705252 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75716fbc-1da9-4c19-b3d7-c115595bff0d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:04.705564 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75716fbc-1da9-4c19-b3d7-c115595bff0d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:04.705836 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75716fbc-1da9-4c19-b3d7-c115595bff0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:04.715271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 245/500] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:00:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:04.716064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f230238-a223-42e2-91d8-64b7a5c074ef None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:04.726249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-75716fbc-1da9-4c19-b3d7-c115595bff0d None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:04.727478 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-75716fbc-1da9-4c19-b3d7-c115595bff0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:04.764018 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:04.788366 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:04.792620 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 256/501] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:04.794003 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bf0f2-aafd-4223-ad33-4ea235b3077e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:04.794287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bf0f2-aafd-4223-ad33-4ea235b3077e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:04.794559 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bf0f2-aafd-4223-ad33-4ea235b3077e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:04.795790 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 257/502] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:04.797676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bf0f2-aafd-4223-ad33-4ea235b3077e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:04.820935 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f230238-a223-42e2-91d8-64b7a5c074ef None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:04.855203 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ef815-6b62-4bc8-ba89-0c55939a00f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:04.855829 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ef815-6b62-4bc8-ba89-0c55939a00f5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:04.856107 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ef815-6b62-4bc8-ba89-0c55939a00f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:04.856376 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ef815-6b62-4bc8-ba89-0c55939a00f5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:04.863745 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ef815-6b62-4bc8-ba89-0c55939a00f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:04.865178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ef815-6b62-4bc8-ba89-0c55939a00f5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:04.876302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-b25ef815-6b62-4bc8-ba89-0c55939a00f5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 19:00:04.876302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:04.876302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:04.876302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:04.876302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:04.876302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:04.876302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:04.876302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:04.876302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:04.876302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:04.876302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:04.876302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:04.876302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:04.876302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:04.876302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:04.876302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:04.877213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:04.877213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:04.877213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:04.877213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:04.877213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:04.877213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:04.877213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:04.877213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:04.877213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:04.877213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:04.877213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:04.877213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:04.877213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:04.877213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:04.877213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:04.877213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:04.877213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:04.877213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:04.878141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:04.878141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:04.878141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:04.878141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:04.878141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:04.878141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:04.878141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:04.878141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:04.878141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 19:00:04.878141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:04.878141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 246/503] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:00:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:04.879987 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ef815-6b62-4bc8-ba89-0c55939a00f5 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:04.909080 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bf0f2-aafd-4223-ad33-4ea235b3077e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:04.942016 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ab744-015d-4d34-b084-f758848329fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:04.942632 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ab744-015d-4d34-b084-f758848329fd None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:04.942909 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ab744-015d-4d34-b084-f758848329fd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:04.943181 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ab744-015d-4d34-b084-f758848329fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:04.952862 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ab744-015d-4d34-b084-f758848329fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:04.954861 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ab744-015d-4d34-b084-f758848329fd None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:04.968980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-181ab744-015d-4d34-b084-f758848329fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:04.968980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:04.968980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:04.968980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:04.968980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:04.968980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:04.968980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:04.968980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:04.968980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:04.968980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:04.968980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:04.968980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:04.968980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:04.968980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:04.968980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:04.968980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:04.970306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:04.970306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:04.970306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:04.970306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:04.970306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:04.970306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:04.970306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:04.970306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:04.970306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:04.970306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:04.970306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:04.970306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:04.970306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:04.970306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:04.970306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:04.970306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:04.970306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:04.971766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:04.971766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:04.971766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:04.971766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 258/504] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:04.971766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b4b70-6f9b-4df1-99c3-3e5a5c9b96bd None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:04.971766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b4b70-6f9b-4df1-99c3-3e5a5c9b96bd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:04.972091 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b4b70-6f9b-4df1-99c3-3e5a5c9b96bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:04.979793 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ef815-6b62-4bc8-ba89-0c55939a00f5 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:04.986809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:04.989245 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7d7b4b70-6f9b-4df1-99c3-3e5a5c9b96bd None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:04.990487 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7d7b4b70-6f9b-4df1-99c3-3e5a5c9b96bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:05.012930 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376211f-c84d-4274-aa9a-5bab39d07c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:05.013581 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376211f-c84d-4274-aa9a-5bab39d07c87 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:05.015127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376211f-c84d-4274-aa9a-5bab39d07c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:05.015127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376211f-c84d-4274-aa9a-5bab39d07c87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:05.024771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376211f-c84d-4274-aa9a-5bab39d07c87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:05.026359 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376211f-c84d-4274-aa9a-5bab39d07c87 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:05.036786 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:05.040653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-a376211f-c84d-4274-aa9a-5bab39d07c87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:05.040653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:05.040653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:05.040653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:05.040653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:05.040653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:05.040653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:05.040653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:05.040653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:05.040653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:05.040653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:05.040653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:05.040653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:05.040653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:05.040653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:05.040653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:05.041921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:05.041921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:05.041921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:05.041921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:05.041921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:05.041921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:05.041921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:05.041921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:05.041921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:05.041921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:05.041921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:05.041921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:05.041921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:05.041921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:05.041921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:05.041921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:05.041921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:05.042802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:05.042802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:05.042802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:05.042802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 247/505] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:05.043256 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376211f-c84d-4274-aa9a-5bab39d07c87 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:05.057671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 259/506] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:05.058720 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b4b70-6f9b-4df1-99c3-3e5a5c9b96bd None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:05.156665 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b4b70-6f9b-4df1-99c3-3e5a5c9b96bd None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:05.157772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376211f-c84d-4274-aa9a-5bab39d07c87 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:05.190352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef34e81-b768-4c46-90c0-a83b2913edbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:05.190642 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96e429-7948-4644-929a-ee09203e7c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:05.190943 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef34e81-b768-4c46-90c0-a83b2913edbe None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:05.191219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef34e81-b768-4c46-90c0-a83b2913edbe None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:05.191325 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96e429-7948-4644-929a-ee09203e7c34 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:05.191493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef34e81-b768-4c46-90c0-a83b2913edbe None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:05.191587 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96e429-7948-4644-929a-ee09203e7c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:05.191787 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96e429-7948-4644-929a-ee09203e7c34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:05.192213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef34e81-b768-4c46-90c0-a83b2913edbe None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:05.192510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef34e81-b768-4c46-90c0-a83b2913edbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:05.193965 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef34e81-b768-4c46-90c0-a83b2913edbe None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:05.201588 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96e429-7948-4644-929a-ee09203e7c34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:05.207442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-2d96e429-7948-4644-929a-ee09203e7c34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:05.207442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:05.207442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:05.207442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:05.207442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:05.207442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:05.207442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:05.207442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:05.207442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:05.207442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:05.207442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:05.207442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:05.207442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:05.207442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:05.207442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:05.207442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:05.208378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:05.208378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:05.208378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:05.208378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:05.208378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:05.208378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:05.208378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:05.208378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:05.208378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:05.208378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:05.208378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:05.208378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:05.208378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:05.208378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:05.208378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:05.208378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:05.209171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:05.209171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:05.209171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:05.209171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:05.209171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:05.209171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:05.209171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:05.209171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:05.209171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:05.209171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:05.209171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:05.209171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:05.209171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 248/507] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:05.209918 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96e429-7948-4644-929a-ee09203e7c34 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:05.232504 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 260/508] 10.222.0.65 () {56 vars in 1137 bytes} [Tue Aug 9 19:00:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:05.232504 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef34e81-b768-4c46-90c0-a83b2913edbe None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:05.235972 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:05.284831 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:05.317328 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96e429-7948-4644-929a-ee09203e7c34 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:05.341730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef34e81-b768-4c46-90c0-a83b2913edbe None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:05.351137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029171d-597d-453f-893a-287b637ca8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:05.351745 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029171d-597d-453f-893a-287b637ca8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:05.352021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029171d-597d-453f-893a-287b637ca8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:05.352288 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029171d-597d-453f-893a-287b637ca8f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:05.352912 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029171d-597d-453f-893a-287b637ca8f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:05.353209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029171d-597d-453f-893a-287b637ca8f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:05.354613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029171d-597d-453f-893a-287b637ca8f2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:05.366899 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 249/509] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:05.367683 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029171d-597d-453f-893a-287b637ca8f2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:05.375978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868b957-be06-476d-961d-be0e2782c49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:05.376583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868b957-be06-476d-961d-be0e2782c49d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:05.376863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868b957-be06-476d-961d-be0e2782c49d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:05.377135 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868b957-be06-476d-961d-be0e2782c49d None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:05.377812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868b957-be06-476d-961d-be0e2782c49d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:05.378115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868b957-be06-476d-961d-be0e2782c49d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:05.379501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868b957-be06-476d-961d-be0e2782c49d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:05.390647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 261/510] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:05.391944 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868b957-be06-476d-961d-be0e2782c49d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:05.455075 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:05.476039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029171d-597d-453f-893a-287b637ca8f2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:05.487295 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:05.490102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868b957-be06-476d-961d-be0e2782c49d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:05.513414 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5a9b7-b2db-4f0f-ba76-c0e4b4f780d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:05.514611 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5a9b7-b2db-4f0f-ba76-c0e4b4f780d2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:05.514890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5a9b7-b2db-4f0f-ba76-c0e4b4f780d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:05.515160 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5a9b7-b2db-4f0f-ba76-c0e4b4f780d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:05.524943 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b49474-d30d-432c-a47e-4b30d6ed0ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:05.525571 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b49474-d30d-432c-a47e-4b30d6ed0ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:05.525853 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b49474-d30d-432c-a47e-4b30d6ed0ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:05.526069 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5a9b7-b2db-4f0f-ba76-c0e4b4f780d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:05.526160 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b49474-d30d-432c-a47e-4b30d6ed0ca8 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:05.526776 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b49474-d30d-432c-a47e-4b30d6ed0ca8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:05.527083 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b49474-d30d-432c-a47e-4b30d6ed0ca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:05.527510 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5a9b7-b2db-4f0f-ba76-c0e4b4f780d2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:05.528440 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b49474-d30d-432c-a47e-4b30d6ed0ca8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:05.536792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 262/511] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:00:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:05.537634 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b49474-d30d-432c-a47e-4b30d6ed0ca8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:05.541609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-51d5a9b7-b2db-4f0f-ba76-c0e4b4f780d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:05.541609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:05.541609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:05.541609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:05.541609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:05.541609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:05.541609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:05.541609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:05.541609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:05.541609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:05.541609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:05.541609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:05.541609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:05.541609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:05.541609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:05.541609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:05.542649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:05.542649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:05.542649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:05.542649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:05.542649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:05.542649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:05.542649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:05.542649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:05.542649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:05.542649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:05.542649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:05.542649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:05.542649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:05.542649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:05.542649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:05.542649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:05.542649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:05.543892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:05.543892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:05.543892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:05.543892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 250/512] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:05.543892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5a9b7-b2db-4f0f-ba76-c0e4b4f780d2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:05.640502 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b49474-d30d-432c-a47e-4b30d6ed0ca8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:05.645490 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5a9b7-b2db-4f0f-ba76-c0e4b4f780d2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:05.673133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6649343-d1cc-4b83-a77f-aa078c3aab37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:05.673855 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6649343-d1cc-4b83-a77f-aa078c3aab37 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:05.673971 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:05.674399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6649343-d1cc-4b83-a77f-aa078c3aab37 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:05.674399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6649343-d1cc-4b83-a77f-aa078c3aab37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:05.679474 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c8f66-f204-48bb-8eb9-0e43069709bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:05.680096 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c8f66-f204-48bb-8eb9-0e43069709bc None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:05.680375 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c8f66-f204-48bb-8eb9-0e43069709bc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:05.680649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c8f66-f204-48bb-8eb9-0e43069709bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:05.687271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c8f66-f204-48bb-8eb9-0e43069709bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:05.689472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c8f66-f204-48bb-8eb9-0e43069709bc None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:05.701102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-d84c8f66-f204-48bb-8eb9-0e43069709bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:05.701102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:05.701102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:05.701102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:05.701102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:05.701102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:05.701102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:05.701102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:05.701102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:05.701102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:05.701102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:05.701102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:05.701102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:05.701102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:05.701102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:05.702038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:05.702038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:05.702038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:05.702038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:05.702038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:05.702038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:05.702038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:05.702038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:05.702038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:05.702038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:05.702038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:05.702038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:05.702038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:05.702038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:05.702038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:05.702038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:05.702038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:05.702879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:05.702879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:05.702879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:05.702879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:05.702879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:05.702879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:05.702879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:05.702879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:05.702879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 251/513] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:05.703361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c8f66-f204-48bb-8eb9-0e43069709bc None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:05.708921 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:05.746711 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6649343-d1cc-4b83-a77f-aa078c3aab37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:05.748107 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6649343-d1cc-4b83-a77f-aa078c3aab37 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:05.802623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c8f66-f204-48bb-8eb9-0e43069709bc None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:05.836656 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930b005-623e-4b7c-9ad3-b576a291de25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:05.837274 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930b005-623e-4b7c-9ad3-b576a291de25 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:05.837580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930b005-623e-4b7c-9ad3-b576a291de25 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:05.837855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930b005-623e-4b7c-9ad3-b576a291de25 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:05.845202 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930b005-623e-4b7c-9ad3-b576a291de25 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:05.845419 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 263/514] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:00:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 19:00:05.846310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6649343-d1cc-4b83-a77f-aa078c3aab37 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:05.846672 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930b005-623e-4b7c-9ad3-b576a291de25 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:05.860625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-7930b005-623e-4b7c-9ad3-b576a291de25 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 19:00:05.860625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:05.860625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:05.860625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:05.860625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:05.860625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:05.860625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:05.860625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:05.860625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:05.860625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:05.860625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:05.860625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:05.860625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:05.860625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:05.860625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:05.860625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:05.861700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:05.861700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:05.861700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:05.861700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:05.861700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:05.861700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:05.861700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:05.861700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:05.861700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:05.861700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:05.861700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:05.861700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:05.861700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:05.861700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:05.861700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:05.861700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:05.861700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:05.861700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:05.862721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:05.862721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:05.862721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:05.862721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:05.862721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:05.862721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:05.862721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:05.862721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:05.862721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 19:00:05.862721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:05.862721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 252/515] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:00:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:05.862721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930b005-623e-4b7c-9ad3-b576a291de25 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:05.911335 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:05.915490 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:05.949627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6649343-d1cc-4b83-a77f-aa078c3aab37 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:05.963847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930b005-623e-4b7c-9ad3-b576a291de25 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:05.982701 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e4bc4-750d-4675-87fc-8f4dc5b7cbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:05.983318 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e4bc4-750d-4675-87fc-8f4dc5b7cbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:05.983596 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e4bc4-750d-4675-87fc-8f4dc5b7cbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:05.983866 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e4bc4-750d-4675-87fc-8f4dc5b7cbd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:05.994693 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e4bc4-750d-4675-87fc-8f4dc5b7cbd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:05.996149 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e4bc4-750d-4675-87fc-8f4dc5b7cbd0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:05.998534 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb41ed2-c4c4-4894-9636-bb626ec41304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:05.999078 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb41ed2-c4c4-4894-9636-bb626ec41304 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:05.999373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb41ed2-c4c4-4894-9636-bb626ec41304 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:05.999642 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb41ed2-c4c4-4894-9636-bb626ec41304 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:06.000297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb41ed2-c4c4-4894-9636-bb626ec41304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:06.000676 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb41ed2-c4c4-4894-9636-bb626ec41304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:06.002073 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb41ed2-c4c4-4894-9636-bb626ec41304 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:06.010058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-364e4bc4-750d-4675-87fc-8f4dc5b7cbd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:06.010058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:06.010058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:06.010058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:06.010058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:06.010058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:06.010058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:06.010058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:06.010058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:06.010058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:06.010058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:06.010058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:06.010058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:06.010058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:06.010058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:06.010058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:06.011017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:06.011017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:06.011017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:06.011017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:06.011017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:06.011017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:06.011017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:06.011017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:06.011017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:06.011017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:06.011017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:06.011017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:06.011017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:06.011017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:06.011017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:06.011017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:06.011017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:06.011992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:06.011992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:06.011992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:06.012354 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 264/516] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:06.013167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e4bc4-750d-4675-87fc-8f4dc5b7cbd0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:06.013707 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 253/517] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:06.014346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb41ed2-c4c4-4894-9636-bb626ec41304 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:06.113145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb41ed2-c4c4-4894-9636-bb626ec41304 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:06.117367 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e4bc4-750d-4675-87fc-8f4dc5b7cbd0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:06.124031 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:06.131339 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:06.147212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c71600-cbc1-4b99-9bfb-f09f8fc9c581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:06.147835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c71600-cbc1-4b99-9bfb-f09f8fc9c581 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:06.148120 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c71600-cbc1-4b99-9bfb-f09f8fc9c581 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:06.148392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c71600-cbc1-4b99-9bfb-f09f8fc9c581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:06.150913 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef58ea-8763-45bd-86a9-75394714e952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:06.151509 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef58ea-8763-45bd-86a9-75394714e952 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:06.151810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef58ea-8763-45bd-86a9-75394714e952 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:06.152081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef58ea-8763-45bd-86a9-75394714e952 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:06.152766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef58ea-8763-45bd-86a9-75394714e952 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:06.153076 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef58ea-8763-45bd-86a9-75394714e952 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:06.154537 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef58ea-8763-45bd-86a9-75394714e952 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:06.158862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c71600-cbc1-4b99-9bfb-f09f8fc9c581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:06.160316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c71600-cbc1-4b99-9bfb-f09f8fc9c581 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:06.172162 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 265/518] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:06.173283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef58ea-8763-45bd-86a9-75394714e952 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:06.175241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-09c71600-cbc1-4b99-9bfb-f09f8fc9c581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:06.175241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:06.175241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:06.175241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:06.175241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:06.175241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:06.175241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:06.175241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:06.175241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:06.175241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:06.175241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:06.175241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:06.175241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:06.175241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:06.175241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:06.175241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:06.176133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:06.176133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:06.176133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:06.176133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:06.176133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:06.176133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:06.176133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:06.176133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:06.176133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:06.176133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:06.176133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:06.176133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:06.176133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:06.176133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:06.176133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:06.176133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:06.176133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:06.176972 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:06.176972 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:06.176972 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:06.176972 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 254/519] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:06.177902 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c71600-cbc1-4b99-9bfb-f09f8fc9c581 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:06.275172 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef58ea-8763-45bd-86a9-75394714e952 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:06.276432 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c71600-cbc1-4b99-9bfb-f09f8fc9c581 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:06.308308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29058f6c-3fac-4316-ab5c-261d81420561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:06.308912 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29058f6c-3fac-4316-ab5c-261d81420561 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:06.309191 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29058f6c-3fac-4316-ab5c-261d81420561 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:06.309485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29058f6c-3fac-4316-ab5c-261d81420561 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:06.309781 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c601f98-866c-4943-b5b9-e876b3446226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:06.310214 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29058f6c-3fac-4316-ab5c-261d81420561 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:06.310381 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c601f98-866c-4943-b5b9-e876b3446226 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:06.310523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29058f6c-3fac-4316-ab5c-261d81420561 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:06.310660 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c601f98-866c-4943-b5b9-e876b3446226 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:06.310944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c601f98-866c-4943-b5b9-e876b3446226 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:06.311553 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c601f98-866c-4943-b5b9-e876b3446226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:06.311851 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c601f98-866c-4943-b5b9-e876b3446226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:06.311976 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29058f6c-3fac-4316-ab5c-261d81420561 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:06.313929 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c601f98-866c-4943-b5b9-e876b3446226 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:06.326500 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 255/520] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:06.327267 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c601f98-866c-4943-b5b9-e876b3446226 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:06.329525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 266/521] 10.222.0.65 () {56 vars in 1137 bytes} [Tue Aug 9 19:00:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:06.330585 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29058f6c-3fac-4316-ab5c-261d81420561 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:06.352259 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:06.361161 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:06.426480 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c601f98-866c-4943-b5b9-e876b3446226 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:06.428293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29058f6c-3fac-4316-ab5c-261d81420561 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:06.460542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f4839-ad83-4dd4-bca2-c2db602c286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:06.461147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f4839-ad83-4dd4-bca2-c2db602c286b None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:06.461424 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f4839-ad83-4dd4-bca2-c2db602c286b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:06.461725 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f4839-ad83-4dd4-bca2-c2db602c286b None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:06.462257 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4843c75-1f4b-4049-b93d-1e73b3a2bc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:06.462409 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f4839-ad83-4dd4-bca2-c2db602c286b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:06.462859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4843c75-1f4b-4049-b93d-1e73b3a2bc00 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:06.463140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4843c75-1f4b-4049-b93d-1e73b3a2bc00 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:06.463413 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4843c75-1f4b-4049-b93d-1e73b3a2bc00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:06.463909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f4839-ad83-4dd4-bca2-c2db602c286b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:06.464137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4843c75-1f4b-4049-b93d-1e73b3a2bc00 None admin] RBAC: Adding query filter params (role.id=973d37db3ba74af0b63e3570ab311e21, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=2cfda1bec35145f3bbcc13fae0b7af2e) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:06.464445 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4843c75-1f4b-4049-b93d-1e73b3a2bc00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:06.465908 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4843c75-1f4b-4049-b93d-1e73b3a2bc00 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:06.472074 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 267/522] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:00:06 2022] GET /identity/v3/role_assignments?user.id=2cfda1bec35145f3bbcc13fae0b7af2e&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=973d37db3ba74af0b63e3570ab311e21 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:06.472782 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4843c75-1f4b-4049-b93d-1e73b3a2bc00 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:06.540090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 256/523] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Aug 9 19:00:06 2022] POST /identity/v3/users => generated 247 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:00:06.541269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f4839-ad83-4dd4-bca2-c2db602c286b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:06.616733 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:06.624457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4843c75-1f4b-4049-b93d-1e73b3a2bc00 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:06.654929 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:06.677704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168264f1-6354-46d5-a5b9-ded86a8fb2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:06.678581 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168264f1-6354-46d5-a5b9-ded86a8fb2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:06.679010 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168264f1-6354-46d5-a5b9-ded86a8fb2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:06.679456 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168264f1-6354-46d5-a5b9-ded86a8fb2c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:06.680271 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168264f1-6354-46d5-a5b9-ded86a8fb2c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:06.680725 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168264f1-6354-46d5-a5b9-ded86a8fb2c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:06.682319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168264f1-6354-46d5-a5b9-ded86a8fb2c7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:06.690238 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f4839-ad83-4dd4-bca2-c2db602c286b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:06.703247 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 268/524] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:06.705078 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168264f1-6354-46d5-a5b9-ded86a8fb2c7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:06.737533 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8cb00-b5b0-4996-bc4a-47ea6bd6b2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:06.738428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8cb00-b5b0-4996-bc4a-47ea6bd6b2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:06.738901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8cb00-b5b0-4996-bc4a-47ea6bd6b2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:06.739189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8cb00-b5b0-4996-bc4a-47ea6bd6b2d8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:06.748492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8cb00-b5b0-4996-bc4a-47ea6bd6b2d8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:06.751497 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8cb00-b5b0-4996-bc4a-47ea6bd6b2d8 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:06.771058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-20f8cb00-b5b0-4996-bc4a-47ea6bd6b2d8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 19:00:06.771058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:06.771058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:06.771058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:06.771058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:06.771058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:06.771058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:06.771058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:06.771058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:06.771058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:06.771058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:06.771058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:06.771058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:06.771058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:06.771058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:06.771058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:06.772084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:06.772084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:06.772084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:06.772084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:06.772084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:06.772084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:06.772084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:06.772084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:06.772084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:06.772084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:06.772084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:06.772084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:06.772084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:06.772084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:06.772084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:06.772084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:06.772084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:06.772084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:06.772969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:06.772969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:06.772969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:06.772969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:06.772969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:06.772969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:06.772969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:06.772969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:06.772969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 19:00:06.772969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:06.772969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 257/525] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:06.773600 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8cb00-b5b0-4996-bc4a-47ea6bd6b2d8 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:06.830477 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168264f1-6354-46d5-a5b9-ded86a8fb2c7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:06.875222 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f8455-c2e3-414a-8340-677f6aa5e514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:06.876051 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f8455-c2e3-414a-8340-677f6aa5e514 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:06.876572 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f8455-c2e3-414a-8340-677f6aa5e514 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:06.877246 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f8455-c2e3-414a-8340-677f6aa5e514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:06.901816 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8cb00-b5b0-4996-bc4a-47ea6bd6b2d8 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:06.913893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:06.951519 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308f7b7-5074-49d1-872a-d69ca91cba60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:06.952398 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308f7b7-5074-49d1-872a-d69ca91cba60 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:06.952785 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308f7b7-5074-49d1-872a-d69ca91cba60 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:06.953130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308f7b7-5074-49d1-872a-d69ca91cba60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:06.963017 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308f7b7-5074-49d1-872a-d69ca91cba60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:06.964870 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308f7b7-5074-49d1-872a-d69ca91cba60 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:06.966845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:06.967831 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f8455-c2e3-414a-8340-677f6aa5e514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:06.969620 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f8455-c2e3-414a-8340-677f6aa5e514 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:06.983549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-9308f7b7-5074-49d1-872a-d69ca91cba60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:06.983549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:06.983549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:06.983549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:06.983549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:06.983549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:06.983549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:06.983549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:06.983549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:06.983549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:06.983549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:06.983549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:06.983549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:06.983549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:06.983549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:06.984714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:06.984714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:06.984714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:06.984714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:06.984714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:06.984714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:06.984714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:06.984714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:06.984714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:06.984714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:06.984714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:06.984714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:06.984714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:06.984714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:06.984714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:06.984714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:06.984714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:06.986351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:06.986351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:06.986351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:06.986351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:06.986351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:06.986351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:06.986351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:06.986351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:06.987507 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 258/526] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:06.992740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308f7b7-5074-49d1-872a-d69ca91cba60 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:07.087136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 269/527] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:00:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 19:00:07.088013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f8455-c2e3-414a-8340-677f6aa5e514 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:07.129955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308f7b7-5074-49d1-872a-d69ca91cba60 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:07.160487 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:07.169121 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1574e4-3fc2-4183-8a68-342620307cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:07.179177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1574e4-3fc2-4183-8a68-342620307cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:07.179177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1574e4-3fc2-4183-8a68-342620307cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:07.179177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1574e4-3fc2-4183-8a68-342620307cc6 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:07.179177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1574e4-3fc2-4183-8a68-342620307cc6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:07.179177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1574e4-3fc2-4183-8a68-342620307cc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:07.179177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1574e4-3fc2-4183-8a68-342620307cc6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:07.192934 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 259/528] 10.222.0.65 () {56 vars in 1139 bytes} [Tue Aug 9 19:00:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:07.194069 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1574e4-3fc2-4183-8a68-342620307cc6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:07.207623 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f8455-c2e3-414a-8340-677f6aa5e514 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:07.245708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25beba-4156-4791-a6c1-f479886e101a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:07.246320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25beba-4156-4791-a6c1-f479886e101a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:07.246614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25beba-4156-4791-a6c1-f479886e101a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:07.246873 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25beba-4156-4791-a6c1-f479886e101a None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:07.247569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25beba-4156-4791-a6c1-f479886e101a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:07.247871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25beba-4156-4791-a6c1-f479886e101a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:07.249435 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25beba-4156-4791-a6c1-f479886e101a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:07.269260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 270/529] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:07.269260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25beba-4156-4791-a6c1-f479886e101a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:07.276349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:07.334135 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1574e4-3fc2-4183-8a68-342620307cc6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:07.380949 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4399d-a781-4dc5-9119-d02f7a8c0731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:07.382317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4399d-a781-4dc5-9119-d02f7a8c0731 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:07.382803 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4399d-a781-4dc5-9119-d02f7a8c0731 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:07.383217 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4399d-a781-4dc5-9119-d02f7a8c0731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:07.388831 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25beba-4156-4791-a6c1-f479886e101a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:07.394819 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4399d-a781-4dc5-9119-d02f7a8c0731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:07.396475 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4399d-a781-4dc5-9119-d02f7a8c0731 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:07.409838 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:07.414276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-eec4399d-a781-4dc5-9119-d02f7a8c0731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:07.414276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:07.414276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:07.414276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:07.414276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:07.414276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:07.414276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:07.414276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:07.414276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:07.414276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:07.414276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:07.414276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:07.414276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:07.414276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:07.414276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:07.414276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:07.415373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:07.415373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:07.415373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:07.415373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:07.415373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:07.415373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:07.415373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:07.415373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:07.415373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:07.415373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:07.415373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:07.415373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:07.415373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:07.415373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:07.415373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:07.415373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:07.415373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:07.416395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:07.416395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:07.416395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:07.422471 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 260/530] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:07.423625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4399d-a781-4dc5-9119-d02f7a8c0731 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:07.429617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dffcf2-666b-48cc-a112-eb1c3b3b4422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:07.430233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dffcf2-666b-48cc-a112-eb1c3b3b4422 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:07.430580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dffcf2-666b-48cc-a112-eb1c3b3b4422 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:07.430860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dffcf2-666b-48cc-a112-eb1c3b3b4422 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:07.526860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dffcf2-666b-48cc-a112-eb1c3b3b4422 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:07.534860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dffcf2-666b-48cc-a112-eb1c3b3b4422 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:07.558509 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4399d-a781-4dc5-9119-d02f7a8c0731 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:07.568398 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:07.595059 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed90cb6-d835-4f43-a1fe-79881c8c1bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:07.596000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed90cb6-d835-4f43-a1fe-79881c8c1bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:07.596484 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed90cb6-d835-4f43-a1fe-79881c8c1bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:07.596927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed90cb6-d835-4f43-a1fe-79881c8c1bc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:07.597899 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed90cb6-d835-4f43-a1fe-79881c8c1bc1 None admin] RBAC: Adding query filter params (role.id=973d37db3ba74af0b63e3570ab311e21, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=98d8000eb20445b78ee56ac372cd024c) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:07.598398 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed90cb6-d835-4f43-a1fe-79881c8c1bc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:07.600065 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed90cb6-d835-4f43-a1fe-79881c8c1bc1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:07.606907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 261/531] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:00:07 2022] GET /identity/v3/role_assignments?user.id=98d8000eb20445b78ee56ac372cd024c&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=973d37db3ba74af0b63e3570ab311e21 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:07.607900 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed90cb6-d835-4f43-a1fe-79881c8c1bc1 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:07.694261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 271/532] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:00:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 19:00:07.699555 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dffcf2-666b-48cc-a112-eb1c3b3b4422 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:07.738646 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:07.802120 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed90cb6-d835-4f43-a1fe-79881c8c1bc1 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:07.850335 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3c33e-af3d-46ec-8576-0dac5d510ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:07.851302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3c33e-af3d-46ec-8576-0dac5d510ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:07.851760 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3c33e-af3d-46ec-8576-0dac5d510ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:07.852223 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3c33e-af3d-46ec-8576-0dac5d510ab7 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:07.853084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3c33e-af3d-46ec-8576-0dac5d510ab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:07.853619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3c33e-af3d-46ec-8576-0dac5d510ab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:07.855420 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3c33e-af3d-46ec-8576-0dac5d510ab7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:07.869481 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dffcf2-666b-48cc-a112-eb1c3b3b4422 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:07.877104 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 262/533] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:07.890907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3c33e-af3d-46ec-8576-0dac5d510ab7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:07.915949 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dcee8-4bb7-48c4-9da4-7bbf19dffc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:07.916699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dcee8-4bb7-48c4-9da4-7bbf19dffc4c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:07.916988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dcee8-4bb7-48c4-9da4-7bbf19dffc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:07.917264 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dcee8-4bb7-48c4-9da4-7bbf19dffc4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:07.940223 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:07.945843 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295dcee8-4bb7-48c4-9da4-7bbf19dffc4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:07.947304 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295dcee8-4bb7-48c4-9da4-7bbf19dffc4c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:07.978383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-295dcee8-4bb7-48c4-9da4-7bbf19dffc4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:07.978383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:07.978383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:07.978383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:07.978383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:07.978383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:07.978383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:07.978383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:07.978383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:07.978383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:07.978383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:07.978383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:07.978383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:07.978383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:07.978383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:07.978383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:07.979377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:07.979377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:07.979377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:07.979377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:07.979377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:07.979377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:07.979377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:07.979377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:07.979377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:07.979377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:07.979377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:07.979377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:07.979377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:07.979377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:07.979377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:07.979377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:07.979377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:07.980473 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:07.980473 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:07.980473 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:07.980473 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 272/534] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:07.986845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dcee8-4bb7-48c4-9da4-7bbf19dffc4c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:08.009004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3c33e-af3d-46ec-8576-0dac5d510ab7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:08.046934 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152a18f-95db-4186-8a44-22c447614edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:08.047988 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152a18f-95db-4186-8a44-22c447614edd None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:08.048443 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152a18f-95db-4186-8a44-22c447614edd None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:08.048858 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152a18f-95db-4186-8a44-22c447614edd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:08.057000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152a18f-95db-4186-8a44-22c447614edd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:08.058689 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152a18f-95db-4186-8a44-22c447614edd None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:08.071334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-f152a18f-95db-4186-8a44-22c447614edd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:08.071334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:08.071334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:08.071334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:08.071334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:08.071334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:08.071334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:08.071334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:08.071334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:08.071334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:08.071334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:08.071334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:08.071334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:08.071334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:08.071334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:08.072407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:08.072407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:08.072407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:08.072407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:08.072407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:08.072407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:08.072407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:08.072407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:08.072407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:08.072407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:08.072407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:08.072407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:08.072407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:08.072407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:08.072407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:08.072407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:08.072407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:08.073499 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:08.073499 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:08.073499 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:08.073499 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:08.073499 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:08.073499 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:08.073499 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:08.073499 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:08.076005 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 263/535] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:08.082306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152a18f-95db-4186-8a44-22c447614edd None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:08.157823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:08.217572 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dcee8-4bb7-48c4-9da4-7bbf19dffc4c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:08.241370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:08.246087 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152a18f-95db-4186-8a44-22c447614edd None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:08.280770 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec09644-5024-4d8c-ad85-5a7f973a9559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:08.282243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec09644-5024-4d8c-ad85-5a7f973a9559 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:08.282844 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec09644-5024-4d8c-ad85-5a7f973a9559 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:08.283512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec09644-5024-4d8c-ad85-5a7f973a9559 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:08.284318 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec09644-5024-4d8c-ad85-5a7f973a9559 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:08.285587 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec09644-5024-4d8c-ad85-5a7f973a9559 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:08.289888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec09644-5024-4d8c-ad85-5a7f973a9559 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:08.308821 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 273/536] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:08.315662 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec09644-5024-4d8c-ad85-5a7f973a9559 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:08.321211 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29c8d1-b49b-47e9-b3f0-7b9feef7a1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:08.322047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29c8d1-b49b-47e9-b3f0-7b9feef7a1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:08.323367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29c8d1-b49b-47e9-b3f0-7b9feef7a1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:08.323792 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29c8d1-b49b-47e9-b3f0-7b9feef7a1c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:08.328868 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29c8d1-b49b-47e9-b3f0-7b9feef7a1c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:08.329581 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29c8d1-b49b-47e9-b3f0-7b9feef7a1c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:08.331201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29c8d1-b49b-47e9-b3f0-7b9feef7a1c7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:08.358680 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 264/537] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:08.365067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29c8d1-b49b-47e9-b3f0-7b9feef7a1c7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:08.524214 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29c8d1-b49b-47e9-b3f0-7b9feef7a1c7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:08.538292 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec09644-5024-4d8c-ad85-5a7f973a9559 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:08.581848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:08.591697 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee3690-3dae-4e6f-bd58-6f73b7e2f18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:08.592650 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee3690-3dae-4e6f-bd58-6f73b7e2f18c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:08.593096 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee3690-3dae-4e6f-bd58-6f73b7e2f18c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:08.593538 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee3690-3dae-4e6f-bd58-6f73b7e2f18c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:08.595300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee3690-3dae-4e6f-bd58-6f73b7e2f18c None admin] RBAC: Adding query filter params (role.id=973d37db3ba74af0b63e3570ab311e21, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=bca1eca610c64b3a8ab04792dcca18b3) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:08.595786 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee3690-3dae-4e6f-bd58-6f73b7e2f18c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:08.602143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d55cf-8f21-4aa6-9aef-553ad98dd370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:08.602785 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d55cf-8f21-4aa6-9aef-553ad98dd370 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:08.605566 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d55cf-8f21-4aa6-9aef-553ad98dd370 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:08.605566 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d55cf-8f21-4aa6-9aef-553ad98dd370 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:08.605763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee3690-3dae-4e6f-bd58-6f73b7e2f18c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:08.614019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d55cf-8f21-4aa6-9aef-553ad98dd370 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:08.615530 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7d55cf-8f21-4aa6-9aef-553ad98dd370 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:08.618955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 265/538] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:00:08 2022] GET /identity/v3/role_assignments?user.id=bca1eca610c64b3a8ab04792dcca18b3&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=973d37db3ba74af0b63e3570ab311e21 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:08.620054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97960f-bffc-48a3-aa71-a7b2f54aebab None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:08.620344 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97960f-bffc-48a3-aa71-a7b2f54aebab None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:08.620617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97960f-bffc-48a3-aa71-a7b2f54aebab None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:08.621935 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 266/539] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:08.634591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-4b7d55cf-8f21-4aa6-9aef-553ad98dd370 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:08.634591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:08.634591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:08.634591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:08.634591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:08.634591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:08.634591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:08.634591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:08.634591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:08.634591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:08.634591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:08.634591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:08.634591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:08.634591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:08.634591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:08.635698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:08.635698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:08.635698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:08.635698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:08.635698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:08.635698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:08.635698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:08.635698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:08.635698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:08.635698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:08.635698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:08.635698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:08.635698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:08.635698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:08.635698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:08.635698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:08.635698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:08.636777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:08.636777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:08.636777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:08.636777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:08.636777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:08.636777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:08.636777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:08.636777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:08.636777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 274/540] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:08.642361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5df142-24fe-49af-8276-b0e1d61514a1 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:08.642631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5df142-24fe-49af-8276-b0e1d61514a1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:08.642899 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5df142-24fe-49af-8276-b0e1d61514a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:08.647559 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d55cf-8f21-4aa6-9aef-553ad98dd370 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:08.676531 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4f5df142-24fe-49af-8276-b0e1d61514a1 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:08.677813 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4f5df142-24fe-49af-8276-b0e1d61514a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:08.705845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:08.804291 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 267/541] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:08.828232 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5df142-24fe-49af-8276-b0e1d61514a1 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:08.852727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d55cf-8f21-4aa6-9aef-553ad98dd370 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:08.915960 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962e5f5-d241-409e-b488-75bce40b0993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:08.917404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962e5f5-d241-409e-b488-75bce40b0993 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:08.917912 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962e5f5-d241-409e-b488-75bce40b0993 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:08.918365 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962e5f5-d241-409e-b488-75bce40b0993 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:08.919240 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962e5f5-d241-409e-b488-75bce40b0993 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:08.919727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962e5f5-d241-409e-b488-75bce40b0993 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:08.921393 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962e5f5-d241-409e-b488-75bce40b0993 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:08.934982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 275/542] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:08.936602 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15a1c2-51c1-49b0-b0fb-10b9e7b5da6a None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:08.937091 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15a1c2-51c1-49b0-b0fb-10b9e7b5da6a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:08.937641 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15a1c2-51c1-49b0-b0fb-10b9e7b5da6a None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:08.944481 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 276/543] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:08.945609 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15a1c2-51c1-49b0-b0fb-10b9e7b5da6a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:08.962030 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5df142-24fe-49af-8276-b0e1d61514a1 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:09.000306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f1255-7943-4e1c-87b2-cf9780bf90a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:09.001219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f1255-7943-4e1c-87b2-cf9780bf90a2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:09.001553 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f1255-7943-4e1c-87b2-cf9780bf90a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:09.001789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f1255-7943-4e1c-87b2-cf9780bf90a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:09.012632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f1255-7943-4e1c-87b2-cf9780bf90a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:09.017370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-0b2f1255-7943-4e1c-87b2-cf9780bf90a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:09.017370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:09.017370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:09.017370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:09.017370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:09.017370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:09.017370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:09.017370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:09.017370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:09.017370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:09.017370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:09.017370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:09.017370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:09.017370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:09.017370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:09.017370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:09.018301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:09.018301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:09.018301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:09.018301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:09.018301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:09.018301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:09.018301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:09.018301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:09.018301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:09.018301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:09.018301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:09.018301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:09.018301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:09.018301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:09.018301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:09.018301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:09.019093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:09.019093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:09.019093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:09.019093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:09.019093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:09.019093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:09.019093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:09.019093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:09.019093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:09.019093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:09.019093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:09.019093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:09.019093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 268/544] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:09.019757 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:09.024979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b5d34-eadf-410f-bf95-4baf5704a3bf None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:09.024979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b5d34-eadf-410f-bf95-4baf5704a3bf None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:09.024979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b5d34-eadf-410f-bf95-4baf5704a3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:09.037832 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:09.041307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-135b5d34-eadf-410f-bf95-4baf5704a3bf None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:09.041307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-135b5d34-eadf-410f-bf95-4baf5704a3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:09.081572 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15a1c2-51c1-49b0-b0fb-10b9e7b5da6a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:09.108500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dab49-609c-4f04-826c-cf273fc95354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:09.109484 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dab49-609c-4f04-826c-cf273fc95354 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:09.110715 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dab49-609c-4f04-826c-cf273fc95354 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:09.111363 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dab49-609c-4f04-826c-cf273fc95354 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:09.112339 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dab49-609c-4f04-826c-cf273fc95354 None admin] RBAC: Adding query filter params (role.id=973d37db3ba74af0b63e3570ab311e21, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=a62d954163ca4bf298f461b4d253269e) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:09.112851 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dab49-609c-4f04-826c-cf273fc95354 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:09.114625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dab49-609c-4f04-826c-cf273fc95354 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:09.117689 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 269/545] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:09.118587 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b5d34-eadf-410f-bf95-4baf5704a3bf None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:09.121792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 277/546] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:00:08 2022] GET /identity/v3/role_assignments?user.id=a62d954163ca4bf298f461b4d253269e&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=973d37db3ba74af0b63e3570ab311e21 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:09.138756 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dab49-609c-4f04-826c-cf273fc95354 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:09.318270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b5d34-eadf-410f-bf95-4baf5704a3bf None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:09.327697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dab49-609c-4f04-826c-cf273fc95354 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:09.343004 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:09.388148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d9eb1-0c6a-4379-89ad-a77598c803be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:09.388766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d9eb1-0c6a-4379-89ad-a77598c803be None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:09.389046 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d9eb1-0c6a-4379-89ad-a77598c803be None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:09.389316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d9eb1-0c6a-4379-89ad-a77598c803be None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:09.390015 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d9eb1-0c6a-4379-89ad-a77598c803be None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:09.390369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d9eb1-0c6a-4379-89ad-a77598c803be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:09.391585 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f29dc5-133e-4407-a64b-87015de4989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:09.392530 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d9eb1-0c6a-4379-89ad-a77598c803be None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:09.393003 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f29dc5-133e-4407-a64b-87015de4989e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:09.393507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f29dc5-133e-4407-a64b-87015de4989e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:09.393980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f29dc5-133e-4407-a64b-87015de4989e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:09.394953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:09.402713 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 270/547] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:00:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:09.410557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d9eb1-0c6a-4379-89ad-a77598c803be None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:09.419356 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f29dc5-133e-4407-a64b-87015de4989e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:09.425598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-43f29dc5-133e-4407-a64b-87015de4989e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:09.425598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:09.425598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:09.425598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:09.425598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:09.425598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:09.425598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:09.425598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:09.425598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:09.425598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:09.425598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:09.425598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:09.425598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:09.425598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:09.425598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:09.425598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:09.426480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:09.426480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:09.426480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:09.426480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:09.426480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:09.426480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:09.426480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:09.426480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:09.426480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:09.426480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:09.426480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:09.426480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:09.426480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:09.426480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:09.426480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:09.426480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:09.427352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:09.427352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:09.427352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:09.427352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:09.427352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:09.427352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:09.427352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:09.427352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:09.427352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:09.427352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:09.427352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:09.427352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:09.431743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 278/548] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:09.434268 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f29dc5-133e-4407-a64b-87015de4989e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:09.608220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d9eb1-0c6a-4379-89ad-a77598c803be None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:09.635991 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f29dc5-133e-4407-a64b-87015de4989e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:09.676051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5bea1-1f7f-4054-9060-0c9be1fe88da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:09.677647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5bea1-1f7f-4054-9060-0c9be1fe88da None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:09.678258 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5bea1-1f7f-4054-9060-0c9be1fe88da None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:09.679846 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5bea1-1f7f-4054-9060-0c9be1fe88da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:09.698148 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa445bb6-23eb-478c-b714-457b2f8b2f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:09.699131 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa445bb6-23eb-478c-b714-457b2f8b2f6d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:09.699646 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa445bb6-23eb-478c-b714-457b2f8b2f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:09.700105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa445bb6-23eb-478c-b714-457b2f8b2f6d None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:09.701036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa445bb6-23eb-478c-b714-457b2f8b2f6d None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:09.701990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa445bb6-23eb-478c-b714-457b2f8b2f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:09.703016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5bea1-1f7f-4054-9060-0c9be1fe88da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:09.705411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa445bb6-23eb-478c-b714-457b2f8b2f6d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:09.708081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5bea1-1f7f-4054-9060-0c9be1fe88da None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:09.715556 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 279/549] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:00:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:09.722119 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa445bb6-23eb-478c-b714-457b2f8b2f6d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:09.737494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-c6f5bea1-1f7f-4054-9060-0c9be1fe88da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:09.737494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:09.737494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:09.737494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:09.737494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:09.737494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:09.737494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:09.737494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:09.737494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:09.737494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:09.737494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:09.737494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:09.737494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:09.737494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:09.737494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:09.737494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:09.738472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:09.738472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:09.738472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:09.738472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:09.738472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:09.738472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:09.738472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:09.738472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:09.738472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:09.738472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:09.738472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:09.738472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:09.738472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:09.738472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:09.738472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:09.738472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:09.738472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:09.739327 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:09.739327 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:09.739327 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:09.739327 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 271/550] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:09.741290 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5bea1-1f7f-4054-9060-0c9be1fe88da None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:09.784671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:09.846910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:09.866225 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa445bb6-23eb-478c-b714-457b2f8b2f6d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:09.938080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5bea1-1f7f-4054-9060-0c9be1fe88da None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:09.939092 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1694c-4deb-4446-84f3-97c7557c26bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:09.939733 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1694c-4deb-4446-84f3-97c7557c26bd None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:09.940012 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1694c-4deb-4446-84f3-97c7557c26bd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:09.940286 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1694c-4deb-4446-84f3-97c7557c26bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:09.958613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1694c-4deb-4446-84f3-97c7557c26bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:09.960091 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1694c-4deb-4446-84f3-97c7557c26bd None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:09.983267 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d72345-edd3-48da-9a3e-462072ddcfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:09.985841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d72345-edd3-48da-9a3e-462072ddcfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:09.986304 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d72345-edd3-48da-9a3e-462072ddcfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:09.986714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d72345-edd3-48da-9a3e-462072ddcfa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:09.991023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-5cc1694c-4deb-4446-84f3-97c7557c26bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:09.991023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:09.991023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:09.991023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:09.991023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:09.991023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:09.991023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:09.991023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:09.991023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:09.991023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:09.991023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:09.991023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:09.991023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:09.991023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:09.991023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:09.991023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:09.992249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:09.992249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:09.992249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:09.992249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:09.992249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:09.992249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:09.992249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:09.992249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:09.992249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:09.992249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:09.992249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:09.992249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:09.992249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:09.992249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:09.992249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:09.992249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:09.992249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:09.993261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:09.993261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:09.993261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:09.993427 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d72345-edd3-48da-9a3e-462072ddcfa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:09.993852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d72345-edd3-48da-9a3e-462072ddcfa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:09.995331 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d72345-edd3-48da-9a3e-462072ddcfa1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:09.995721 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 280/551] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:10.001560 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1694c-4deb-4446-84f3-97c7557c26bd None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:10.024084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 272/552] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:10.030331 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d72345-edd3-48da-9a3e-462072ddcfa1 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:10.129047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:10.146394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1694c-4deb-4446-84f3-97c7557c26bd None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:10.183830 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bd13c-5a19-4b23-bfbd-5d7fc4a79c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:10.184766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bd13c-5a19-4b23-bfbd-5d7fc4a79c75 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:10.184875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d72345-edd3-48da-9a3e-462072ddcfa1 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:10.185325 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bd13c-5a19-4b23-bfbd-5d7fc4a79c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:10.185804 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bd13c-5a19-4b23-bfbd-5d7fc4a79c75 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:10.186638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007bd13c-5a19-4b23-bfbd-5d7fc4a79c75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:10.187159 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007bd13c-5a19-4b23-bfbd-5d7fc4a79c75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:10.188943 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007bd13c-5a19-4b23-bfbd-5d7fc4a79c75 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:10.199448 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:10.202431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 281/553] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:10.204768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901f40d-4336-4655-9553-06c0d2907179 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:10.205374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901f40d-4336-4655-9553-06c0d2907179 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:10.205872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901f40d-4336-4655-9553-06c0d2907179 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:10.211912 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 282/554] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:10.212922 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901f40d-4336-4655-9553-06c0d2907179 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:10.231739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee10d9a0-a7b9-4547-b81c-7cbc8d44d526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:10.233174 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10d9a0-a7b9-4547-b81c-7cbc8d44d526 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:10.233963 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10d9a0-a7b9-4547-b81c-7cbc8d44d526 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:10.234493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee10d9a0-a7b9-4547-b81c-7cbc8d44d526 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:10.245102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10d9a0-a7b9-4547-b81c-7cbc8d44d526 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:10.248561 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee10d9a0-a7b9-4547-b81c-7cbc8d44d526 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:10.264461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-ee10d9a0-a7b9-4547-b81c-7cbc8d44d526 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 19:00:10.264461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:10.264461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:10.264461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:10.264461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:10.264461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:10.264461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:10.264461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:10.264461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:10.264461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:10.264461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:10.264461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:10.264461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:10.264461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:10.264461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:10.264461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:10.265472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:10.265472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:10.265472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:10.265472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:10.265472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:10.265472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:10.265472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:10.265472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:10.265472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:10.265472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:10.265472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:10.265472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:10.265472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:10.265472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:10.265472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:10.265472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:10.265472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:10.265472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:10.272985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:10.272985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:10.272985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:10.272985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:10.272985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:10.272985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:10.272985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:10.272985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:10.272985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 19:00:10.272985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:10.272985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 273/555] 10.222.0.65 () {56 vars in 1093 bytes} [Tue Aug 9 19:00:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:10.272985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f062267-4886-4ff3-8b1c-0aba7416e8c0 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:10.272985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f062267-4886-4ff3-8b1c-0aba7416e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:10.273717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f062267-4886-4ff3-8b1c-0aba7416e8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:10.297036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9f062267-4886-4ff3-8b1c-0aba7416e8c0 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:10.299981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9f062267-4886-4ff3-8b1c-0aba7416e8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:10.345247 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901f40d-4336-4655-9553-06c0d2907179 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:10.385650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01342f3-b562-4f2a-9ed8-1763eca8679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:10.386086 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 274/556] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:10.386191 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01342f3-b562-4f2a-9ed8-1763eca8679c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:10.386478 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01342f3-b562-4f2a-9ed8-1763eca8679c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:10.386746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01342f3-b562-4f2a-9ed8-1763eca8679c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:10.387685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f062267-4886-4ff3-8b1c-0aba7416e8c0 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:10.401503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01342f3-b562-4f2a-9ed8-1763eca8679c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:10.401503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01342f3-b562-4f2a-9ed8-1763eca8679c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:10.417627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-b01342f3-b562-4f2a-9ed8-1763eca8679c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 19:00:10.417627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:10.417627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:10.417627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:10.417627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:10.417627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:10.417627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:10.417627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:10.417627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:10.417627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:10.417627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:10.417627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:10.417627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:10.417627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:10.417627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:10.417627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:10.418617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:10.418617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:10.418617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:10.418617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:10.418617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:10.418617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:10.418617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:10.418617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:10.418617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:10.418617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:10.418617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:10.418617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:10.418617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:10.418617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:10.418617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:10.418617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:10.418617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:10.418617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:10.420000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:10.420000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:10.420000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:10.420000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:10.420000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:10.420000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:10.420000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:10.420000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:10.420000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 19:00:10.420000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:10.420000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 283/557] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:00:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:10.420000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01342f3-b562-4f2a-9ed8-1763eca8679c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:10.431634 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:10.538667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:10.543006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f062267-4886-4ff3-8b1c-0aba7416e8c0 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:10.554678 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01342f3-b562-4f2a-9ed8-1763eca8679c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:10.591444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab85a7b-305d-4695-b555-b847fd482d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:10.591871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81471e23-ae54-4360-abbf-d2b389c70534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:10.592065 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab85a7b-305d-4695-b555-b847fd482d3b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:10.592334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab85a7b-305d-4695-b555-b847fd482d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:10.592659 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab85a7b-305d-4695-b555-b847fd482d3b None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:10.593335 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471e23-ae54-4360-abbf-d2b389c70534 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:10.593442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab85a7b-305d-4695-b555-b847fd482d3b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:10.593747 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab85a7b-305d-4695-b555-b847fd482d3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:10.594770 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471e23-ae54-4360-abbf-d2b389c70534 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:10.595326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471e23-ae54-4360-abbf-d2b389c70534 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:10.595759 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab85a7b-305d-4695-b555-b847fd482d3b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:10.596510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81471e23-ae54-4360-abbf-d2b389c70534 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:10.597017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81471e23-ae54-4360-abbf-d2b389c70534 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:10.598698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81471e23-ae54-4360-abbf-d2b389c70534 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:10.621764 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 275/558] 10.222.0.65 () {56 vars in 1133 bytes} [Tue Aug 9 19:00:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:10.621764 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab85a7b-305d-4695-b555-b847fd482d3b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:10.624743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 284/559] 10.222.0.65 () {56 vars in 1135 bytes} [Tue Aug 9 19:00:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:10.626256 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81471e23-ae54-4360-abbf-d2b389c70534 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:10.697618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:10.740013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81471e23-ae54-4360-abbf-d2b389c70534 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:10.747017 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab85a7b-305d-4695-b555-b847fd482d3b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:10.780182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f38716-326d-4015-8579-c28c6f2b31b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:10.781166 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f38716-326d-4015-8579-c28c6f2b31b9 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:10.782405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f38716-326d-4015-8579-c28c6f2b31b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:10.782885 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f38716-326d-4015-8579-c28c6f2b31b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:10.783428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3344b-673a-4592-bd28-12154877be24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:10.784040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3344b-673a-4592-bd28-12154877be24 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:10.784320 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3344b-673a-4592-bd28-12154877be24 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:10.784587 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3344b-673a-4592-bd28-12154877be24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:10.794402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3344b-673a-4592-bd28-12154877be24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:10.794970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f38716-326d-4015-8579-c28c6f2b31b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:10.796649 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f38716-326d-4015-8579-c28c6f2b31b9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:10.799201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-57c3344b-673a-4592-bd28-12154877be24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:10.799201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:10.799201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:10.799201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:10.799201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:10.799201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:10.799201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:10.799201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:10.799201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:10.799201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:10.799201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:10.799201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:10.799201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:10.799201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:10.799201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:10.799201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:10.800127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:10.800127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:10.800127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:10.800127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:10.800127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:10.800127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:10.800127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:10.800127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:10.800127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:10.800127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:10.800127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:10.800127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:10.800127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:10.800127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:10.800127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:10.800127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:10.800978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:10.800978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:10.800978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:10.800978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:10.800978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:10.800978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:10.800978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:10.800978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:10.800978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:10.800978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:10.800978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:10.800978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:10.800978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 276/560] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:10.801715 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3344b-673a-4592-bd28-12154877be24 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:10.818438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-04f38716-326d-4015-8579-c28c6f2b31b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:10.818438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:10.818438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:10.818438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:10.818438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:10.818438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:10.818438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:10.818438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:10.818438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:10.818438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:10.818438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:10.818438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:10.818438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:10.818438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:10.818438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:10.818438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:10.819521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:10.819521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:10.819521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:10.819521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:10.819521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:10.819521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:10.819521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:10.819521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:10.819521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:10.819521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:10.819521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:10.819521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:10.819521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:10.819521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:10.819521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:10.819521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:10.819521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:10.820429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:10.820429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:10.820429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:10.820429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 285/561] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:10.821202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e696a-c505-48ea-b4e5-716f85602b70 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:10.821202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e696a-c505-48ea-b4e5-716f85602b70 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:10.821361 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e696a-c505-48ea-b4e5-716f85602b70 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:10.822790 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 286/562] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:10.823488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e696a-c505-48ea-b4e5-716f85602b70 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:10.831307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:10.918396 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3344b-673a-4592-bd28-12154877be24 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:10.931153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e696a-c505-48ea-b4e5-716f85602b70 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:10.948664 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:10.958353 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9925a6b-a78b-4072-a9d1-3667b8998f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:10.959079 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9925a6b-a78b-4072-a9d1-3667b8998f9f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:10.959260 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9925a6b-a78b-4072-a9d1-3667b8998f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:10.959496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9925a6b-a78b-4072-a9d1-3667b8998f9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:10.967262 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020861a1-2146-4811-833c-342c13d769a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:10.968285 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020861a1-2146-4811-833c-342c13d769a4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:10.968582 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020861a1-2146-4811-833c-342c13d769a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:10.968839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020861a1-2146-4811-833c-342c13d769a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:10.970077 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020861a1-2146-4811-833c-342c13d769a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:10.970791 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020861a1-2146-4811-833c-342c13d769a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:10.972610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020861a1-2146-4811-833c-342c13d769a4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:10.982800 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 287/563] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:00:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:10.983450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020861a1-2146-4811-833c-342c13d769a4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:11.035630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9925a6b-a78b-4072-a9d1-3667b8998f9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:11.037107 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9925a6b-a78b-4072-a9d1-3667b8998f9f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:11.060955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:11.086391 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020861a1-2146-4811-833c-342c13d769a4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:11.122655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781c35a-bb30-48f5-b569-b966ad1c6728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:11.123354 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781c35a-bb30-48f5-b569-b966ad1c6728 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:11.123634 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781c35a-bb30-48f5-b569-b966ad1c6728 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:11.123899 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781c35a-bb30-48f5-b569-b966ad1c6728 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:11.124529 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781c35a-bb30-48f5-b569-b966ad1c6728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:11.124825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781c35a-bb30-48f5-b569-b966ad1c6728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:11.126318 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781c35a-bb30-48f5-b569-b966ad1c6728 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:11.137794 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 288/564] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:11.139269 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ad842-72e7-49a0-a4ee-38b9cc4551e1 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:11.139560 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ad842-72e7-49a0-a4ee-38b9cc4551e1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:11.139905 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ad842-72e7-49a0-a4ee-38b9cc4551e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:11.158441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-624ad842-72e7-49a0-a4ee-38b9cc4551e1 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:11.163311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-624ad842-72e7-49a0-a4ee-38b9cc4551e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:11.163439 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 277/565] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:00:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 19:00:11.163439 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9925a6b-a78b-4072-a9d1-3667b8998f9f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:11.193221 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:11.231914 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 289/566] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:11.232720 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ad842-72e7-49a0-a4ee-38b9cc4551e1 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:11.269364 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9925a6b-a78b-4072-a9d1-3667b8998f9f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:11.288757 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:11.306703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e521e1f-0ab4-4643-acbc-17701cea1fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:11.307348 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e521e1f-0ab4-4643-acbc-17701cea1fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:11.307635 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e521e1f-0ab4-4643-acbc-17701cea1fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:11.307912 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e521e1f-0ab4-4643-acbc-17701cea1fd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:11.318970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e521e1f-0ab4-4643-acbc-17701cea1fd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:11.320427 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e521e1f-0ab4-4643-acbc-17701cea1fd2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:11.335388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-8e521e1f-0ab4-4643-acbc-17701cea1fd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:11.335388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:11.335388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:11.335388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:11.335388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:11.335388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:11.335388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:11.335388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:11.335388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:11.335388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:11.335388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:11.335388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:11.335388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:11.335388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:11.335388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:11.335388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:11.336318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:11.336318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:11.336318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:11.336318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:11.336318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:11.336318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:11.336318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:11.336318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:11.336318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:11.336318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:11.336318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:11.336318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:11.336318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:11.336318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:11.336318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:11.336318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:11.336318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:11.337199 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:11.337199 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:11.337199 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:11.337199 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 278/567] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:11.337919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e521e1f-0ab4-4643-acbc-17701cea1fd2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:11.344248 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ad842-72e7-49a0-a4ee-38b9cc4551e1 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:11.378101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa6a66-51d4-44d5-838a-45b818aac954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:11.378765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa6a66-51d4-44d5-838a-45b818aac954 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:11.379049 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa6a66-51d4-44d5-838a-45b818aac954 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:11.379377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa6a66-51d4-44d5-838a-45b818aac954 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:11.386193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa6a66-51d4-44d5-838a-45b818aac954 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:11.387618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa6a66-51d4-44d5-838a-45b818aac954 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:11.398818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-69fa6a66-51d4-44d5-838a-45b818aac954 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:11.398818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:11.398818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:11.398818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:11.398818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:11.398818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:11.398818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:11.398818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:11.398818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:11.398818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:11.398818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:11.398818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:11.398818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:11.398818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:11.398818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:11.399872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:11.399872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:11.399872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:11.399872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:11.399872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:11.399872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:11.399872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:11.399872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:11.399872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:11.399872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:11.399872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:11.399872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:11.399872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:11.399872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:11.399872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:11.399872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:11.399872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:11.400759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:11.400759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:11.400759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:11.400759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:11.400759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:11.400759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:11.400759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:11.400759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:11.400759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 290/568] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:11.401240 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa6a66-51d4-44d5-838a-45b818aac954 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:11.430059 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:11.442688 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e521e1f-0ab4-4643-acbc-17701cea1fd2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:11.476037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b3aa3-54f0-4a24-864b-73fe4d8e49ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:11.476662 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b3aa3-54f0-4a24-864b-73fe4d8e49ba None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:11.476944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b3aa3-54f0-4a24-864b-73fe4d8e49ba None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:11.477218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b3aa3-54f0-4a24-864b-73fe4d8e49ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:11.488195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b3aa3-54f0-4a24-864b-73fe4d8e49ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:11.489614 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b3aa3-54f0-4a24-864b-73fe4d8e49ba None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:11.503888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-021b3aa3-54f0-4a24-864b-73fe4d8e49ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:11.503888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:11.503888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:11.503888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:11.503888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:11.503888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:11.503888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:11.503888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:11.503888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:11.503888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:11.503888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:11.503888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:11.503888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:11.503888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:11.503888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:11.503888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:11.505037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:11.505037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:11.505037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:11.505037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:11.505037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:11.505037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:11.505037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:11.505037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:11.505037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:11.505037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:11.505037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:11.505037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:11.505037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:11.505037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:11.505037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:11.505037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:11.505037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:11.505973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:11.505973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:11.505973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:11.505973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 279/569] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:11.506209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417802c5-20c7-4091-99e0-e65a9ea71f99 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:11.506434 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417802c5-20c7-4091-99e0-e65a9ea71f99 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:11.506961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417802c5-20c7-4091-99e0-e65a9ea71f99 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:11.512454 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 280/570] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:11.512584 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa6a66-51d4-44d5-838a-45b818aac954 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:11.512679 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417802c5-20c7-4091-99e0-e65a9ea71f99 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:11.536522 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:11.546068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0fbb0-e5af-4f83-a2ac-1588c7b7f5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:11.551136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0fbb0-e5af-4f83-a2ac-1588c7b7f5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:11.551136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0fbb0-e5af-4f83-a2ac-1588c7b7f5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:11.551136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0fbb0-e5af-4f83-a2ac-1588c7b7f5f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:11.558465 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0fbb0-e5af-4f83-a2ac-1588c7b7f5f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:11.564320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-38a0fbb0-e5af-4f83-a2ac-1588c7b7f5f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:11.564320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:11.564320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:11.564320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:11.564320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:11.564320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:11.564320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:11.564320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:11.564320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:11.564320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:11.564320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:11.564320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:11.564320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:11.564320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:11.564320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:11.564320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:11.565409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:11.565409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:11.565409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:11.565409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:11.565409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:11.565409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:11.565409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:11.565409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:11.565409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:11.565409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:11.565409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:11.565409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:11.565409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:11.565409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:11.565409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:11.565409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:11.566717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:11.566717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:11.566717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:11.566717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:11.566717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:11.566717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:11.566717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:11.566717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:11.566717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:11.566717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:11.566717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:11.566717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:11.566717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 291/571] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:11.566717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0fbb0-e5af-4f83-a2ac-1588c7b7f5f6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:11.618063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417802c5-20c7-4091-99e0-e65a9ea71f99 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:11.652096 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49557c4d-4976-4232-8048-8d685d6612f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:11.652700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49557c4d-4976-4232-8048-8d685d6612f6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:11.652984 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49557c4d-4976-4232-8048-8d685d6612f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:11.653261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49557c4d-4976-4232-8048-8d685d6612f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:11.653929 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49557c4d-4976-4232-8048-8d685d6612f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:11.654236 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49557c4d-4976-4232-8048-8d685d6612f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:11.655609 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:11.655707 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49557c4d-4976-4232-8048-8d685d6612f6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:11.667257 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0fbb0-e5af-4f83-a2ac-1588c7b7f5f6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:11.672508 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 281/572] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:11.672508 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49557c4d-4976-4232-8048-8d685d6612f6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:11.705315 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1aeb71-ac28-4014-a107-69599e288e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:11.705992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aeb71-ac28-4014-a107-69599e288e06 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:11.706275 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aeb71-ac28-4014-a107-69599e288e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:11.706627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aeb71-ac28-4014-a107-69599e288e06 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:11.707330 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1aeb71-ac28-4014-a107-69599e288e06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:11.707639 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1aeb71-ac28-4014-a107-69599e288e06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:11.709075 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1aeb71-ac28-4014-a107-69599e288e06 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:11.721409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 292/573] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:11.722606 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc49f3-55da-43bc-b51a-81d089e27902 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:11.722892 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc49f3-55da-43bc-b51a-81d089e27902 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:11.723167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc49f3-55da-43bc-b51a-81d089e27902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:11.741544 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d1cc49f3-55da-43bc-b51a-81d089e27902 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:11.742671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d1cc49f3-55da-43bc-b51a-81d089e27902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:11.753717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:11.771277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49557c4d-4976-4232-8048-8d685d6612f6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:11.806454 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0f691-caef-47e5-b0e9-483af3fb5900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:11.807054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0f691-caef-47e5-b0e9-483af3fb5900 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:11.807325 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0f691-caef-47e5-b0e9-483af3fb5900 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:11.807589 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0f691-caef-47e5-b0e9-483af3fb5900 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:11.807998 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 293/574] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:11.808214 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0f691-caef-47e5-b0e9-483af3fb5900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:11.808512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0f691-caef-47e5-b0e9-483af3fb5900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:11.808825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc49f3-55da-43bc-b51a-81d089e27902 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:11.810190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0f691-caef-47e5-b0e9-483af3fb5900 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:11.822448 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 282/575] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:11.823317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0f691-caef-47e5-b0e9-483af3fb5900 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:11.895691 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:11.916012 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc49f3-55da-43bc-b51a-81d089e27902 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:11.921135 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0f691-caef-47e5-b0e9-483af3fb5900 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:11.950440 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d650f4-9b9f-40ab-9289-e3ea7281245c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:11.951043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d650f4-9b9f-40ab-9289-e3ea7281245c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:11.951321 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d650f4-9b9f-40ab-9289-e3ea7281245c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:11.951593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d650f4-9b9f-40ab-9289-e3ea7281245c None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:11.952253 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d650f4-9b9f-40ab-9289-e3ea7281245c None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:11.952557 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d650f4-9b9f-40ab-9289-e3ea7281245c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:11.954600 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d650f4-9b9f-40ab-9289-e3ea7281245c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:11.954714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea0672-cfb6-44e8-acd9-eab3fa5dac85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:11.955288 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea0672-cfb6-44e8-acd9-eab3fa5dac85 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:11.955568 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea0672-cfb6-44e8-acd9-eab3fa5dac85 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:11.955920 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea0672-cfb6-44e8-acd9-eab3fa5dac85 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:11.962373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 294/576] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:00:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:11.963135 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d650f4-9b9f-40ab-9289-e3ea7281245c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:11.963613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea0672-cfb6-44e8-acd9-eab3fa5dac85 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:11.965054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea0672-cfb6-44e8-acd9-eab3fa5dac85 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:11.977651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-2bea0672-cfb6-44e8-acd9-eab3fa5dac85 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 19:00:11.977651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:11.977651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:11.977651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:11.977651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:11.977651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:11.977651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:11.977651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:11.977651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:11.977651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:11.977651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:11.977651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:11.977651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:11.977651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:11.977651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:11.977651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:11.978838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:11.978838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:11.978838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:11.978838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:11.978838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:11.978838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:11.978838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:11.978838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:11.978838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:11.978838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:11.978838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:11.978838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:11.978838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:11.978838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:11.978838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:11.978838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:11.978838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:11.978838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:11.980339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:11.980339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:11.980339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:11.980339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:11.980339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:11.980339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:11.980339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:11.980339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:11.980339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 19:00:11.980339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:11.980339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 283/577] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:00:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:11.980339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea0672-cfb6-44e8-acd9-eab3fa5dac85 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:11.983773 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:12.065277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d650f4-9b9f-40ab-9289-e3ea7281245c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:12.081339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea0672-cfb6-44e8-acd9-eab3fa5dac85 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:12.098422 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5ab62-8bc6-4ef3-ae25-e28222278cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:12.099080 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5ab62-8bc6-4ef3-ae25-e28222278cb5 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:12.099362 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5ab62-8bc6-4ef3-ae25-e28222278cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:12.099641 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5ab62-8bc6-4ef3-ae25-e28222278cb5 None admin] PATH_INFO: `/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/2cfda1bec35145f3bbcc13fae0b7af2e/roles/973d37db3ba74af0b63e3570ab311e21` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:12.110637 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:12.114369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5ab62-8bc6-4ef3-ae25-e28222278cb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user_id=2cfda1bec35145f3bbcc13fae0b7af2e, role_id=973d37db3ba74af0b63e3570ab311e21)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:12.115760 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4407f-e886-44d6-ab40-bab43595f118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:12.115896 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5ab62-8bc6-4ef3-ae25-e28222278cb5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:12.116390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4407f-e886-44d6-ab40-bab43595f118 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:12.116669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4407f-e886-44d6-ab40-bab43595f118 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:12.116943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4407f-e886-44d6-ab40-bab43595f118 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:12.123644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4407f-e886-44d6-ab40-bab43595f118 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:12.125238 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4407f-e886-44d6-ab40-bab43595f118 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:12.136733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-92c4407f-e886-44d6-ab40-bab43595f118 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:12.136733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:12.136733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:12.136733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:12.136733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:12.136733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:12.136733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:12.136733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:12.136733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:12.136733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:12.136733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:12.136733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:12.136733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:12.136733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:12.136733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:12.137825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:12.137825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:12.137825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:12.137825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:12.137825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:12.137825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:12.137825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:12.137825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:12.137825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:12.137825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:12.137825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:12.137825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:12.137825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:12.137825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:12.137825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:12.137825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:12.137825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:12.138735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:12.138735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:12.138735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:12.138735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:12.138735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:12.138735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:12.138735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:12.138735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:12.138735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 284/578] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:12.138735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4407f-e886-44d6-ab40-bab43595f118 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:12.193986 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 295/579] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 19:00:11 2022] PUT /identity/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/2cfda1bec35145f3bbcc13fae0b7af2e/roles/973d37db3ba74af0b63e3570ab311e21 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:00:12.195010 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5ab62-8bc6-4ef3-ae25-e28222278cb5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:12.208665 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:12.254578 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4407f-e886-44d6-ab40-bab43595f118 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:12.300662 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910709f-bba1-4609-ae2e-5cf0a1cf3b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:12.301310 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910709f-bba1-4609-ae2e-5cf0a1cf3b2a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:12.301622 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910709f-bba1-4609-ae2e-5cf0a1cf3b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:12.301892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910709f-bba1-4609-ae2e-5cf0a1cf3b2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:12.311907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5ab62-8bc6-4ef3-ae25-e28222278cb5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:12.313436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910709f-bba1-4609-ae2e-5cf0a1cf3b2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:12.318887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-0910709f-bba1-4609-ae2e-5cf0a1cf3b2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:12.318887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:12.318887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:12.318887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:12.318887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:12.318887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:12.318887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:12.318887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:12.318887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:12.318887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:12.318887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:12.318887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:12.318887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:12.318887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:12.318887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:12.318887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:12.325137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:12.325137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:12.325137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:12.325137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:12.325137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:12.325137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:12.325137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:12.325137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:12.325137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:12.325137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:12.325137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:12.325137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:12.325137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:12.325137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:12.325137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:12.325137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:12.326362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:12.326362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:12.326362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:12.326362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:12.326362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:12.326362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:12.326362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:12.326362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:12.326362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:12.326362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:12.326362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:12.326362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:12.326362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 285/580] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:12.326362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910709f-bba1-4609-ae2e-5cf0a1cf3b2a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:12.364685 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2afaf-97e2-4943-a80e-219ae0525aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:12.365320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2afaf-97e2-4943-a80e-219ae0525aac None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:12.365669 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2afaf-97e2-4943-a80e-219ae0525aac None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:12.365939 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2afaf-97e2-4943-a80e-219ae0525aac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:12.376494 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2afaf-97e2-4943-a80e-219ae0525aac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:12.378007 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2afaf-97e2-4943-a80e-219ae0525aac None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:12.393140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ecf2afaf-97e2-4943-a80e-219ae0525aac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:12.393140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:12.393140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:12.393140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:12.393140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:12.393140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:12.393140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:12.393140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:12.393140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:12.393140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:12.393140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:12.393140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:12.393140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:12.393140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:12.393140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:12.393140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:12.394277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:12.394277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:12.394277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:12.394277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:12.394277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:12.394277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:12.394277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:12.394277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:12.394277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:12.394277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:12.394277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:12.394277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:12.394277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:12.394277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:12.394277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:12.394277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:12.394277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:12.395296 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:12.395296 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:12.395296 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:12.395296 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 296/581] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:12.395296 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2afaf-97e2-4943-a80e-219ae0525aac None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:12.440589 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910709f-bba1-4609-ae2e-5cf0a1cf3b2a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:12.442667 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:12.464501 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:12.475987 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28e856-5d46-4d1d-b0b4-ec1a6bd1d076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:12.476714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28e856-5d46-4d1d-b0b4-ec1a6bd1d076 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:12.477089 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28e856-5d46-4d1d-b0b4-ec1a6bd1d076 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:12.477492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28e856-5d46-4d1d-b0b4-ec1a6bd1d076 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:12.478307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28e856-5d46-4d1d-b0b4-ec1a6bd1d076 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:12.478713 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28e856-5d46-4d1d-b0b4-ec1a6bd1d076 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:12.480224 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28e856-5d46-4d1d-b0b4-ec1a6bd1d076 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:12.503161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 286/582] 10.222.0.65 () {56 vars in 1137 bytes} [Tue Aug 9 19:00:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:12.503161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28e856-5d46-4d1d-b0b4-ec1a6bd1d076 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:12.517923 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2afaf-97e2-4943-a80e-219ae0525aac None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:12.553080 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf7192-a838-4222-9db5-3813f960280a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:12.553912 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf7192-a838-4222-9db5-3813f960280a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:12.554287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf7192-a838-4222-9db5-3813f960280a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:12.554649 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf7192-a838-4222-9db5-3813f960280a None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:12.555406 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf7192-a838-4222-9db5-3813f960280a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:12.555789 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf7192-a838-4222-9db5-3813f960280a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:12.557277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf7192-a838-4222-9db5-3813f960280a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:12.574651 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 297/583] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:12.575928 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf7192-a838-4222-9db5-3813f960280a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:12.611585 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28e856-5d46-4d1d-b0b4-ec1a6bd1d076 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:12.646804 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17318aea-f128-4dc9-8a05-73f1b365479f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:12.647507 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17318aea-f128-4dc9-8a05-73f1b365479f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:12.647857 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17318aea-f128-4dc9-8a05-73f1b365479f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:12.648201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17318aea-f128-4dc9-8a05-73f1b365479f None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:12.648937 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17318aea-f128-4dc9-8a05-73f1b365479f None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:12.649346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17318aea-f128-4dc9-8a05-73f1b365479f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:12.650796 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17318aea-f128-4dc9-8a05-73f1b365479f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:12.659852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 287/584] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:00:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:12.660671 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17318aea-f128-4dc9-8a05-73f1b365479f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:12.689715 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf7192-a838-4222-9db5-3813f960280a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:12.691601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:12.707814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:12.724655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bcca19-b937-4ff9-b761-24e3ede86d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:12.725258 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bcca19-b937-4ff9-b761-24e3ede86d65 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:12.725625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bcca19-b937-4ff9-b761-24e3ede86d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:12.725905 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bcca19-b937-4ff9-b761-24e3ede86d65 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:12.726536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bcca19-b937-4ff9-b761-24e3ede86d65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:12.726834 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bcca19-b937-4ff9-b761-24e3ede86d65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:12.728280 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bcca19-b937-4ff9-b761-24e3ede86d65 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:12.740289 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 298/585] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:12.741002 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bcca19-b937-4ff9-b761-24e3ede86d65 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:12.773964 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17318aea-f128-4dc9-8a05-73f1b365479f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:12.809171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2723f2e-ad11-45af-9d2f-a92bdc88d8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:12.809833 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2723f2e-ad11-45af-9d2f-a92bdc88d8fa None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:12.810136 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2723f2e-ad11-45af-9d2f-a92bdc88d8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:12.810383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2723f2e-ad11-45af-9d2f-a92bdc88d8fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:12.821091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2723f2e-ad11-45af-9d2f-a92bdc88d8fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:12.822560 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2723f2e-ad11-45af-9d2f-a92bdc88d8fa None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:12.836906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-a2723f2e-ad11-45af-9d2f-a92bdc88d8fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:12.836906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:12.836906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:12.836906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:12.836906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:12.836906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:12.836906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:12.836906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:12.836906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:12.836906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:12.836906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:12.836906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:12.836906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:12.836906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:12.836906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:12.836906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:12.837861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:12.837861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:12.837861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:12.837861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:12.837861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:12.837861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:12.837861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:12.837861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:12.837861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:12.837861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:12.837861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:12.837861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:12.837861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:12.837861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:12.837861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:12.837861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:12.837861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:12.838818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:12.838818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:12.838818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:12.838818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 288/586] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:12.838818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2723f2e-ad11-45af-9d2f-a92bdc88d8fa None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:12.847746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bcca19-b937-4ff9-b761-24e3ede86d65 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:12.884122 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0b610-91f5-4b73-9f93-8f2470b1879a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:12.885064 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0b610-91f5-4b73-9f93-8f2470b1879a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:12.885539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0b610-91f5-4b73-9f93-8f2470b1879a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:12.885955 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0b610-91f5-4b73-9f93-8f2470b1879a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:12.887007 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0b610-91f5-4b73-9f93-8f2470b1879a None admin] RBAC: Adding query filter params (role.id=973d37db3ba74af0b63e3570ab311e21, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=aac48cd591b44f2999d2f172262019da) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:12.887587 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0b610-91f5-4b73-9f93-8f2470b1879a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:12.889137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0b610-91f5-4b73-9f93-8f2470b1879a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:12.895661 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 299/587] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:00:12 2022] GET /identity/v3/role_assignments?user.id=aac48cd591b44f2999d2f172262019da&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=973d37db3ba74af0b63e3570ab311e21 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:12.895661 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0b610-91f5-4b73-9f93-8f2470b1879a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:12.937929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:12.967467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:12.977331 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2723f2e-ad11-45af-9d2f-a92bdc88d8fa None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:13.020179 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0166b-a98c-49f8-92c0-67832221069d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:13.021653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0166b-a98c-49f8-92c0-67832221069d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:13.022155 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0166b-a98c-49f8-92c0-67832221069d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:13.022865 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0166b-a98c-49f8-92c0-67832221069d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:13.031239 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0b610-91f5-4b73-9f93-8f2470b1879a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:13.038794 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0166b-a98c-49f8-92c0-67832221069d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:13.041210 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0166b-a98c-49f8-92c0-67832221069d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:13.061195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-18e0166b-a98c-49f8-92c0-67832221069d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:13.061195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:13.061195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:13.061195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:13.061195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:13.061195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:13.061195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:13.061195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:13.061195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:13.061195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:13.061195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:13.061195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:13.061195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:13.061195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:13.061195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:13.061195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:13.062212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:13.062212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:13.062212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:13.062212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:13.062212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:13.062212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:13.062212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:13.062212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:13.062212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:13.062212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:13.062212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:13.062212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:13.062212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:13.062212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:13.062212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:13.062212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:13.062212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:13.063184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:13.063184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:13.063184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:13.063812 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 289/588] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:13.067553 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0166b-a98c-49f8-92c0-67832221069d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:13.081219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631c9d8-893f-4dc5-877b-6d44eea7bbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:13.081882 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631c9d8-893f-4dc5-877b-6d44eea7bbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:13.082161 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631c9d8-893f-4dc5-877b-6d44eea7bbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:13.082825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631c9d8-893f-4dc5-877b-6d44eea7bbf9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:13.095314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631c9d8-893f-4dc5-877b-6d44eea7bbf9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:13.097508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631c9d8-893f-4dc5-877b-6d44eea7bbf9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:13.112546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-b631c9d8-893f-4dc5-877b-6d44eea7bbf9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 19:00:13.112546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:13.112546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:13.112546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:13.112546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:13.112546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:13.112546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:13.112546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:13.112546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:13.112546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:13.112546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:13.112546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:13.112546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:13.112546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:13.112546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:13.112546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:13.113697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:13.113697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:13.113697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:13.113697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:13.113697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:13.113697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:13.113697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:13.113697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:13.113697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:13.113697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:13.113697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:13.113697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:13.113697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:13.113697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:13.113697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:13.113697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:13.113697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:13.113697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:13.114915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:13.114915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:13.114915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:13.114915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:13.114915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:13.114915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:13.114915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:13.114915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:13.114915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 19:00:13.114915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:13.122025 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 300/589] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:00:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:13.123273 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631c9d8-893f-4dc5-877b-6d44eea7bbf9 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:13.187091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0166b-a98c-49f8-92c0-67832221069d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:13.224476 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46851d5a-ccbe-4145-8110-a9f52072f3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:13.225491 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46851d5a-ccbe-4145-8110-a9f52072f3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:13.225817 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46851d5a-ccbe-4145-8110-a9f52072f3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:13.226191 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46851d5a-ccbe-4145-8110-a9f52072f3f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:13.226923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46851d5a-ccbe-4145-8110-a9f52072f3f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:13.227324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46851d5a-ccbe-4145-8110-a9f52072f3f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:13.228947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46851d5a-ccbe-4145-8110-a9f52072f3f2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:13.233758 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:13.243109 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 290/590] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:13.244177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46851d5a-ccbe-4145-8110-a9f52072f3f2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:13.252077 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631c9d8-893f-4dc5-877b-6d44eea7bbf9 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:13.254303 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:13.294062 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af008a07-1306-4fd0-8741-2f7bab5528c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:13.294670 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af008a07-1306-4fd0-8741-2f7bab5528c5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:13.294961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af008a07-1306-4fd0-8741-2f7bab5528c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:13.295308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af008a07-1306-4fd0-8741-2f7bab5528c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:13.295939 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af008a07-1306-4fd0-8741-2f7bab5528c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:13.296241 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af008a07-1306-4fd0-8741-2f7bab5528c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:13.297676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af008a07-1306-4fd0-8741-2f7bab5528c5 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:13.315599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 301/591] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:13.315599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af008a07-1306-4fd0-8741-2f7bab5528c5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:13.419756 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af008a07-1306-4fd0-8741-2f7bab5528c5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:13.430713 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46851d5a-ccbe-4145-8110-a9f52072f3f2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:13.467245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c2a22-80ec-49c3-a75d-6819b161475e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:13.467644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07cacb-7576-4173-8440-ad96e190240e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:13.467865 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c2a22-80ec-49c3-a75d-6819b161475e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:13.468129 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c2a22-80ec-49c3-a75d-6819b161475e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:13.468495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c2a22-80ec-49c3-a75d-6819b161475e None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:13.469665 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07cacb-7576-4173-8440-ad96e190240e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:13.469851 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c2a22-80ec-49c3-a75d-6819b161475e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:13.470154 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c2a22-80ec-49c3-a75d-6819b161475e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:13.470508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07cacb-7576-4173-8440-ad96e190240e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:13.470965 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07cacb-7576-4173-8440-ad96e190240e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:13.471624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c2a22-80ec-49c3-a75d-6819b161475e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:13.480012 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07cacb-7576-4173-8440-ad96e190240e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:13.482601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07cacb-7576-4173-8440-ad96e190240e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:13.493796 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 291/592] 10.222.0.65 () {56 vars in 1137 bytes} [Tue Aug 9 19:00:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:13.494652 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c2a22-80ec-49c3-a75d-6819b161475e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:13.495876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-4c07cacb-7576-4173-8440-ad96e190240e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:13.495876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:13.495876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:13.495876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:13.495876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:13.495876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:13.495876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:13.495876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:13.495876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:13.495876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:13.495876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:13.495876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:13.495876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:13.495876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:13.495876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:13.496824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:13.496824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:13.496824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:13.496824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:13.496824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:13.496824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:13.496824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:13.496824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:13.496824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:13.496824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:13.496824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:13.496824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:13.496824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:13.496824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:13.496824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:13.496824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:13.496824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:13.497772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:13.497772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:13.497772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:13.497772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:13.497772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:13.497772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:13.497772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:13.497772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:13.498885 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 302/593] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:13.499658 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07cacb-7576-4173-8440-ad96e190240e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:13.517939 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:13.591033 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:13.618070 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07cacb-7576-4173-8440-ad96e190240e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:13.648402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c2a22-80ec-49c3-a75d-6819b161475e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:13.653838 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d34f5f-3627-451b-8af6-a2c721b53463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:13.654472 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d34f5f-3627-451b-8af6-a2c721b53463 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:13.654748 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d34f5f-3627-451b-8af6-a2c721b53463 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:13.655024 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d34f5f-3627-451b-8af6-a2c721b53463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:13.666624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d34f5f-3627-451b-8af6-a2c721b53463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:13.668171 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d34f5f-3627-451b-8af6-a2c721b53463 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:13.688047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-90d34f5f-3627-451b-8af6-a2c721b53463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:13.688047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:13.688047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:13.688047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:13.688047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:13.688047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:13.688047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:13.688047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:13.688047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:13.688047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:13.688047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:13.688047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:13.688047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:13.688047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:13.688047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:13.688047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:13.689184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:13.689184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:13.689184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:13.689184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:13.689184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:13.689184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:13.689184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:13.689184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:13.689184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:13.689184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:13.689184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:13.689184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:13.689184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:13.689184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:13.689184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:13.689184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:13.689184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:13.690462 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:13.690462 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:13.690462 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:13.690462 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 303/594] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:13.690462 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d34f5f-3627-451b-8af6-a2c721b53463 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:13.694130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc639d3c-3fd7-4bd1-897d-ec037d7398cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:13.695091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc639d3c-3fd7-4bd1-897d-ec037d7398cf None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:13.695617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc639d3c-3fd7-4bd1-897d-ec037d7398cf None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:13.696083 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc639d3c-3fd7-4bd1-897d-ec037d7398cf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:13.706689 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc639d3c-3fd7-4bd1-897d-ec037d7398cf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:13.709352 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc639d3c-3fd7-4bd1-897d-ec037d7398cf None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:13.725814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-cc639d3c-3fd7-4bd1-897d-ec037d7398cf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 19:00:13.725814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:13.725814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:13.725814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:13.725814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:13.725814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:13.725814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:13.725814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:13.725814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:13.725814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:13.725814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:13.725814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:13.725814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:13.725814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:13.725814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:13.725814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:13.726765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:13.726765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:13.726765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:13.726765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:13.726765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:13.726765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:13.726765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:13.726765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:13.726765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:13.726765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:13.726765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:13.726765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:13.726765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:13.726765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:13.726765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:13.726765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:13.726765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:13.726765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:13.727709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:13.727709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:13.727709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:13.727709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:13.727709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:13.727709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:13.727709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:13.727709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:13.727709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 19:00:13.727709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:13.735890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 292/595] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:13.735890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc639d3c-3fd7-4bd1-897d-ec037d7398cf None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:13.768435 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:13.816625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d34f5f-3627-451b-8af6-a2c721b53463 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:13.843303 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc639d3c-3fd7-4bd1-897d-ec037d7398cf None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:13.854019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84cfe2-6d31-435e-96da-60a164b072e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:13.855037 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84cfe2-6d31-435e-96da-60a164b072e8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:13.855527 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84cfe2-6d31-435e-96da-60a164b072e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:13.856028 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84cfe2-6d31-435e-96da-60a164b072e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:13.856990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84cfe2-6d31-435e-96da-60a164b072e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:13.857619 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84cfe2-6d31-435e-96da-60a164b072e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:13.859995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84cfe2-6d31-435e-96da-60a164b072e8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:13.868667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:13.874846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 304/596] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:13.876188 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84cfe2-6d31-435e-96da-60a164b072e8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:13.879385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d21c2f-5ccd-4c92-83a9-dc332abf12c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:13.880002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d21c2f-5ccd-4c92-83a9-dc332abf12c5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:13.880280 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d21c2f-5ccd-4c92-83a9-dc332abf12c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:13.880552 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d21c2f-5ccd-4c92-83a9-dc332abf12c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:13.882195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d21c2f-5ccd-4c92-83a9-dc332abf12c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:13.882195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d21c2f-5ccd-4c92-83a9-dc332abf12c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:13.883143 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d21c2f-5ccd-4c92-83a9-dc332abf12c5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:13.900498 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 293/597] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:13.901398 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d21c2f-5ccd-4c92-83a9-dc332abf12c5 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:14.004977 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84cfe2-6d31-435e-96da-60a164b072e8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:14.005527 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d21c2f-5ccd-4c92-83a9-dc332abf12c5 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:14.024910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:14.042718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5c7c7-9617-4904-b861-4ed9cd818aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:14.054904 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5c7c7-9617-4904-b861-4ed9cd818aeb None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:14.054904 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5c7c7-9617-4904-b861-4ed9cd818aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:14.054904 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5c7c7-9617-4904-b861-4ed9cd818aeb None admin] PATH_INFO: `/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/98d8000eb20445b78ee56ac372cd024c/roles/973d37db3ba74af0b63e3570ab311e21` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:14.055185 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516422b-f1a9-4d7f-836f-cb238c214a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:14.055185 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516422b-f1a9-4d7f-836f-cb238c214a5a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:14.055185 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516422b-f1a9-4d7f-836f-cb238c214a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:14.055185 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516422b-f1a9-4d7f-836f-cb238c214a5a None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:14.055889 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516422b-f1a9-4d7f-836f-cb238c214a5a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:14.055889 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516422b-f1a9-4d7f-836f-cb238c214a5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:14.055889 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516422b-f1a9-4d7f-836f-cb238c214a5a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:14.060962 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5c7c7-9617-4904-b861-4ed9cd818aeb None admin] RBAC: Authorizing `identity:create_grant(project_id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user_id=98d8000eb20445b78ee56ac372cd024c, role_id=973d37db3ba74af0b63e3570ab311e21)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:14.061670 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5c7c7-9617-4904-b861-4ed9cd818aeb None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:14.075224 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 305/598] 10.222.0.65 () {56 vars in 1139 bytes} [Tue Aug 9 19:00:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:14.075224 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516422b-f1a9-4d7f-836f-cb238c214a5a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:14.145418 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 294/599] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 19:00:13 2022] PUT /identity/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/98d8000eb20445b78ee56ac372cd024c/roles/973d37db3ba74af0b63e3570ab311e21 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:00:14.147402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5c7c7-9617-4904-b861-4ed9cd818aeb None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:14.205983 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:14.247109 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516422b-f1a9-4d7f-836f-cb238c214a5a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:14.282731 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5c7c7-9617-4904-b861-4ed9cd818aeb None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:14.287751 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfb261-cf9b-4557-8af7-ea4ca07d2840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:14.288448 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfb261-cf9b-4557-8af7-ea4ca07d2840 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:14.288726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfb261-cf9b-4557-8af7-ea4ca07d2840 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:14.288992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfb261-cf9b-4557-8af7-ea4ca07d2840 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:14.296352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfb261-cf9b-4557-8af7-ea4ca07d2840 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:14.298463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfb261-cf9b-4557-8af7-ea4ca07d2840 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:14.310528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-a8bfb261-cf9b-4557-8af7-ea4ca07d2840 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:14.310528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:14.310528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:14.310528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:14.310528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:14.310528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:14.310528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:14.310528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:14.310528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:14.310528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:14.310528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:14.310528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:14.310528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:14.310528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:14.310528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:14.311692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:14.311692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:14.311692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:14.311692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:14.311692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:14.311692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:14.311692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:14.311692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:14.311692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:14.311692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:14.311692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:14.311692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:14.311692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:14.311692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:14.311692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:14.311692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:14.311692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:14.313096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:14.313096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:14.313096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:14.313096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:14.313096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:14.313096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:14.313096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:14.313096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:14.313096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 306/600] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:14.318154 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9ee6f-13a4-45bd-ad52-23214200d009 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:14.318447 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9ee6f-13a4-45bd-ad52-23214200d009 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:14.318716 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9ee6f-13a4-45bd-ad52-23214200d009 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:14.320512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 307/601] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:14.321288 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9ee6f-13a4-45bd-ad52-23214200d009 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:14.329913 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786fddf-9b09-4fd8-aca0-8079aa25ef3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:14.331385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786fddf-9b09-4fd8-aca0-8079aa25ef3f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:14.331738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786fddf-9b09-4fd8-aca0-8079aa25ef3f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:14.332214 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786fddf-9b09-4fd8-aca0-8079aa25ef3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:14.346939 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786fddf-9b09-4fd8-aca0-8079aa25ef3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:14.348430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786fddf-9b09-4fd8-aca0-8079aa25ef3f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:14.367232 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:14.368147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-1786fddf-9b09-4fd8-aca0-8079aa25ef3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:14.368147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:14.368147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:14.368147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:14.368147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:14.368147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:14.368147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:14.368147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:14.368147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:14.368147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:14.368147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:14.368147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:14.368147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:14.368147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:14.368147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:14.368147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:14.369126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:14.369126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:14.369126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:14.369126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:14.369126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:14.369126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:14.369126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:14.369126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:14.369126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:14.369126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:14.369126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:14.369126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:14.369126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:14.369126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:14.369126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:14.369126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:14.369126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:14.372658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:14.372658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:14.372658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:14.372658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 295/602] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:14.372658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520b2b2-f533-4582-a629-d29f0e9c8a12 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:14.372658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520b2b2-f533-4582-a629-d29f0e9c8a12 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:14.372658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520b2b2-f533-4582-a629-d29f0e9c8a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:14.394935 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9520b2b2-f533-4582-a629-d29f0e9c8a12 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:14.396139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9520b2b2-f533-4582-a629-d29f0e9c8a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:14.460135 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9ee6f-13a4-45bd-ad52-23214200d009 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:14.467028 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 296/603] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:14.467961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520b2b2-f533-4582-a629-d29f0e9c8a12 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:14.506329 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:14.527922 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c4fa2-2302-48d8-ba10-a69b9e88c12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:14.528836 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c4fa2-2302-48d8-ba10-a69b9e88c12f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:14.529264 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c4fa2-2302-48d8-ba10-a69b9e88c12f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:14.529715 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c4fa2-2302-48d8-ba10-a69b9e88c12f None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:14.531663 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c4fa2-2302-48d8-ba10-a69b9e88c12f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:14.533377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c4fa2-2302-48d8-ba10-a69b9e88c12f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:14.534018 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c4fa2-2302-48d8-ba10-a69b9e88c12f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:14.552020 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 308/604] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:14.553120 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c4fa2-2302-48d8-ba10-a69b9e88c12f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:14.606498 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520b2b2-f533-4582-a629-d29f0e9c8a12 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:14.645608 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc1af9-4d9f-4a0d-9303-f7b5d248ff1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:14.646358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc1af9-4d9f-4a0d-9303-f7b5d248ff1d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:14.646719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc1af9-4d9f-4a0d-9303-f7b5d248ff1d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:14.647062 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc1af9-4d9f-4a0d-9303-f7b5d248ff1d None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:14.647776 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc1af9-4d9f-4a0d-9303-f7b5d248ff1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:14.648151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc1af9-4d9f-4a0d-9303-f7b5d248ff1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:14.649706 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc1af9-4d9f-4a0d-9303-f7b5d248ff1d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:14.666771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 297/605] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:14.667754 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc1af9-4d9f-4a0d-9303-f7b5d248ff1d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:14.682935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:14.691686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c4fa2-2302-48d8-ba10-a69b9e88c12f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:14.728840 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd89ae-5517-4314-b234-29167414ffc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:14.729749 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd89ae-5517-4314-b234-29167414ffc9 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:14.730181 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd89ae-5517-4314-b234-29167414ffc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:14.730602 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd89ae-5517-4314-b234-29167414ffc9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:14.742212 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd89ae-5517-4314-b234-29167414ffc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:14.747645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-d1dd89ae-5517-4314-b234-29167414ffc9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:14.747645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:14.747645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:14.747645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:14.747645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:14.747645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:14.747645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:14.747645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:14.747645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:14.747645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:14.747645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:14.747645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:14.747645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:14.747645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:14.747645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:14.747645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:14.748771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:14.748771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:14.748771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:14.748771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:14.748771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:14.748771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:14.748771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:14.748771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:14.748771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:14.748771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:14.748771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:14.748771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:14.748771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:14.748771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:14.748771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:14.748771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:14.749746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:14.749746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:14.749746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:14.749746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:14.749746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:14.749746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:14.749746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:14.749746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:14.749746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:14.749746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:14.749746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:14.749746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:14.757194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 309/606] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:14.758294 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd89ae-5517-4314-b234-29167414ffc9 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:14.764598 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:14.798917 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc1af9-4d9f-4a0d-9303-f7b5d248ff1d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:14.842207 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598fd67-4805-4c32-b763-2e415ec303e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:14.842978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598fd67-4805-4c32-b763-2e415ec303e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:14.844277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598fd67-4805-4c32-b763-2e415ec303e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:14.844624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598fd67-4805-4c32-b763-2e415ec303e3 None admin] PATH_INFO: `/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/bca1eca610c64b3a8ab04792dcca18b3/roles/973d37db3ba74af0b63e3570ab311e21` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:14.863017 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598fd67-4805-4c32-b763-2e415ec303e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user_id=bca1eca610c64b3a8ab04792dcca18b3, role_id=973d37db3ba74af0b63e3570ab311e21)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:14.865235 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598fd67-4805-4c32-b763-2e415ec303e3 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:14.873020 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd89ae-5517-4314-b234-29167414ffc9 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:14.911490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132295c-f57a-44c5-bb2a-cfa2be49d47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:14.912120 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132295c-f57a-44c5-bb2a-cfa2be49d47a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:14.912401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132295c-f57a-44c5-bb2a-cfa2be49d47a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:14.912673 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132295c-f57a-44c5-bb2a-cfa2be49d47a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:14.919652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132295c-f57a-44c5-bb2a-cfa2be49d47a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:14.921201 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132295c-f57a-44c5-bb2a-cfa2be49d47a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:14.933226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-5132295c-f57a-44c5-bb2a-cfa2be49d47a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:14.933226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:14.933226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:14.933226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:14.933226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:14.933226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:14.933226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:14.933226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:14.933226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:14.933226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:14.933226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:14.933226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:14.933226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:14.933226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:14.933226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:14.934342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:14.934342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:14.934342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:14.934342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:14.934342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:14.934342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:14.934342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:14.934342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:14.934342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:14.934342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:14.934342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:14.934342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:14.934342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:14.934342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:14.934342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:14.934342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:14.934342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:14.935358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:14.935358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:14.935358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:14.935358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:14.935358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:14.935358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:14.935358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:14.935358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:14.937599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 310/607] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:14.938699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132295c-f57a-44c5-bb2a-cfa2be49d47a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:14.958335 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 298/608] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 19:00:14 2022] PUT /identity/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/bca1eca610c64b3a8ab04792dcca18b3/roles/973d37db3ba74af0b63e3570ab311e21 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:00:14.961069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:14.961333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598fd67-4805-4c32-b763-2e415ec303e3 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:15.053947 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132295c-f57a-44c5-bb2a-cfa2be49d47a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:15.095012 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808a46d-4193-48b0-8ce7-1bac909100fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:15.096481 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a46d-4193-48b0-8ce7-1bac909100fc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:15.096972 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a46d-4193-48b0-8ce7-1bac909100fc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:15.097489 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808a46d-4193-48b0-8ce7-1bac909100fc None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:15.098454 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808a46d-4193-48b0-8ce7-1bac909100fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:15.098971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808a46d-4193-48b0-8ce7-1bac909100fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:15.100648 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808a46d-4193-48b0-8ce7-1bac909100fc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:15.114974 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 311/609] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:00:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:15.116770 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5b184-6746-4acb-8081-1db8ca88dc89 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:15.117270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5b184-6746-4acb-8081-1db8ca88dc89 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:15.117812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5b184-6746-4acb-8081-1db8ca88dc89 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:15.119654 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 312/610] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:15.120608 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5b184-6746-4acb-8081-1db8ca88dc89 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:15.131035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598fd67-4805-4c32-b763-2e415ec303e3 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:15.164290 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:15.172734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3703422-795a-4de1-b3b5-c193fee1fdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:15.173553 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3703422-795a-4de1-b3b5-c193fee1fdab None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:15.173935 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3703422-795a-4de1-b3b5-c193fee1fdab None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:15.174308 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3703422-795a-4de1-b3b5-c193fee1fdab None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:15.175103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3703422-795a-4de1-b3b5-c193fee1fdab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:15.175526 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3703422-795a-4de1-b3b5-c193fee1fdab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:15.177063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3703422-795a-4de1-b3b5-c193fee1fdab None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:15.189444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 299/611] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:15.190768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8656b3-9fe3-485f-88dc-f82a24f32eb2 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:15.191123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8656b3-9fe3-485f-88dc-f82a24f32eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:15.191461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8656b3-9fe3-485f-88dc-f82a24f32eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:15.211306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-cc8656b3-9fe3-485f-88dc-f82a24f32eb2 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:15.212663 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cc8656b3-9fe3-485f-88dc-f82a24f32eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:15.227181 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:15.256890 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5b184-6746-4acb-8081-1db8ca88dc89 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:15.284597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 300/612] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:15.285656 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8656b3-9fe3-485f-88dc-f82a24f32eb2 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:15.303865 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb5a86-4acb-459e-a07e-561cd8b20dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:15.304709 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb5a86-4acb-459e-a07e-561cd8b20dea None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:15.304942 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb5a86-4acb-459e-a07e-561cd8b20dea None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:15.305214 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb5a86-4acb-459e-a07e-561cd8b20dea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:15.319438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb5a86-4acb-459e-a07e-561cd8b20dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:15.321534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb5a86-4acb-459e-a07e-561cd8b20dea None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:15.338374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-82fb5a86-4acb-459e-a07e-561cd8b20dea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:15.338374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:15.338374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:15.338374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:15.338374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:15.338374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:15.338374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:15.338374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:15.338374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:15.338374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:15.338374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:15.338374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:15.338374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:15.338374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:15.338374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:15.338374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:15.339534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:15.339534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:15.339534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:15.339534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:15.339534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:15.339534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:15.339534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:15.339534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:15.339534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:15.339534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:15.339534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:15.339534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:15.339534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:15.339534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:15.339534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:15.339534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:15.339534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:15.340601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:15.340601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:15.340601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:15.340601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 313/613] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:15.340601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb5a86-4acb-459e-a07e-561cd8b20dea None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:15.408555 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8656b3-9fe3-485f-88dc-f82a24f32eb2 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:15.431913 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:15.451443 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60f5e2-9397-4783-87d5-1b1642e15110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:15.452531 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60f5e2-9397-4783-87d5-1b1642e15110 None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:15.453577 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60f5e2-9397-4783-87d5-1b1642e15110 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:15.454076 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60f5e2-9397-4783-87d5-1b1642e15110 None admin] PATH_INFO: `/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/a62d954163ca4bf298f461b4d253269e/roles/973d37db3ba74af0b63e3570ab311e21` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:15.456758 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb5a86-4acb-459e-a07e-561cd8b20dea None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:15.470293 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60f5e2-9397-4783-87d5-1b1642e15110 None admin] RBAC: Authorizing `identity:create_grant(project_id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user_id=a62d954163ca4bf298f461b4d253269e, role_id=973d37db3ba74af0b63e3570ab311e21)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:15.472106 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60f5e2-9397-4783-87d5-1b1642e15110 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:15.486884 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:15.494215 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b428e0d-fdf3-4b46-8613-a7c325397ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:15.494850 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b428e0d-fdf3-4b46-8613-a7c325397ffc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:15.495127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b428e0d-fdf3-4b46-8613-a7c325397ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:15.495397 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b428e0d-fdf3-4b46-8613-a7c325397ffc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:15.512655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b428e0d-fdf3-4b46-8613-a7c325397ffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:15.518306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9b428e0d-fdf3-4b46-8613-a7c325397ffc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:15.518306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:15.518306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:15.518306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:15.518306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:15.518306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:15.518306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:15.518306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:15.518306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:15.518306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:15.518306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:15.518306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:15.518306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:15.518306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:15.518306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:15.518306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:15.519488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:15.519488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:15.519488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:15.519488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:15.519488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:15.519488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:15.519488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:15.519488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:15.519488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:15.519488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:15.519488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:15.519488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:15.519488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:15.519488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:15.519488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:15.519488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:15.520638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:15.520638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:15.520638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:15.520638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:15.520638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:15.520638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:15.520638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:15.520638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:15.520638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:15.520638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:15.520638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:15.520638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:15.522370 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 314/614] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:15.523052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b428e0d-fdf3-4b46-8613-a7c325397ffc None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:15.541887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 301/615] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 19:00:15 2022] PUT /identity/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/a62d954163ca4bf298f461b4d253269e/roles/973d37db3ba74af0b63e3570ab311e21 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:00:15.551401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60f5e2-9397-4783-87d5-1b1642e15110 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:15.714653 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b428e0d-fdf3-4b46-8613-a7c325397ffc None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:15.720433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60f5e2-9397-4783-87d5-1b1642e15110 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:15.752503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a1859-774c-41fc-96b5-c2e3d23e0762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:15.753300 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a1859-774c-41fc-96b5-c2e3d23e0762 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:15.753704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a1859-774c-41fc-96b5-c2e3d23e0762 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:15.754077 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a1859-774c-41fc-96b5-c2e3d23e0762 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:15.754832 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a1859-774c-41fc-96b5-c2e3d23e0762 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:15.755243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a1859-774c-41fc-96b5-c2e3d23e0762 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:15.757009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a1859-774c-41fc-96b5-c2e3d23e0762 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:15.760075 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4519c-3e66-4a06-ae8b-f93d1a13cd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:15.760692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4519c-3e66-4a06-ae8b-f93d1a13cd4a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:15.760970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4519c-3e66-4a06-ae8b-f93d1a13cd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:15.761241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4519c-3e66-4a06-ae8b-f93d1a13cd4a None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:15.761949 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4519c-3e66-4a06-ae8b-f93d1a13cd4a None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:15.762251 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4519c-3e66-4a06-ae8b-f93d1a13cd4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:15.763644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4519c-3e66-4a06-ae8b-f93d1a13cd4a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:15.772065 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 315/616] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:15.773664 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 302/617] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:00:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:15.777739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a1859-774c-41fc-96b5-c2e3d23e0762 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:15.779091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4519c-3e66-4a06-ae8b-f93d1a13cd4a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:15.828851 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:15.847974 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:15.891583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4519c-3e66-4a06-ae8b-f93d1a13cd4a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:15.931954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a1859-774c-41fc-96b5-c2e3d23e0762 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:15.958064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a217d6-db39-4f10-bede-ddd0f72e38aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:15.958696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a217d6-db39-4f10-bede-ddd0f72e38aa None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:15.958974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a217d6-db39-4f10-bede-ddd0f72e38aa None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:15.959243 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a217d6-db39-4f10-bede-ddd0f72e38aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:15.978730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a217d6-db39-4f10-bede-ddd0f72e38aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:15.981470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a217d6-db39-4f10-bede-ddd0f72e38aa None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:15.997660 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3470ac-e034-43c9-9d5c-3fd2d88e957b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:15.998332 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3470ac-e034-43c9-9d5c-3fd2d88e957b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:15.998614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3470ac-e034-43c9-9d5c-3fd2d88e957b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:15.998878 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3470ac-e034-43c9-9d5c-3fd2d88e957b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:16.012696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-85a217d6-db39-4f10-bede-ddd0f72e38aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:16.012696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:16.012696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:16.012696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:16.012696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:16.012696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:16.012696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:16.012696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:16.012696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:16.012696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:16.012696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:16.012696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:16.012696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:16.012696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:16.012696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:16.012696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:16.013729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:16.013729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:16.013729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:16.013729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:16.013729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:16.013729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:16.013729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:16.013729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:16.013729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:16.013729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:16.013729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:16.013729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:16.013729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:16.013729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:16.013729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:16.013729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:16.013729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:16.015064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:16.015064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:16.015064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:16.015064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 303/618] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:16.016235 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3470ac-e034-43c9-9d5c-3fd2d88e957b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:16.019059 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3470ac-e034-43c9-9d5c-3fd2d88e957b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:16.020947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a217d6-db39-4f10-bede-ddd0f72e38aa None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:16.045767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9e3470ac-e034-43c9-9d5c-3fd2d88e957b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 19:00:16.045767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:16.045767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:16.045767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:16.045767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:16.045767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:16.045767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:16.045767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:16.045767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:16.045767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:16.045767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:16.045767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:16.045767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:16.045767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:16.045767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:16.045767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:16.048686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:16.048686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:16.048686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:16.048686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:16.048686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:16.048686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:16.048686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:16.048686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:16.048686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:16.048686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:16.048686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:16.048686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:16.048686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:16.048686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:16.048686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:16.048686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:16.048686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:16.048686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:16.050982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:16.050982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:16.050982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:16.050982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:16.050982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:16.050982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:16.050982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:16.050982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:16.050982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 19:00:16.050982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:16.050982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 316/619] 10.222.0.65 () {56 vars in 1093 bytes} [Tue Aug 9 19:00:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:16.058425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3470ac-e034-43c9-9d5c-3fd2d88e957b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:16.133881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:16.149787 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a217d6-db39-4f10-bede-ddd0f72e38aa None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:16.218298 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5b2a0-327f-4e39-a14e-91ce432129d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:16.219448 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5b2a0-327f-4e39-a14e-91ce432129d0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:16.219727 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5b2a0-327f-4e39-a14e-91ce432129d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:16.220001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5b2a0-327f-4e39-a14e-91ce432129d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:16.220649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5b2a0-327f-4e39-a14e-91ce432129d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:16.220955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5b2a0-327f-4e39-a14e-91ce432129d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:16.223117 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5b2a0-327f-4e39-a14e-91ce432129d0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:16.239666 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 304/620] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:16.246655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5b2a0-327f-4e39-a14e-91ce432129d0 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:16.260214 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3470ac-e034-43c9-9d5c-3fd2d88e957b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:16.277841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:16.304711 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfa09b-3a15-4d32-8149-8591836ee916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:16.305329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfa09b-3a15-4d32-8149-8591836ee916 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:16.305635 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfa09b-3a15-4d32-8149-8591836ee916 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:16.305906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfa09b-3a15-4d32-8149-8591836ee916 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:16.306699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfa09b-3a15-4d32-8149-8591836ee916 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:16.307148 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfa09b-3a15-4d32-8149-8591836ee916 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:16.308800 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfa09b-3a15-4d32-8149-8591836ee916 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:16.328563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 317/621] 10.222.0.65 () {56 vars in 1133 bytes} [Tue Aug 9 19:00:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:16.342891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfa09b-3a15-4d32-8149-8591836ee916 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:16.445292 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5b2a0-327f-4e39-a14e-91ce432129d0 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:16.487129 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f288e-4eb8-4cb5-a4e7-277d46ae4983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:16.487768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f288e-4eb8-4cb5-a4e7-277d46ae4983 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:16.488045 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f288e-4eb8-4cb5-a4e7-277d46ae4983 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:16.488315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f288e-4eb8-4cb5-a4e7-277d46ae4983 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:16.500698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f288e-4eb8-4cb5-a4e7-277d46ae4983 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:16.502105 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f288e-4eb8-4cb5-a4e7-277d46ae4983 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:16.513211 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:16.525492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-6a0f288e-4eb8-4cb5-a4e7-277d46ae4983 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 19:00:16.525492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:16.525492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:16.525492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:16.525492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:16.525492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:16.525492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:16.525492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:16.525492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:16.525492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:16.525492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:16.525492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:16.525492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:16.525492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:16.525492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:16.525492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:16.526691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:16.526691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:16.526691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:16.526691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:16.526691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:16.526691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:16.526691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:16.526691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:16.526691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:16.526691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:16.526691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:16.526691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:16.526691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:16.526691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:16.526691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:16.526691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:16.526691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:16.526691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:16.527916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:16.527916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:16.527916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:16.527916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:16.527916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:16.527916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:16.527916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:16.527916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:16.527916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 19:00:16.527916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:16.527916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 305/622] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:00:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:16.536052 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f288e-4eb8-4cb5-a4e7-277d46ae4983 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:16.555474 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfa09b-3a15-4d32-8149-8591836ee916 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:16.607102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbafca-f208-4d4a-bc25-000781c8d601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:16.607704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbafca-f208-4d4a-bc25-000781c8d601 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:16.607977 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbafca-f208-4d4a-bc25-000781c8d601 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:16.608245 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbafca-f208-4d4a-bc25-000781c8d601 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:16.654484 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f288e-4eb8-4cb5-a4e7-277d46ae4983 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:16.657933 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:16.690813 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac65572-1395-474b-ae0f-1a95a5b9fbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:16.691436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac65572-1395-474b-ae0f-1a95a5b9fbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:16.691686 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac65572-1395-474b-ae0f-1a95a5b9fbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:16.691956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac65572-1395-474b-ae0f-1a95a5b9fbb0 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:16.692677 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac65572-1395-474b-ae0f-1a95a5b9fbb0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:16.692980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac65572-1395-474b-ae0f-1a95a5b9fbb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:16.694590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac65572-1395-474b-ae0f-1a95a5b9fbb0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:16.709977 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbafca-f208-4d4a-bc25-000781c8d601 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:16.711442 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbafca-f208-4d4a-bc25-000781c8d601 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:16.717563 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 306/623] 10.222.0.65 () {56 vars in 1135 bytes} [Tue Aug 9 19:00:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:16.719102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1fa09-eacb-4df0-b1be-769a62c899c2 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:16.719605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1fa09-eacb-4df0-b1be-769a62c899c2 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:16.720089 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1fa09-eacb-4df0-b1be-769a62c899c2 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:16.726237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 307/624] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:16.726444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1fa09-eacb-4df0-b1be-769a62c899c2 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:16.802645 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:16.847919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 318/625] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:00:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 19:00:16.849991 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d50e50-1c96-47b5-9ac0-6ff820b7c6ed None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:16.850632 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d50e50-1c96-47b5-9ac0-6ff820b7c6ed None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:16.850908 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d50e50-1c96-47b5-9ac0-6ff820b7c6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:16.851796 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1fa09-eacb-4df0-b1be-769a62c899c2 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:16.871009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-17d50e50-1c96-47b5-9ac0-6ff820b7c6ed None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:16.872246 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-17d50e50-1c96-47b5-9ac0-6ff820b7c6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:16.894387 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc57d20-616c-47cf-aa68-5458d248b5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:16.895027 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc57d20-616c-47cf-aa68-5458d248b5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:16.895309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc57d20-616c-47cf-aa68-5458d248b5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:16.895581 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc57d20-616c-47cf-aa68-5458d248b5e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:16.908319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc57d20-616c-47cf-aa68-5458d248b5e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:16.909955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc57d20-616c-47cf-aa68-5458d248b5e6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:16.927872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-3fc57d20-616c-47cf-aa68-5458d248b5e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:16.927872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:16.927872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:16.927872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:16.927872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:16.927872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:16.927872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:16.927872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:16.927872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:16.927872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:16.927872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:16.927872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:16.927872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:16.927872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:16.927872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:16.927872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:16.928881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:16.928881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:16.928881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:16.928881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:16.928881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:16.928881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:16.928881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:16.928881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:16.928881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:16.928881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:16.928881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:16.928881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:16.928881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:16.928881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:16.928881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:16.928881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:16.928881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:16.929779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:16.929779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:16.929779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:16.929779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 308/626] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:16.930437 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc57d20-616c-47cf-aa68-5458d248b5e6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:16.939771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:16.945987 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 319/627] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:16.953914 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d50e50-1c96-47b5-9ac0-6ff820b7c6ed None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:17.048483 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc57d20-616c-47cf-aa68-5458d248b5e6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:17.063045 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:17.093376 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a91e90-6646-4323-b028-b6c33f0c65c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:17.095936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d50e50-1c96-47b5-9ac0-6ff820b7c6ed None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:17.097869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a91e90-6646-4323-b028-b6c33f0c65c8 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:17.098155 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a91e90-6646-4323-b028-b6c33f0c65c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:17.098426 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a91e90-6646-4323-b028-b6c33f0c65c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:17.111050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a91e90-6646-4323-b028-b6c33f0c65c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:17.112613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a91e90-6646-4323-b028-b6c33f0c65c8 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:17.128512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-80a91e90-6646-4323-b028-b6c33f0c65c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:17.128512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:17.128512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:17.128512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:17.128512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:17.128512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:17.128512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:17.128512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:17.128512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:17.128512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:17.128512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:17.128512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:17.128512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:17.128512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:17.128512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:17.128512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:17.129513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:17.129513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:17.129513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:17.129513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:17.129513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:17.129513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:17.129513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:17.129513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:17.129513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:17.129513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:17.129513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:17.129513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:17.129513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:17.129513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:17.129513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:17.129513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:17.129513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:17.130473 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:17.130473 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:17.130473 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:17.133529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 309/628] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:17.134571 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a91e90-6646-4323-b028-b6c33f0c65c8 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:17.138681 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55968cf1-66e8-40db-9feb-56060b0e6641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:17.139461 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55968cf1-66e8-40db-9feb-56060b0e6641 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:17.139910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55968cf1-66e8-40db-9feb-56060b0e6641 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:17.140629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55968cf1-66e8-40db-9feb-56060b0e6641 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:17.141511 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55968cf1-66e8-40db-9feb-56060b0e6641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:17.141956 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55968cf1-66e8-40db-9feb-56060b0e6641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:17.143464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55968cf1-66e8-40db-9feb-56060b0e6641 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:17.155745 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 320/629] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:17.158115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55968cf1-66e8-40db-9feb-56060b0e6641 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:17.219240 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:17.244271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a91e90-6646-4323-b028-b6c33f0c65c8 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:17.266109 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55968cf1-66e8-40db-9feb-56060b0e6641 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:17.281815 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40459f77-6911-430e-9fa5-05757b816dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:17.282447 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40459f77-6911-430e-9fa5-05757b816dcb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:17.282729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40459f77-6911-430e-9fa5-05757b816dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:17.283002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40459f77-6911-430e-9fa5-05757b816dcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:17.294339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40459f77-6911-430e-9fa5-05757b816dcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:17.299541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-40459f77-6911-430e-9fa5-05757b816dcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:17.299541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:17.299541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:17.299541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:17.299541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:17.299541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:17.299541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:17.299541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:17.299541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:17.299541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:17.299541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:17.299541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:17.299541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:17.299541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:17.299541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:17.299541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:17.300467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:17.300467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:17.300467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:17.300467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:17.300467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:17.300467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:17.300467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:17.300467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:17.300467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:17.300467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:17.300467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:17.300467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:17.300467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:17.300467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:17.300467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:17.300467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:17.301318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:17.301318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:17.301318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:17.301318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:17.301318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:17.301318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:17.301318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:17.301318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:17.301318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:17.301318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:17.301318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:17.301318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:17.301318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 310/630] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:17.302760 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40459f77-6911-430e-9fa5-05757b816dcb None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:17.307036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416fa64-7674-459b-9088-74e0e1d4f73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:17.307645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416fa64-7674-459b-9088-74e0e1d4f73c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:17.307922 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416fa64-7674-459b-9088-74e0e1d4f73c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:17.308192 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416fa64-7674-459b-9088-74e0e1d4f73c None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:17.308830 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416fa64-7674-459b-9088-74e0e1d4f73c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:17.309131 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416fa64-7674-459b-9088-74e0e1d4f73c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:17.310534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416fa64-7674-459b-9088-74e0e1d4f73c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:17.327613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 321/631] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:17.327613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4383e-b6c5-42b2-91ae-f04bcb18d634 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:17.327613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4383e-b6c5-42b2-91ae-f04bcb18d634 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:17.327613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4383e-b6c5-42b2-91ae-f04bcb18d634 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:17.327613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 322/632] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:17.327613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4383e-b6c5-42b2-91ae-f04bcb18d634 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:17.332359 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:17.414563 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40459f77-6911-430e-9fa5-05757b816dcb None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:17.432378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4383e-b6c5-42b2-91ae-f04bcb18d634 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:17.449950 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:17.451903 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d947a06-a223-4e7e-ba8e-fd97b301671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:17.452730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d947a06-a223-4e7e-ba8e-fd97b301671a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:17.453739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d947a06-a223-4e7e-ba8e-fd97b301671a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:17.454006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d947a06-a223-4e7e-ba8e-fd97b301671a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:17.460893 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d947a06-a223-4e7e-ba8e-fd97b301671a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:17.462434 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d947a06-a223-4e7e-ba8e-fd97b301671a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:17.467407 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a084587-4dfc-42e4-8d39-68f39e05f656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:17.468014 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a084587-4dfc-42e4-8d39-68f39e05f656 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:17.468294 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a084587-4dfc-42e4-8d39-68f39e05f656 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:17.468674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a084587-4dfc-42e4-8d39-68f39e05f656 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:17.469427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a084587-4dfc-42e4-8d39-68f39e05f656 None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:17.469789 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a084587-4dfc-42e4-8d39-68f39e05f656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:17.471209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a084587-4dfc-42e4-8d39-68f39e05f656 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:17.474102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-3d947a06-a223-4e7e-ba8e-fd97b301671a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:17.474102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:17.474102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:17.474102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:17.474102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:17.474102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:17.474102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:17.474102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:17.474102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:17.474102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:17.474102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:17.474102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:17.474102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:17.474102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:17.474102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:17.474997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:17.474997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:17.474997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:17.474997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:17.474997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:17.474997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:17.474997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:17.474997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:17.474997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:17.474997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:17.474997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:17.474997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:17.474997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:17.474997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:17.474997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:17.474997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:17.474997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:17.476347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:17.476347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:17.476347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:17.476347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:17.476347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:17.476347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:17.476347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:17.476347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:17.480026 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 311/633] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:17.485195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 323/634] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:00:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:17.485321 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d947a06-a223-4e7e-ba8e-fd97b301671a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:17.485420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270e5f1-51e1-47a8-be69-46c2c6dd9882 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:17.485420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270e5f1-51e1-47a8-be69-46c2c6dd9882 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:17.485420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270e5f1-51e1-47a8-be69-46c2c6dd9882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:17.502117 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a270e5f1-51e1-47a8-be69-46c2c6dd9882 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:17.503314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a270e5f1-51e1-47a8-be69-46c2c6dd9882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:17.574960 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 324/635] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:17.575814 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270e5f1-51e1-47a8-be69-46c2c6dd9882 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:17.592353 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:17.612502 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d947a06-a223-4e7e-ba8e-fd97b301671a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:17.654962 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486f0c7-d62a-4a0d-a3c4-aa250aac1f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:17.655731 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486f0c7-d62a-4a0d-a3c4-aa250aac1f26 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:17.656064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486f0c7-d62a-4a0d-a3c4-aa250aac1f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:17.656376 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486f0c7-d62a-4a0d-a3c4-aa250aac1f26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:17.663245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486f0c7-d62a-4a0d-a3c4-aa250aac1f26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:17.664689 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486f0c7-d62a-4a0d-a3c4-aa250aac1f26 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:17.676451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-2486f0c7-d62a-4a0d-a3c4-aa250aac1f26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:17.676451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:17.676451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:17.676451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:17.676451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:17.676451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:17.676451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:17.676451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:17.676451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:17.676451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:17.676451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:17.676451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:17.676451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:17.676451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:17.676451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:17.677421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:17.677421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:17.677421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:17.677421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:17.677421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:17.677421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:17.677421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:17.677421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:17.677421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:17.677421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:17.677421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:17.677421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:17.677421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:17.677421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:17.677421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:17.677421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:17.677421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:17.678358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:17.678358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:17.678358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:17.678358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:17.678358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:17.678358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:17.678358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:17.678358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:17.682417 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 312/636] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:17.683278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486f0c7-d62a-4a0d-a3c4-aa250aac1f26 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:17.695235 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270e5f1-51e1-47a8-be69-46c2c6dd9882 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:17.711531 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:17.738208 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf99a2-f663-42fb-9332-184e09c8969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:17.739043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf99a2-f663-42fb-9332-184e09c8969f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:17.739325 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf99a2-f663-42fb-9332-184e09c8969f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:17.739894 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf99a2-f663-42fb-9332-184e09c8969f None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:17.740601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf99a2-f663-42fb-9332-184e09c8969f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:17.740913 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf99a2-f663-42fb-9332-184e09c8969f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:17.742840 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf99a2-f663-42fb-9332-184e09c8969f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:17.763709 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 325/637] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:17.764602 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf99a2-f663-42fb-9332-184e09c8969f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:17.796283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486f0c7-d62a-4a0d-a3c4-aa250aac1f26 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:17.832621 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97a928-bf84-4281-8428-c6017da6a825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:17.833253 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97a928-bf84-4281-8428-c6017da6a825 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:17.833570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97a928-bf84-4281-8428-c6017da6a825 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:17.833848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97a928-bf84-4281-8428-c6017da6a825 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:17.845536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97a928-bf84-4281-8428-c6017da6a825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:17.846941 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97a928-bf84-4281-8428-c6017da6a825 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:17.848718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:17.861674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-0f97a928-bf84-4281-8428-c6017da6a825 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:17.861674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:17.861674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:17.861674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:17.861674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:17.861674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:17.861674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:17.861674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:17.861674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:17.861674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:17.861674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:17.861674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:17.861674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:17.861674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:17.861674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:17.861674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:17.862895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:17.862895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:17.862895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:17.862895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:17.862895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:17.862895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:17.862895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:17.862895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:17.862895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:17.862895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:17.862895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:17.862895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:17.862895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:17.862895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:17.862895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:17.862895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:17.862895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:17.863779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:17.863779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:17.863779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:17.863779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 313/638] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:17.863779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97a928-bf84-4281-8428-c6017da6a825 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:17.871106 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf99a2-f663-42fb-9332-184e09c8969f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:17.904843 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36d6b8-fe75-4750-ba9f-08ae58e3bac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:17.905478 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36d6b8-fe75-4750-ba9f-08ae58e3bac3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:17.905782 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36d6b8-fe75-4750-ba9f-08ae58e3bac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:17.906108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be36d6b8-fe75-4750-ba9f-08ae58e3bac3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:17.915958 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be36d6b8-fe75-4750-ba9f-08ae58e3bac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:17.921053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-be36d6b8-fe75-4750-ba9f-08ae58e3bac3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:17.921053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:17.921053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:17.921053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:17.921053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:17.921053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:17.921053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:17.921053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:17.921053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:17.921053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:17.921053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:17.921053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:17.921053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:17.921053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:17.921053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:17.921053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:17.922183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:17.922183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:17.922183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:17.922183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:17.922183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:17.922183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:17.922183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:17.922183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:17.922183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:17.922183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:17.922183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:17.922183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:17.922183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:17.922183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:17.922183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:17.922183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:17.923063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:17.923063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:17.923063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:17.923063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:17.923063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:17.923063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:17.923063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:17.923063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:17.923063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:17.923063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:17.923063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:17.923063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:17.923063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 326/639] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:17.923063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36d6b8-fe75-4750-ba9f-08ae58e3bac3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:17.952124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:17.967452 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97a928-bf84-4281-8428-c6017da6a825 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:18.000300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367c2f9-46e4-4626-9c11-fe31820ccabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:18.000900 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367c2f9-46e4-4626-9c11-fe31820ccabb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:18.001176 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367c2f9-46e4-4626-9c11-fe31820ccabb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:18.001442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367c2f9-46e4-4626-9c11-fe31820ccabb None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:18.002156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367c2f9-46e4-4626-9c11-fe31820ccabb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:18.002461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367c2f9-46e4-4626-9c11-fe31820ccabb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:18.003885 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367c2f9-46e4-4626-9c11-fe31820ccabb None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:18.016685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 314/640] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:18.017934 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8105e-19db-4e60-9cc5-94d83f864c11 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:18.018225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8105e-19db-4e60-9cc5-94d83f864c11 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:18.018510 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8105e-19db-4e60-9cc5-94d83f864c11 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:18.020075 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 315/641] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:18.020630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8105e-19db-4e60-9cc5-94d83f864c11 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:18.024685 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be36d6b8-fe75-4750-ba9f-08ae58e3bac3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:18.057377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f02cd0-b625-4651-ae33-cc4727f67ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:18.058046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f02cd0-b625-4651-ae33-cc4727f67ab3 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:18.058326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f02cd0-b625-4651-ae33-cc4727f67ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:18.058599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f02cd0-b625-4651-ae33-cc4727f67ab3 None admin] PATH_INFO: `/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/aac48cd591b44f2999d2f172262019da/roles/973d37db3ba74af0b63e3570ab311e21` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:18.073133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f02cd0-b625-4651-ae33-cc4727f67ab3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user_id=aac48cd591b44f2999d2f172262019da, role_id=973d37db3ba74af0b63e3570ab311e21)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:18.074605 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f02cd0-b625-4651-ae33-cc4727f67ab3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:18.076452 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:18.120057 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8105e-19db-4e60-9cc5-94d83f864c11 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:18.153532 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826c20f-7b59-44a4-bf75-a1a3a2624a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:18.154125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826c20f-7b59-44a4-bf75-a1a3a2624a32 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:18.154392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826c20f-7b59-44a4-bf75-a1a3a2624a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:18.154661 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826c20f-7b59-44a4-bf75-a1a3a2624a32 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:18.157839 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826c20f-7b59-44a4-bf75-a1a3a2624a32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:18.157839 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826c20f-7b59-44a4-bf75-a1a3a2624a32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:18.157839 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826c20f-7b59-44a4-bf75-a1a3a2624a32 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:18.167934 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 316/642] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:18.168706 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826c20f-7b59-44a4-bf75-a1a3a2624a32 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:18.181950 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 327/643] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 19:00:17 2022] PUT /identity/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/aac48cd591b44f2999d2f172262019da/roles/973d37db3ba74af0b63e3570ab311e21 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:00:18.182699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f02cd0-b625-4651-ae33-cc4727f67ab3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:18.277503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:18.297501 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826c20f-7b59-44a4-bf75-a1a3a2624a32 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:18.299060 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f02cd0-b625-4651-ae33-cc4727f67ab3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:18.312977 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:18.343165 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280077f7-f28d-421c-adfc-32d1537f9869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:18.344016 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280077f7-f28d-421c-adfc-32d1537f9869 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:18.344295 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280077f7-f28d-421c-adfc-32d1537f9869 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:18.344564 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280077f7-f28d-421c-adfc-32d1537f9869 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:18.345291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280077f7-f28d-421c-adfc-32d1537f9869 None admin] RBAC: Adding query filter params (role.id=973d37db3ba74af0b63e3570ab311e21, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=2cfda1bec35145f3bbcc13fae0b7af2e) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:18.345627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280077f7-f28d-421c-adfc-32d1537f9869 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:18.347048 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280077f7-f28d-421c-adfc-32d1537f9869 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:18.347161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7424884-7c6d-47d6-86a0-6b90c674ef51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:18.347699 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7424884-7c6d-47d6-86a0-6b90c674ef51 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:18.347983 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7424884-7c6d-47d6-86a0-6b90c674ef51 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:18.348308 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7424884-7c6d-47d6-86a0-6b90c674ef51 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:18.348981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7424884-7c6d-47d6-86a0-6b90c674ef51 None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:18.349287 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7424884-7c6d-47d6-86a0-6b90c674ef51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:18.350752 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7424884-7c6d-47d6-86a0-6b90c674ef51 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:18.357561 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 328/644] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:00:18 2022] GET /identity/v3/role_assignments?user.id=2cfda1bec35145f3bbcc13fae0b7af2e&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=973d37db3ba74af0b63e3570ab311e21 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:18.359559 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bec3b-9099-43ee-b8fc-8eb020768e9a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:18.359858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bec3b-9099-43ee-b8fc-8eb020768e9a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:18.360328 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bec3b-9099-43ee-b8fc-8eb020768e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:18.362195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 317/645] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:00:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:18.362879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7424884-7c6d-47d6-86a0-6b90c674ef51 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:18.381318 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c05bec3b-9099-43ee-b8fc-8eb020768e9a None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:18.382843 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c05bec3b-9099-43ee-b8fc-8eb020768e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:18.474574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 329/646] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:18.475753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bec3b-9099-43ee-b8fc-8eb020768e9a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:18.495448 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7424884-7c6d-47d6-86a0-6b90c674ef51 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:18.544371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ff09a-e054-4b14-8896-661eff0e67dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:18.545004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ff09a-e054-4b14-8896-661eff0e67dd None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:18.545282 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ff09a-e054-4b14-8896-661eff0e67dd None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:18.545581 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ff09a-e054-4b14-8896-661eff0e67dd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:18.556159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ff09a-e054-4b14-8896-661eff0e67dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:18.557955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ff09a-e054-4b14-8896-661eff0e67dd None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:18.572013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-301ff09a-e054-4b14-8896-661eff0e67dd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 19:00:18.572013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:18.572013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:18.572013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:18.572013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:18.572013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:18.572013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:18.572013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:18.572013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:18.572013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:18.572013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:18.572013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:18.572013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:18.572013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:18.572013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:18.572013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:18.573000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:18.573000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:18.573000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:18.573000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:18.573000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:18.573000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:18.573000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:18.573000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:18.573000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:18.573000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:18.573000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:18.573000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:18.573000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:18.573000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:18.573000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:18.573000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:18.573000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:18.573000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:18.574482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:18.574482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:18.574482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:18.574482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:18.574482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:18.574482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:18.574482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:18.574482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:18.574482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 19:00:18.574482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:18.574482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 318/647] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:00:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:18.574482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ff09a-e054-4b14-8896-661eff0e67dd None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:18.579568 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:18.606936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bec3b-9099-43ee-b8fc-8eb020768e9a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:18.628666 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:18.655341 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb22ca-7c0e-4dbf-9ef9-7118302dc4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:18.656523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb22ca-7c0e-4dbf-9ef9-7118302dc4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:18.656798 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb22ca-7c0e-4dbf-9ef9-7118302dc4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:18.657226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb22ca-7c0e-4dbf-9ef9-7118302dc4c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:18.670129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb22ca-7c0e-4dbf-9ef9-7118302dc4c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:18.671117 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfb22ca-7c0e-4dbf-9ef9-7118302dc4c4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:18.686856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-5cfb22ca-7c0e-4dbf-9ef9-7118302dc4c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:18.686856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:18.686856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:18.686856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:18.686856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:18.686856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:18.686856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:18.686856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:18.686856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:18.686856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:18.686856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:18.686856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:18.686856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:18.686856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:18.686856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:18.686856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:18.688431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:18.688431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:18.688431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:18.688431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:18.688431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:18.688431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:18.688431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:18.688431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:18.688431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:18.688431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:18.688431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:18.688431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:18.688431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:18.688431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:18.688431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:18.688431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:18.688431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:18.689330 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:18.689330 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:18.689330 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:18.689330 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 330/648] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:18.689929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb22ca-7c0e-4dbf-9ef9-7118302dc4c4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:18.711045 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ff09a-e054-4b14-8896-661eff0e67dd None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:18.747218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2713d-b9ef-40c1-81e1-09a77efd4469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:18.747956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2713d-b9ef-40c1-81e1-09a77efd4469 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:18.748295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2713d-b9ef-40c1-81e1-09a77efd4469 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:18.748656 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2713d-b9ef-40c1-81e1-09a77efd4469 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:18.760715 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2713d-b9ef-40c1-81e1-09a77efd4469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:18.766063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-99b2713d-b9ef-40c1-81e1-09a77efd4469 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:18.766063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:18.766063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:18.766063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:18.766063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:18.766063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:18.766063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:18.766063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:18.766063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:18.766063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:18.766063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:18.766063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:18.766063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:18.766063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:18.766063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:18.766063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:18.767040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:18.767040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:18.767040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:18.767040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:18.767040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:18.767040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:18.767040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:18.767040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:18.767040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:18.767040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:18.767040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:18.767040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:18.767040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:18.767040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:18.767040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:18.767040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:18.767882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:18.767882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:18.767882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:18.767882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:18.767882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:18.767882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:18.767882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:18.767882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:18.767882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:18.767882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:18.767882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:18.767882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:18.767882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 319/649] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:18.768595 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2713d-b9ef-40c1-81e1-09a77efd4469 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:18.819193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb22ca-7c0e-4dbf-9ef9-7118302dc4c4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:18.852631 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:18.864647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1bdf0-4ffe-4202-bf97-d58910227c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:18.869200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1bdf0-4ffe-4202-bf97-d58910227c4d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:18.869200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1bdf0-4ffe-4202-bf97-d58910227c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:18.869200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1bdf0-4ffe-4202-bf97-d58910227c4d None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:18.869200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1bdf0-4ffe-4202-bf97-d58910227c4d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:18.869200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1bdf0-4ffe-4202-bf97-d58910227c4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:18.870417 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1bdf0-4ffe-4202-bf97-d58910227c4d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:18.886058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:18.892963 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2713d-b9ef-40c1-81e1-09a77efd4469 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:18.897663 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 331/650] 10.222.0.65 () {56 vars in 1137 bytes} [Tue Aug 9 19:00:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:18.898708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1bdf0-4ffe-4202-bf97-d58910227c4d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:18.933950 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9191b4-b2d1-448b-8f90-f5d25aa24690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:18.934561 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9191b4-b2d1-448b-8f90-f5d25aa24690 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:18.934915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9191b4-b2d1-448b-8f90-f5d25aa24690 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:18.935292 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9191b4-b2d1-448b-8f90-f5d25aa24690 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:18.936004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9191b4-b2d1-448b-8f90-f5d25aa24690 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:18.936467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9191b4-b2d1-448b-8f90-f5d25aa24690 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:18.937989 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9191b4-b2d1-448b-8f90-f5d25aa24690 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:18.954030 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 320/651] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:18.955155 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9191b4-b2d1-448b-8f90-f5d25aa24690 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:19.036611 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1bdf0-4ffe-4202-bf97-d58910227c4d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:19.072275 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9191b4-b2d1-448b-8f90-f5d25aa24690 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:19.082026 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a1056-5ac2-48d7-9ecc-999ce77620b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:19.083347 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a1056-5ac2-48d7-9ecc-999ce77620b6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:19.083811 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a1056-5ac2-48d7-9ecc-999ce77620b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:19.084260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a1056-5ac2-48d7-9ecc-999ce77620b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:19.085560 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a1056-5ac2-48d7-9ecc-999ce77620b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:19.086305 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a1056-5ac2-48d7-9ecc-999ce77620b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:19.088126 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a1056-5ac2-48d7-9ecc-999ce77620b6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:19.099972 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 332/652] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:00:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:19.101017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a1056-5ac2-48d7-9ecc-999ce77620b6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:19.111808 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95e89f-2b6f-4f9b-8aed-68ebadcad69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:19.112892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95e89f-2b6f-4f9b-8aed-68ebadcad69a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:19.112892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95e89f-2b6f-4f9b-8aed-68ebadcad69a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:19.113127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95e89f-2b6f-4f9b-8aed-68ebadcad69a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:19.146905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:19.155472 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:19.203468 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95e89f-2b6f-4f9b-8aed-68ebadcad69a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:19.206338 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95e89f-2b6f-4f9b-8aed-68ebadcad69a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:19.213992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a1056-5ac2-48d7-9ecc-999ce77620b6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:19.253621 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56609c-c2d3-4e10-b308-ea6eb15af234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:19.254411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56609c-c2d3-4e10-b308-ea6eb15af234 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:19.254796 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56609c-c2d3-4e10-b308-ea6eb15af234 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:19.255137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56609c-c2d3-4e10-b308-ea6eb15af234 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:19.263766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56609c-c2d3-4e10-b308-ea6eb15af234 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:19.265897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56609c-c2d3-4e10-b308-ea6eb15af234 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:19.278420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ec56609c-c2d3-4e10-b308-ea6eb15af234 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 19:00:19.278420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:19.278420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:19.278420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:19.278420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:19.278420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:19.278420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:19.278420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:19.278420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:19.278420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:19.278420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:19.278420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:19.278420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:19.278420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:19.278420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:19.278420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:19.279846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:19.279846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:19.279846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:19.279846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:19.279846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:19.279846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:19.279846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:19.279846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:19.279846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:19.279846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:19.279846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:19.279846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:19.279846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:19.279846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:19.279846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:19.279846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:19.279846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:19.279846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:19.281406 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:19.281406 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:19.281406 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:19.281406 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:19.281406 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:19.281406 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:19.281406 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:19.281406 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:19.281406 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 19:00:19.281406 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:19.284854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 333/653] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:00:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:19.286386 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56609c-c2d3-4e10-b308-ea6eb15af234 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:19.338224 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 321/654] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:00:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 19:00:19.339394 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95e89f-2b6f-4f9b-8aed-68ebadcad69a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:19.390770 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56609c-c2d3-4e10-b308-ea6eb15af234 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:19.398441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:19.418961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:19.432474 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7431d-27d3-4fca-b30a-63b4215aeb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:19.433331 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7431d-27d3-4fca-b30a-63b4215aeb53 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:19.433798 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7431d-27d3-4fca-b30a-63b4215aeb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:19.434242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7431d-27d3-4fca-b30a-63b4215aeb53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:19.449586 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7431d-27d3-4fca-b30a-63b4215aeb53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:19.451995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7431d-27d3-4fca-b30a-63b4215aeb53 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:19.464084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95e89f-2b6f-4f9b-8aed-68ebadcad69a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:19.471027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-4dc7431d-27d3-4fca-b30a-63b4215aeb53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:19.471027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:19.471027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:19.471027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:19.471027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:19.471027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:19.471027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:19.471027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:19.471027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:19.471027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:19.471027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:19.471027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:19.471027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:19.471027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:19.471027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:19.471027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:19.472150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:19.472150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:19.472150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:19.472150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:19.472150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:19.472150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:19.472150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:19.472150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:19.472150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:19.472150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:19.472150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:19.472150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:19.472150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:19.472150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:19.472150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:19.472150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:19.472150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:19.473053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:19.473053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:19.473053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:19.475447 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 334/655] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:19.476409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7431d-27d3-4fca-b30a-63b4215aeb53 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:19.517036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0c768-d730-4b7e-b88f-85c3e43cf025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:19.519174 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0c768-d730-4b7e-b88f-85c3e43cf025 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:19.520316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0c768-d730-4b7e-b88f-85c3e43cf025 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:19.520913 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0c768-d730-4b7e-b88f-85c3e43cf025 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:19.523621 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0c768-d730-4b7e-b88f-85c3e43cf025 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:19.524168 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0c768-d730-4b7e-b88f-85c3e43cf025 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:19.526007 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0c768-d730-4b7e-b88f-85c3e43cf025 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:19.547194 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 322/656] 10.222.0.65 () {56 vars in 1137 bytes} [Tue Aug 9 19:00:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:19.548354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0c768-d730-4b7e-b88f-85c3e43cf025 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:19.600230 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7431d-27d3-4fca-b30a-63b4215aeb53 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:19.637823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f7263-ac22-4a89-87c9-c915fee7716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:19.638553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f7263-ac22-4a89-87c9-c915fee7716c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:19.638943 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f7263-ac22-4a89-87c9-c915fee7716c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:19.639238 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f7263-ac22-4a89-87c9-c915fee7716c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:19.652134 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f7263-ac22-4a89-87c9-c915fee7716c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:19.653753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f7263-ac22-4a89-87c9-c915fee7716c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:19.658046 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0c768-d730-4b7e-b88f-85c3e43cf025 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:19.668650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-7a2f7263-ac22-4a89-87c9-c915fee7716c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:19.668650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:19.668650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:19.668650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:19.668650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:19.668650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:19.668650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:19.668650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:19.668650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:19.668650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:19.668650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:19.668650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:19.668650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:19.668650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:19.668650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:19.668650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:19.669671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:19.669671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:19.669671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:19.669671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:19.669671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:19.669671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:19.669671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:19.669671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:19.669671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:19.669671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:19.669671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:19.669671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:19.669671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:19.669671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:19.669671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:19.669671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:19.669671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:19.670569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:19.670569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:19.670569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:19.670569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 335/657] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:19.671995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f7263-ac22-4a89-87c9-c915fee7716c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:19.677056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:19.689838 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:19.697916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce78b0c-a8f3-4f3c-b803-5f706c12f805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:19.698674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce78b0c-a8f3-4f3c-b803-5f706c12f805 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:19.699055 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce78b0c-a8f3-4f3c-b803-5f706c12f805 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:19.699422 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce78b0c-a8f3-4f3c-b803-5f706c12f805 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:19.700213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce78b0c-a8f3-4f3c-b803-5f706c12f805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:19.700610 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce78b0c-a8f3-4f3c-b803-5f706c12f805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:19.702157 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce78b0c-a8f3-4f3c-b803-5f706c12f805 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:19.720323 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 323/658] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:19.720323 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce78b0c-a8f3-4f3c-b803-5f706c12f805 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:19.786763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f7263-ac22-4a89-87c9-c915fee7716c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:19.821940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce78b0c-a8f3-4f3c-b803-5f706c12f805 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:19.824065 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b57062-43a1-462d-8809-eef7f94633a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:19.824964 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b57062-43a1-462d-8809-eef7f94633a8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:19.825476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b57062-43a1-462d-8809-eef7f94633a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:19.825951 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b57062-43a1-462d-8809-eef7f94633a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:19.857916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2f1d8-3603-421c-8917-97a349807010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:19.859364 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2f1d8-3603-421c-8917-97a349807010 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:19.859682 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2f1d8-3603-421c-8917-97a349807010 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:19.859959 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2f1d8-3603-421c-8917-97a349807010 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:19.860884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2f1d8-3603-421c-8917-97a349807010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:19.861190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2f1d8-3603-421c-8917-97a349807010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:19.862650 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c2f1d8-3603-421c-8917-97a349807010 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:19.879065 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 324/659] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:19.880195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2f1d8-3603-421c-8917-97a349807010 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:19.901722 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b57062-43a1-462d-8809-eef7f94633a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:19.903477 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b57062-43a1-462d-8809-eef7f94633a8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:19.917796 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:19.925738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:20.013817 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 336/660] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:00:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 19:00:20.014991 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b57062-43a1-462d-8809-eef7f94633a8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:20.016691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2f1d8-3603-421c-8917-97a349807010 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:20.062983 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557da05-ecce-4b44-8695-97db72ecc662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:20.063622 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557da05-ecce-4b44-8695-97db72ecc662 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:20.063925 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557da05-ecce-4b44-8695-97db72ecc662 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:20.064600 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557da05-ecce-4b44-8695-97db72ecc662 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:20.074000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557da05-ecce-4b44-8695-97db72ecc662 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:20.076002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557da05-ecce-4b44-8695-97db72ecc662 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:20.092909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-7557da05-ecce-4b44-8695-97db72ecc662 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 19:00:20.092909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:20.092909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:20.092909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:20.092909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:20.092909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:20.092909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:20.092909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:20.092909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:20.092909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:20.092909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:20.092909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:20.092909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:20.092909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:20.092909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:20.092909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:20.094464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:20.094464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:20.094464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:20.094464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:20.094464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:20.094464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:20.094464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:20.094464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:20.094464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:20.094464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:20.094464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:20.094464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:20.094464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:20.094464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:20.094464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:20.094464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:20.094464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:20.094464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:20.095430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:20.095430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:20.095430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:20.095430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:20.095430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:20.095430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:20.095430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:20.095430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:20.095430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 19:00:20.095430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:20.095430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 325/661] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:20.096045 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557da05-ecce-4b44-8695-97db72ecc662 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:20.135350 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b57062-43a1-462d-8809-eef7f94633a8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:20.148147 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:20.173398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabb945-f676-402e-b6f9-ffd43bdb2635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:20.174428 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabb945-f676-402e-b6f9-ffd43bdb2635 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:20.175085 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabb945-f676-402e-b6f9-ffd43bdb2635 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:20.175611 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabb945-f676-402e-b6f9-ffd43bdb2635 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:20.183546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabb945-f676-402e-b6f9-ffd43bdb2635 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:20.185757 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabb945-f676-402e-b6f9-ffd43bdb2635 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:20.200036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-cfabb945-f676-402e-b6f9-ffd43bdb2635 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:20.200036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:20.200036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:20.200036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:20.200036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:20.200036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:20.200036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:20.200036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:20.200036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:20.200036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:20.200036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:20.200036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:20.200036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:20.200036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:20.200036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:20.201054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:20.201054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:20.201054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:20.201054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:20.201054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:20.201054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:20.201054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:20.201054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:20.201054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:20.201054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:20.201054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:20.201054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:20.201054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:20.201054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:20.201054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:20.201054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:20.201054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:20.201995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:20.201995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:20.201995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:20.201995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:20.201995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:20.201995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:20.201995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:20.201995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:20.204593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 337/662] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:20.205692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabb945-f676-402e-b6f9-ffd43bdb2635 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:20.206778 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:20.213846 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557da05-ecce-4b44-8695-97db72ecc662 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:20.251817 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2e590-3ae8-4e06-8863-5493e3867e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:20.252460 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2e590-3ae8-4e06-8863-5493e3867e91 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:20.252795 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2e590-3ae8-4e06-8863-5493e3867e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:20.253074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2e590-3ae8-4e06-8863-5493e3867e91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:20.265246 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2e590-3ae8-4e06-8863-5493e3867e91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:20.266728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2e590-3ae8-4e06-8863-5493e3867e91 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:20.282723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-b0b2e590-3ae8-4e06-8863-5493e3867e91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:20.282723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:20.282723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:20.282723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:20.282723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:20.282723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:20.282723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:20.282723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:20.282723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:20.282723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:20.282723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:20.282723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:20.282723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:20.282723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:20.282723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:20.282723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:20.283735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:20.283735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:20.283735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:20.283735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:20.283735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:20.283735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:20.283735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:20.283735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:20.283735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:20.283735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:20.283735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:20.283735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:20.283735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:20.283735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:20.283735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:20.283735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:20.283735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:20.284617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:20.284617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:20.284617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:20.284617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 326/663] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:20.285263 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2e590-3ae8-4e06-8863-5493e3867e91 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:20.323414 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabb945-f676-402e-b6f9-ffd43bdb2635 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:20.359909 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a0dbd-0693-4012-9046-e4e0c876df4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:20.360582 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a0dbd-0693-4012-9046-e4e0c876df4a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:20.360780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a0dbd-0693-4012-9046-e4e0c876df4a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:20.361034 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a0dbd-0693-4012-9046-e4e0c876df4a None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:20.361797 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a0dbd-0693-4012-9046-e4e0c876df4a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:20.362101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a0dbd-0693-4012-9046-e4e0c876df4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:20.363849 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a0dbd-0693-4012-9046-e4e0c876df4a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:20.380617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 338/664] 10.222.0.65 () {56 vars in 1139 bytes} [Tue Aug 9 19:00:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:20.381712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a0dbd-0693-4012-9046-e4e0c876df4a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:20.401310 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2e590-3ae8-4e06-8863-5493e3867e91 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:20.412897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:20.436443 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168598e-d24d-404a-8225-9938ae51d277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:20.437142 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168598e-d24d-404a-8225-9938ae51d277 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:20.437374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168598e-d24d-404a-8225-9938ae51d277 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:20.437765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168598e-d24d-404a-8225-9938ae51d277 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:20.438446 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168598e-d24d-404a-8225-9938ae51d277 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:20.438748 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168598e-d24d-404a-8225-9938ae51d277 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:20.440195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168598e-d24d-404a-8225-9938ae51d277 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:20.452313 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 327/665] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:20.454137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0e6ba-a4f6-4c73-b1ab-69eb4b19216d None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:20.454422 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0e6ba-a4f6-4c73-b1ab-69eb4b19216d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:20.454692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0e6ba-a4f6-4c73-b1ab-69eb4b19216d None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:20.456034 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 328/666] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:20.460550 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0e6ba-a4f6-4c73-b1ab-69eb4b19216d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:20.468907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:20.493324 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a0dbd-0693-4012-9046-e4e0c876df4a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:20.537159 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43285e03-e392-4afd-9b6a-cedd6ea8b616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:20.537781 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43285e03-e392-4afd-9b6a-cedd6ea8b616 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:20.538056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43285e03-e392-4afd-9b6a-cedd6ea8b616 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:20.538381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43285e03-e392-4afd-9b6a-cedd6ea8b616 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:20.539026 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43285e03-e392-4afd-9b6a-cedd6ea8b616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:20.539330 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43285e03-e392-4afd-9b6a-cedd6ea8b616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:20.540701 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43285e03-e392-4afd-9b6a-cedd6ea8b616 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:20.552190 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 339/667] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:20.552998 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43285e03-e392-4afd-9b6a-cedd6ea8b616 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:20.581953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0e6ba-a4f6-4c73-b1ab-69eb4b19216d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:20.615694 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a57216-075c-49ce-bb9a-249e96ae7173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:20.616296 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a57216-075c-49ce-bb9a-249e96ae7173 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:20.616571 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a57216-075c-49ce-bb9a-249e96ae7173 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:20.616838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a57216-075c-49ce-bb9a-249e96ae7173 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:20.639090 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:20.651892 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43285e03-e392-4afd-9b6a-cedd6ea8b616 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:20.682784 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a57216-075c-49ce-bb9a-249e96ae7173 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:20.684244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a57216-075c-49ce-bb9a-249e96ae7173 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:20.684530 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f270b-4c60-4a9e-839c-e6097ad7281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:20.685126 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f270b-4c60-4a9e-839c-e6097ad7281c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:20.685404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f270b-4c60-4a9e-839c-e6097ad7281c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:20.685705 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f270b-4c60-4a9e-839c-e6097ad7281c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:20.686422 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f270b-4c60-4a9e-839c-e6097ad7281c None admin] RBAC: Adding query filter params (role.id=973d37db3ba74af0b63e3570ab311e21, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=98d8000eb20445b78ee56ac372cd024c) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:20.686726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f270b-4c60-4a9e-839c-e6097ad7281c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:20.688150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f270b-4c60-4a9e-839c-e6097ad7281c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:20.692535 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:20.693799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 340/668] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:00:20 2022] GET /identity/v3/role_assignments?user.id=98d8000eb20445b78ee56ac372cd024c&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=973d37db3ba74af0b63e3570ab311e21 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:20.695014 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d8137-d757-4550-97bb-7d86bb9b4514 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:20.695302 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d8137-d757-4550-97bb-7d86bb9b4514 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:20.695566 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d8137-d757-4550-97bb-7d86bb9b4514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:20.722153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-673d8137-d757-4550-97bb-7d86bb9b4514 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:20.723409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-673d8137-d757-4550-97bb-7d86bb9b4514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:20.792573 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 329/669] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:00:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 19:00:20.793969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf30fc-4306-4672-a848-21d8d0579498 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:20.794347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf30fc-4306-4672-a848-21d8d0579498 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:20.794695 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf30fc-4306-4672-a848-21d8d0579498 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:20.800349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 330/670] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:20.800349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf30fc-4306-4672-a848-21d8d0579498 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:20.808118 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 341/671] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:20.809418 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d8137-d757-4550-97bb-7d86bb9b4514 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:20.920896 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:20.929263 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf30fc-4306-4672-a848-21d8d0579498 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:20.936805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:20.941579 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d8137-d757-4550-97bb-7d86bb9b4514 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:20.965498 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aabf42-ddf7-401a-8774-34827b263dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:20.966141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aabf42-ddf7-401a-8774-34827b263dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:20.966418 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aabf42-ddf7-401a-8774-34827b263dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:20.966691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aabf42-ddf7-401a-8774-34827b263dd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:20.973978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aabf42-ddf7-401a-8774-34827b263dd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:20.975424 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aabf42-ddf7-401a-8774-34827b263dd7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:20.982448 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cc9e1-1558-4316-9095-cce209a2eb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:20.983312 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cc9e1-1558-4316-9095-cce209a2eb27 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:20.983801 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cc9e1-1558-4316-9095-cce209a2eb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:20.984435 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cc9e1-1558-4316-9095-cce209a2eb27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:20.986746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-05aabf42-ddf7-401a-8774-34827b263dd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:20.986746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:20.986746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:20.986746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:20.986746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:20.986746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:20.986746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:20.986746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:20.986746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:20.986746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:20.986746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:20.986746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:20.986746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:20.986746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:20.986746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:20.987802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:20.987802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:20.987802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:20.987802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:20.987802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:20.987802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:20.987802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:20.987802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:20.987802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:20.987802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:20.987802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:20.987802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:20.987802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:20.987802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:20.987802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:20.987802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:20.987802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:20.988982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:20.988982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:20.988982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:20.988982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:20.988982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:20.988982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:20.988982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:20.988982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:20.988982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 331/672] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:20.990132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a1ec0-755e-4d21-95ab-36408d9e3b6c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:20.990819 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a1ec0-755e-4d21-95ab-36408d9e3b6c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:20.991090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a1ec0-755e-4d21-95ab-36408d9e3b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:21.000389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cc9e1-1558-4316-9095-cce209a2eb27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:21.002079 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cc9e1-1558-4316-9095-cce209a2eb27 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:21.009246 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-616a1ec0-755e-4d21-95ab-36408d9e3b6c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:21.010471 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-616a1ec0-755e-4d21-95ab-36408d9e3b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:21.019876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-071cc9e1-1558-4316-9095-cce209a2eb27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:21.019876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:21.019876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:21.019876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:21.019876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:21.019876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:21.019876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:21.019876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:21.019876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:21.019876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:21.019876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:21.019876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:21.019876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:21.019876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:21.019876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:21.019876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:21.020996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:21.020996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:21.020996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:21.020996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:21.020996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:21.020996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:21.020996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:21.020996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:21.020996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:21.020996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:21.020996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:21.020996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:21.020996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:21.020996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:21.020996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:21.020996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:21.020996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:21.022554 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:21.022554 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:21.022554 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:21.022554 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 342/673] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:21.023036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cc9e1-1558-4316-9095-cce209a2eb27 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:21.086472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 332/674] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:21.087236 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a1ec0-755e-4d21-95ab-36408d9e3b6c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:21.135558 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cc9e1-1558-4316-9095-cce209a2eb27 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:21.174360 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a63af-be99-4b70-baf4-5d78f3e895cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:21.175007 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a63af-be99-4b70-baf4-5d78f3e895cb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:21.175289 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a63af-be99-4b70-baf4-5d78f3e895cb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:21.175565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a63af-be99-4b70-baf4-5d78f3e895cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:21.177941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:21.187940 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a63af-be99-4b70-baf4-5d78f3e895cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:21.192823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-121a63af-be99-4b70-baf4-5d78f3e895cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:21.192823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:21.192823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:21.192823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:21.192823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:21.192823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:21.192823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:21.192823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:21.192823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:21.192823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:21.192823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:21.192823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:21.192823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:21.192823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:21.192823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:21.192823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:21.193802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:21.193802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:21.193802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:21.193802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:21.193802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:21.193802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:21.193802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:21.193802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:21.193802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:21.193802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:21.193802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:21.193802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:21.193802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:21.193802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:21.193802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:21.193802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:21.194684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:21.194684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:21.194684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:21.194684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:21.194684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:21.194684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:21.194684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:21.194684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:21.194684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:21.194684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:21.194684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:21.194684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:21.199243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 343/675] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:21.199958 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a63af-be99-4b70-baf4-5d78f3e895cb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:21.208457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:21.215050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a1ec0-755e-4d21-95ab-36408d9e3b6c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:21.250889 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5f80d-7ae1-4392-86a6-6acae3eb3b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:21.251652 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5f80d-7ae1-4392-86a6-6acae3eb3b21 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:21.252023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5f80d-7ae1-4392-86a6-6acae3eb3b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:21.252388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5f80d-7ae1-4392-86a6-6acae3eb3b21 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:21.253179 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5f80d-7ae1-4392-86a6-6acae3eb3b21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:21.253611 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5f80d-7ae1-4392-86a6-6acae3eb3b21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:21.255139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5f80d-7ae1-4392-86a6-6acae3eb3b21 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:21.272844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 333/676] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:21.272844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5f80d-7ae1-4392-86a6-6acae3eb3b21 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:21.315221 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a63af-be99-4b70-baf4-5d78f3e895cb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:21.350721 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c5576-4b54-4a69-85a0-3f01574d3f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:21.351361 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c5576-4b54-4a69-85a0-3f01574d3f37 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:21.351566 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c5576-4b54-4a69-85a0-3f01574d3f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:21.351780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c5576-4b54-4a69-85a0-3f01574d3f37 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:21.352829 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c5576-4b54-4a69-85a0-3f01574d3f37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:21.353134 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c5576-4b54-4a69-85a0-3f01574d3f37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:21.354886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c5576-4b54-4a69-85a0-3f01574d3f37 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:21.367974 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 344/677] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:21.370608 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c5576-4b54-4a69-85a0-3f01574d3f37 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:21.378350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5f80d-7ae1-4392-86a6-6acae3eb3b21 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:21.416102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8cf7c-14ed-429d-b79d-7eb2aa8fd570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:21.416732 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8cf7c-14ed-429d-b79d-7eb2aa8fd570 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:21.417005 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8cf7c-14ed-429d-b79d-7eb2aa8fd570 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:21.417270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8cf7c-14ed-429d-b79d-7eb2aa8fd570 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:21.427863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8cf7c-14ed-429d-b79d-7eb2aa8fd570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:21.430058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:21.432928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-fdb8cf7c-14ed-429d-b79d-7eb2aa8fd570 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:00:21.432928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:21.432928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:21.432928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:21.432928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:21.432928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:21.432928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:21.432928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:21.432928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:21.432928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:21.432928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:21.432928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:21.432928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:21.432928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:21.432928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:21.432928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:21.434092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:21.434092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:21.434092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:21.434092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:21.434092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:21.434092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:21.434092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:21.434092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:21.434092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:21.434092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:21.434092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:21.434092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:21.434092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:21.434092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:21.434092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:21.434092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:21.435172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:21.435172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:21.435172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:21.435172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:21.435172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:21.435172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:21.435172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:21.435172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:21.435172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:21.435172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:21.435172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:00:21.435172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:21.439054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 334/678] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:00:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:21.439943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8cf7c-14ed-429d-b79d-7eb2aa8fd570 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:21.459712 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:21.482768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c5576-4b54-4a69-85a0-3f01574d3f37 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:21.529174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8326654-1623-416e-acb1-4ddbe6f43e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:21.529816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8326654-1623-416e-acb1-4ddbe6f43e68 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:21.530101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8326654-1623-416e-acb1-4ddbe6f43e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:21.530403 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8326654-1623-416e-acb1-4ddbe6f43e68 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:21.531575 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8326654-1623-416e-acb1-4ddbe6f43e68 None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:21.531961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8326654-1623-416e-acb1-4ddbe6f43e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:21.533232 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8326654-1623-416e-acb1-4ddbe6f43e68 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:21.545880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 345/679] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:00:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:21.545880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8326654-1623-416e-acb1-4ddbe6f43e68 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:21.554818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8cf7c-14ed-429d-b79d-7eb2aa8fd570 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:21.590127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2da34-633b-4dc5-8816-b7bebcbfc0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:21.590733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2da34-633b-4dc5-8816-b7bebcbfc0aa None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:21.591019 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2da34-633b-4dc5-8816-b7bebcbfc0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:21.591290 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2da34-633b-4dc5-8816-b7bebcbfc0aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:21.592012 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2da34-633b-4dc5-8816-b7bebcbfc0aa None admin] RBAC: Adding query filter params (role.id=973d37db3ba74af0b63e3570ab311e21, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=bca1eca610c64b3a8ab04792dcca18b3) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:21.592688 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2da34-633b-4dc5-8816-b7bebcbfc0aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:21.594896 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2da34-633b-4dc5-8816-b7bebcbfc0aa None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:21.600968 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 335/680] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:00:21 2022] GET /identity/v3/role_assignments?user.id=bca1eca610c64b3a8ab04792dcca18b3&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=973d37db3ba74af0b63e3570ab311e21 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:21.602254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2da34-633b-4dc5-8816-b7bebcbfc0aa None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:21.666153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8326654-1623-416e-acb1-4ddbe6f43e68 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:21.685570 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:21.707512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7c095-640c-4973-aeae-3082bce5b76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:21.709186 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7c095-640c-4973-aeae-3082bce5b76d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:21.709722 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7c095-640c-4973-aeae-3082bce5b76d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:21.710466 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7c095-640c-4973-aeae-3082bce5b76d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:21.721031 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7c095-640c-4973-aeae-3082bce5b76d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:21.723560 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7c095-640c-4973-aeae-3082bce5b76d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:21.727186 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:21.742124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-a9a7c095-640c-4973-aeae-3082bce5b76d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:21.742124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:21.742124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:21.742124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:21.742124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:21.742124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:21.742124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:21.742124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:21.742124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:21.742124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:21.742124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:21.742124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:21.742124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:21.742124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:21.742124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:21.743115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:21.743115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:21.743115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:21.743115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:21.743115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:21.743115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:21.743115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:21.743115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:21.743115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:21.743115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:21.743115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:21.743115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:21.743115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:21.743115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:21.743115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:21.743115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:21.743115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:21.744017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:21.744017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:21.744017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:21.744017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:21.744017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:21.744017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:21.744017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:21.744017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:21.746717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 346/681] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:21.747815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7c095-640c-4973-aeae-3082bce5b76d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:21.758672 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2da34-633b-4dc5-8816-b7bebcbfc0aa None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:21.804276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fe77f-0691-4a09-9008-9a24c08d735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:21.804784 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fe77f-0691-4a09-9008-9a24c08d735e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:21.805067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fe77f-0691-4a09-9008-9a24c08d735e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:21.805349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fe77f-0691-4a09-9008-9a24c08d735e None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:21.806067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fe77f-0691-4a09-9008-9a24c08d735e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:21.806598 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fe77f-0691-4a09-9008-9a24c08d735e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:21.807747 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046fe77f-0691-4a09-9008-9a24c08d735e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:21.817491 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 336/682] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:00:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:21.818317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fe77f-0691-4a09-9008-9a24c08d735e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:21.889587 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7c095-640c-4973-aeae-3082bce5b76d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:21.932546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac290b-849e-4202-8787-8ae9869a6757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:21.933286 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac290b-849e-4202-8787-8ae9869a6757 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:21.933647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac290b-849e-4202-8787-8ae9869a6757 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:21.934051 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac290b-849e-4202-8787-8ae9869a6757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:21.945680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac290b-849e-4202-8787-8ae9869a6757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:21.946941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac290b-849e-4202-8787-8ae9869a6757 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:21.960789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fe77f-0691-4a09-9008-9a24c08d735e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:21.964056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-85ac290b-849e-4202-8787-8ae9869a6757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:21.964056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:21.964056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:21.964056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:21.964056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:21.964056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:21.964056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:21.964056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:21.964056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:21.964056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:21.964056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:21.964056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:21.964056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:21.964056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:21.964056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:21.964056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:21.965298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:21.965298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:21.965298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:21.965298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:21.965298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:21.965298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:21.965298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:21.965298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:21.965298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:21.965298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:21.965298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:21.965298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:21.965298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:21.965298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:21.965298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:21.965298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:21.965298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:21.966481 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:21.966481 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:21.966481 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:21.966481 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 347/683] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:21.966481 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac290b-849e-4202-8787-8ae9869a6757 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:21.996748 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:22.010723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588081f-19b7-47d4-90ca-9b18f63cf103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:22.011848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588081f-19b7-47d4-90ca-9b18f63cf103 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:22.012444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588081f-19b7-47d4-90ca-9b18f63cf103 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:22.012880 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588081f-19b7-47d4-90ca-9b18f63cf103 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:22.014049 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588081f-19b7-47d4-90ca-9b18f63cf103 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:22.014574 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588081f-19b7-47d4-90ca-9b18f63cf103 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:22.017740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588081f-19b7-47d4-90ca-9b18f63cf103 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:22.040713 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 337/684] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:22.040713 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588081f-19b7-47d4-90ca-9b18f63cf103 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:22.041969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:22.094561 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac290b-849e-4202-8787-8ae9869a6757 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:22.135788 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f962f5c-4da2-4b39-9f06-7ba1eece89ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:22.136777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f962f5c-4da2-4b39-9f06-7ba1eece89ab None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:22.137225 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f962f5c-4da2-4b39-9f06-7ba1eece89ab None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:22.137693 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f962f5c-4da2-4b39-9f06-7ba1eece89ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:22.150244 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f962f5c-4da2-4b39-9f06-7ba1eece89ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:22.151892 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f962f5c-4da2-4b39-9f06-7ba1eece89ab None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:22.152570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588081f-19b7-47d4-90ca-9b18f63cf103 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:22.170001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-2f962f5c-4da2-4b39-9f06-7ba1eece89ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:22.170001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:22.170001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:22.170001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:22.170001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:22.170001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:22.170001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:22.170001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:22.170001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:22.170001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:22.170001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:22.170001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:22.170001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:22.170001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:22.170001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:22.170001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:22.171712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:22.171712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:22.171712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:22.171712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:22.171712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:22.171712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:22.171712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:22.171712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:22.171712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:22.171712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:22.171712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:22.171712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:22.171712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:22.171712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:22.171712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:22.171712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:22.171712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:22.172667 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:22.172667 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:22.172667 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:22.172667 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 348/685] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:22.173168 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f962f5c-4da2-4b39-9f06-7ba1eece89ab None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:22.206000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad1e0e-996d-41ec-82f9-2950ea947656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:22.206890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad1e0e-996d-41ec-82f9-2950ea947656 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:22.207170 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad1e0e-996d-41ec-82f9-2950ea947656 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:22.207441 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad1e0e-996d-41ec-82f9-2950ea947656 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:22.208337 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad1e0e-996d-41ec-82f9-2950ea947656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:22.208666 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad1e0e-996d-41ec-82f9-2950ea947656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:22.210698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad1e0e-996d-41ec-82f9-2950ea947656 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:22.229564 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 338/686] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:22.230465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad1e0e-996d-41ec-82f9-2950ea947656 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:22.284183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:22.307905 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f962f5c-4da2-4b39-9f06-7ba1eece89ab None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:22.314458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:22.355466 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1105e1-1d8d-435b-a94e-5d5c7677f7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:22.357265 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1105e1-1d8d-435b-a94e-5d5c7677f7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:22.357770 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1105e1-1d8d-435b-a94e-5d5c7677f7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:22.358221 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1105e1-1d8d-435b-a94e-5d5c7677f7a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:22.359923 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1105e1-1d8d-435b-a94e-5d5c7677f7a0 None admin] RBAC: Adding query filter params (role.id=973d37db3ba74af0b63e3570ab311e21, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=a62d954163ca4bf298f461b4d253269e) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:22.360678 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1105e1-1d8d-435b-a94e-5d5c7677f7a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:22.362495 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1105e1-1d8d-435b-a94e-5d5c7677f7a0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:22.365846 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad1e0e-996d-41ec-82f9-2950ea947656 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:22.376651 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 349/687] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:00:22 2022] GET /identity/v3/role_assignments?user.id=a62d954163ca4bf298f461b4d253269e&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=973d37db3ba74af0b63e3570ab311e21 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:22.376651 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1105e1-1d8d-435b-a94e-5d5c7677f7a0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:22.446799 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39425a56-08b6-4b9c-ad6a-0eb093a75b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:22.447338 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425a56-08b6-4b9c-ad6a-0eb093a75b93 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:22.447619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425a56-08b6-4b9c-ad6a-0eb093a75b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:22.447890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425a56-08b6-4b9c-ad6a-0eb093a75b93 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:22.452696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39425a56-08b6-4b9c-ad6a-0eb093a75b93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:22.454458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39425a56-08b6-4b9c-ad6a-0eb093a75b93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:22.455945 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39425a56-08b6-4b9c-ad6a-0eb093a75b93 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:22.490555 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 339/688] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:22.508213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39425a56-08b6-4b9c-ad6a-0eb093a75b93 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:22.577412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1105e1-1d8d-435b-a94e-5d5c7677f7a0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:22.613883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6df84c-8ddc-42e1-8dfc-7e96b0007569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:22.614866 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6df84c-8ddc-42e1-8dfc-7e96b0007569 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:22.615370 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6df84c-8ddc-42e1-8dfc-7e96b0007569 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:22.615853 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6df84c-8ddc-42e1-8dfc-7e96b0007569 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:22.632367 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6df84c-8ddc-42e1-8dfc-7e96b0007569 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:22.632367 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6df84c-8ddc-42e1-8dfc-7e96b0007569 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:22.649147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39425a56-08b6-4b9c-ad6a-0eb093a75b93 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:22.658266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-bd6df84c-8ddc-42e1-8dfc-7e96b0007569 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 19:00:22.658266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:22.658266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:22.658266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:22.658266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:22.658266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:22.658266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:22.658266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:22.658266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:22.658266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:22.658266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:22.658266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:22.658266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:22.658266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:22.658266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:22.658266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:22.659251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:22.659251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:22.659251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:22.659251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:22.659251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:22.659251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:22.659251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:22.659251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:22.659251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:22.659251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:22.659251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:22.659251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:22.659251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:22.659251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:22.659251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:22.659251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:22.659251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:22.659251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:22.660206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:22.660206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:22.660206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:22.660206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:22.660206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:22.660206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:22.660206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:22.660206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:22.660206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 19:00:22.660206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:22.660206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 350/689] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:00:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:22.665182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6df84c-8ddc-42e1-8dfc-7e96b0007569 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:22.670458 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:22.678232 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:22.695122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccecc6-9c7b-4861-aa7f-841a18dedffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:22.695122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccecc6-9c7b-4861-aa7f-841a18dedffe None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:22.695122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccecc6-9c7b-4861-aa7f-841a18dedffe None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:22.695122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccecc6-9c7b-4861-aa7f-841a18dedffe None admin] PATH_INFO: `/v3/users/nova` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:22.705662 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccecc6-9c7b-4861-aa7f-841a18dedffe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:22.707089 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccecc6-9c7b-4861-aa7f-841a18dedffe None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:22.724148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-04ccecc6-9c7b-4861-aa7f-841a18dedffe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 19:00:22.724148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:22.724148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:22.724148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:22.724148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:22.724148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:22.724148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:22.724148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:22.724148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:22.724148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:22.724148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:22.724148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:22.724148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:22.724148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:22.724148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:22.724148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:22.726392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:22.726392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:22.726392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:22.726392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:22.726392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:22.726392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:22.726392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:22.726392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:22.726392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:22.726392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:22.726392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:22.726392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:22.726392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:22.726392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:22.726392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:22.726392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:22.726392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:22.726392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:22.728486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:22.728486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:22.728486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:22.728486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:22.728486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:22.728486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:22.728486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:22.728486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:22.728486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 19:00:22.728486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:22.728486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 340/690] 10.222.0.65 () {56 vars in 1093 bytes} [Tue Aug 9 19:00:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:22.734961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccecc6-9c7b-4861-aa7f-841a18dedffe None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:22.814610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6df84c-8ddc-42e1-8dfc-7e96b0007569 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:22.861027 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccecc6-9c7b-4861-aa7f-841a18dedffe None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:22.868319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76719405-481f-46c2-9a78-b3b159e61216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:22.869316 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76719405-481f-46c2-9a78-b3b159e61216 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:22.869876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76719405-481f-46c2-9a78-b3b159e61216 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:22.870378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76719405-481f-46c2-9a78-b3b159e61216 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:22.871360 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76719405-481f-46c2-9a78-b3b159e61216 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:22.871881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76719405-481f-46c2-9a78-b3b159e61216 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:22.873713 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76719405-481f-46c2-9a78-b3b159e61216 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:22.894450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 351/691] 10.222.0.65 () {56 vars in 1135 bytes} [Tue Aug 9 19:00:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:22.896054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c978bc-5000-4865-9136-aa416106387b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:22.896541 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c978bc-5000-4865-9136-aa416106387b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:22.897020 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c978bc-5000-4865-9136-aa416106387b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:22.898704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 352/692] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:22.903245 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c978bc-5000-4865-9136-aa416106387b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:22.909070 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9f5fc-9aff-4330-b71d-f2563cff2116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:22.909728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9f5fc-9aff-4330-b71d-f2563cff2116 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:22.910008 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9f5fc-9aff-4330-b71d-f2563cff2116 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:22.910279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9f5fc-9aff-4330-b71d-f2563cff2116 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:22.911008 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9f5fc-9aff-4330-b71d-f2563cff2116 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:22.911309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9f5fc-9aff-4330-b71d-f2563cff2116 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:22.912741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9f5fc-9aff-4330-b71d-f2563cff2116 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:22.939377 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 341/693] 10.222.0.65 () {56 vars in 1133 bytes} [Tue Aug 9 19:00:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:22.939377 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47a3ab-3b7a-4479-b39e-1eb22c8f11c0 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:22.939377 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47a3ab-3b7a-4479-b39e-1eb22c8f11c0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:22.939377 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47a3ab-3b7a-4479-b39e-1eb22c8f11c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:22.959279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3a47a3ab-3b7a-4479-b39e-1eb22c8f11c0 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:22.960458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3a47a3ab-3b7a-4479-b39e-1eb22c8f11c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:23.001700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:23.045525 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 342/694] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:23.045525 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47a3ab-3b7a-4479-b39e-1eb22c8f11c0 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:23.143045 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:23.162934 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47a3ab-3b7a-4479-b39e-1eb22c8f11c0 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:23.186384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c978bc-5000-4865-9136-aa416106387b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:23.209402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1f038-055a-4f30-bd23-0b6f66234061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:23.210887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1f038-055a-4f30-bd23-0b6f66234061 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:23.211333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1f038-055a-4f30-bd23-0b6f66234061 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:23.211996 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1f038-055a-4f30-bd23-0b6f66234061 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:23.230467 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0eb00-30d9-4ece-8da0-7f22e83ea3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:23.231135 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0eb00-30d9-4ece-8da0-7f22e83ea3ab None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:23.231420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0eb00-30d9-4ece-8da0-7f22e83ea3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:23.231697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0eb00-30d9-4ece-8da0-7f22e83ea3ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:23.285868 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:23.296100 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1f038-055a-4f30-bd23-0b6f66234061 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:23.298590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1f038-055a-4f30-bd23-0b6f66234061 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:23.307000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0eb00-30d9-4ece-8da0-7f22e83ea3ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:23.308464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0eb00-30d9-4ece-8da0-7f22e83ea3ab None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:23.376796 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:23.411751 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 343/695] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:00:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 19:00:23.412867 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1f038-055a-4f30-bd23-0b6f66234061 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:23.427723 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 353/696] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:00:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 19:00:23.428926 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0eb00-30d9-4ece-8da0-7f22e83ea3ab None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:23.491350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:23.526371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1f038-055a-4f30-bd23-0b6f66234061 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:23.539440 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0eb00-30d9-4ece-8da0-7f22e83ea3ab None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:23.565605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f0645-830f-4050-bffe-b5a4fc70d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:23.566436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f0645-830f-4050-bffe-b5a4fc70d6cc None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:23.566933 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f0645-830f-4050-bffe-b5a4fc70d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:23.567261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f0645-830f-4050-bffe-b5a4fc70d6cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:23.578860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f0682-8556-4ef4-96e5-7eeb3a3a9295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:23.579234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f0645-830f-4050-bffe-b5a4fc70d6cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:23.579851 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f0682-8556-4ef4-96e5-7eeb3a3a9295 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:23.580302 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f0682-8556-4ef4-96e5-7eeb3a3a9295 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:23.580719 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f0682-8556-4ef4-96e5-7eeb3a3a9295 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:23.581069 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f0645-830f-4050-bffe-b5a4fc70d6cc None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:23.591874 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f0682-8556-4ef4-96e5-7eeb3a3a9295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:23.593830 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f0682-8556-4ef4-96e5-7eeb3a3a9295 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:23.597855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-279f0645-830f-4050-bffe-b5a4fc70d6cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:23.597855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:23.597855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:23.597855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:23.597855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:23.597855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:23.597855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:23.597855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:23.597855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:23.597855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:23.597855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:23.597855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:23.597855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:23.597855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:23.597855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:23.597855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:23.598992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:23.598992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:23.598992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:23.598992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:23.598992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:23.598992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:23.598992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:23.598992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:23.598992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:23.598992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:23.598992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:23.598992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:23.598992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:23.598992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:23.598992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:23.598992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:23.598992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:23.600006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:23.600006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:23.600006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:23.605772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 344/697] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:23.606754 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f0645-830f-4050-bffe-b5a4fc70d6cc None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:23.613243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-4d2f0682-8556-4ef4-96e5-7eeb3a3a9295 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:23.613243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:23.613243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:23.613243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:23.613243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:23.613243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:23.613243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:23.613243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:23.613243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:23.613243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:23.613243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:23.613243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:23.613243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:23.613243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:23.613243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:23.613243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:23.614220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:23.614220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:23.614220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:23.614220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:23.614220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:23.614220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:23.614220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:23.614220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:23.614220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:23.614220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:23.614220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:23.614220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:23.614220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:23.614220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:23.614220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:23.614220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:23.614220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:23.615136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:23.615136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:23.615136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:23.617269 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 354/698] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:23.618303 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f0682-8556-4ef4-96e5-7eeb3a3a9295 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:23.641422 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:23.728489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f0645-830f-4050-bffe-b5a4fc70d6cc None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:23.730936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f0682-8556-4ef4-96e5-7eeb3a3a9295 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:23.755940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:23.770761 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb90133-692d-4f14-9926-94c292894585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:23.771134 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155330c1-95fc-4b04-9cb0-8208ee22efc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:23.771732 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155330c1-95fc-4b04-9cb0-8208ee22efc3 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:23.772013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155330c1-95fc-4b04-9cb0-8208ee22efc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:23.772353 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155330c1-95fc-4b04-9cb0-8208ee22efc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:23.772652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb90133-692d-4f14-9926-94c292894585 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:23.773299 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb90133-692d-4f14-9926-94c292894585 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:23.773813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb90133-692d-4f14-9926-94c292894585 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:23.774672 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb90133-692d-4f14-9926-94c292894585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:23.775193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb90133-692d-4f14-9926-94c292894585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:23.776761 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb90133-692d-4f14-9926-94c292894585 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:23.785109 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155330c1-95fc-4b04-9cb0-8208ee22efc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:23.787360 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155330c1-95fc-4b04-9cb0-8208ee22efc3 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:23.790816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 355/699] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:23.791956 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb90133-692d-4f14-9926-94c292894585 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:23.803281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-155330c1-95fc-4b04-9cb0-8208ee22efc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:23.803281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:23.803281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:23.803281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:23.803281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:23.803281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:23.803281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:23.803281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:23.803281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:23.803281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:23.803281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:23.803281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:23.803281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:23.803281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:23.803281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:23.803281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:23.804403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:23.804403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:23.804403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:23.804403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:23.804403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:23.804403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:23.804403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:23.804403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:23.804403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:23.804403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:23.804403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:23.804403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:23.804403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:23.804403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:23.804403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:23.804403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:23.804403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:23.805330 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:23.805330 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:23.805330 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:23.805330 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 345/700] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:23.806374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba77bc-86e2-4179-9458-205048ab8026 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:23.806374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba77bc-86e2-4179-9458-205048ab8026 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:23.806374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba77bc-86e2-4179-9458-205048ab8026 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:23.807551 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 346/701] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:23.809522 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba77bc-86e2-4179-9458-205048ab8026 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:23.886029 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:23.911744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb90133-692d-4f14-9926-94c292894585 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:23.916959 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba77bc-86e2-4179-9458-205048ab8026 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:23.948782 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f757b9-9c6b-4e77-94af-9217390c28c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:23.949735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f757b9-9c6b-4e77-94af-9217390c28c8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:23.950273 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f757b9-9c6b-4e77-94af-9217390c28c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:23.950560 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f757b9-9c6b-4e77-94af-9217390c28c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:23.951200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f757b9-9c6b-4e77-94af-9217390c28c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:23.951506 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f757b9-9c6b-4e77-94af-9217390c28c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:23.953022 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f757b9-9c6b-4e77-94af-9217390c28c8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:23.954477 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07553455-d856-4267-83dd-22d654e86cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:23.955153 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07553455-d856-4267-83dd-22d654e86cfa None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:23.955439 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07553455-d856-4267-83dd-22d654e86cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:23.955712 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07553455-d856-4267-83dd-22d654e86cfa None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:23.956414 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07553455-d856-4267-83dd-22d654e86cfa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:23.957880 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07553455-d856-4267-83dd-22d654e86cfa None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:23.966202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 356/702] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:23.968478 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f757b9-9c6b-4e77-94af-9217390c28c8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:24.067520 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f757b9-9c6b-4e77-94af-9217390c28c8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:24.100845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd313e1e-251b-418c-a533-82e7013dc473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:24.101445 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd313e1e-251b-418c-a533-82e7013dc473 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:24.101756 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd313e1e-251b-418c-a533-82e7013dc473 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:24.102024 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd313e1e-251b-418c-a533-82e7013dc473 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:24.102655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd313e1e-251b-418c-a533-82e7013dc473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:24.103009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd313e1e-251b-418c-a533-82e7013dc473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:24.104366 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd313e1e-251b-418c-a533-82e7013dc473 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:24.105941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:24.110566 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 347/703] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Aug 9 19:00:23 2022] POST /identity/v3/users => generated 254 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:00:24.111808 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b40af-aa56-4b36-a569-9fb1985efa28 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:24.112094 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b40af-aa56-4b36-a569-9fb1985efa28 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:24.112365 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b40af-aa56-4b36-a569-9fb1985efa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:24.130117 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 357/704] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:24.131683 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd313e1e-251b-418c-a533-82e7013dc473 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:24.145092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-666b40af-aa56-4b36-a569-9fb1985efa28 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:24.146503 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-666b40af-aa56-4b36-a569-9fb1985efa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:24.175343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:24.231691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 348/705] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:24.231691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b40af-aa56-4b36-a569-9fb1985efa28 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:24.281011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd313e1e-251b-418c-a533-82e7013dc473 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:24.320921 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070feb1e-0a0b-463e-9280-5a309839f902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:24.321857 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070feb1e-0a0b-463e-9280-5a309839f902 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:24.321857 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070feb1e-0a0b-463e-9280-5a309839f902 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:24.322042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070feb1e-0a0b-463e-9280-5a309839f902 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:24.330094 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070feb1e-0a0b-463e-9280-5a309839f902 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:24.331704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070feb1e-0a0b-463e-9280-5a309839f902 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:24.344291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-070feb1e-0a0b-463e-9280-5a309839f902 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:24.344291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:24.344291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:24.344291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:24.344291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:24.344291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:24.344291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:24.344291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:24.344291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:24.344291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:24.344291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:24.344291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:24.344291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:24.344291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:24.344291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:24.345249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:24.345249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:24.345249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:24.345249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:24.345249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:24.345249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:24.345249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:24.345249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:24.345249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:24.345249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:24.345249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:24.345249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:24.345249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:24.345249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:24.345249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:24.345249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:24.345249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:24.346217 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:24.346217 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:24.346217 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:24.346217 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:24.346217 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:24.346217 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:24.346217 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:24.346217 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:24.346217 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 358/706] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:24.347623 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070feb1e-0a0b-463e-9280-5a309839f902 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:24.407080 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:24.420756 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b40af-aa56-4b36-a569-9fb1985efa28 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:24.461430 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070feb1e-0a0b-463e-9280-5a309839f902 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:24.466274 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cb48d-7747-46ca-b6f8-6f4d6b8eb65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:24.466989 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cb48d-7747-46ca-b6f8-6f4d6b8eb65b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:24.467341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cb48d-7747-46ca-b6f8-6f4d6b8eb65b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:24.467683 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cb48d-7747-46ca-b6f8-6f4d6b8eb65b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:24.477023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cb48d-7747-46ca-b6f8-6f4d6b8eb65b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:24.479951 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cb48d-7747-46ca-b6f8-6f4d6b8eb65b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:24.498981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-3e2cb48d-7747-46ca-b6f8-6f4d6b8eb65b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:24.498981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:24.498981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:24.498981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:24.498981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:24.498981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:24.498981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:24.498981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:24.498981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:24.498981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:24.498981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:24.498981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:24.498981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:24.498981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:24.498981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:24.500943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:24.500943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:24.500943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:24.500943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:24.500943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:24.500943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:24.500943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:24.500943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:24.500943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:24.500943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:24.500943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:24.500943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:24.500943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:24.500943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:24.500943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:24.500943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:24.500943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:24.501932 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:24.501932 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:24.501932 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:24.501932 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:24.501932 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:24.501932 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:24.501932 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:24.501932 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:24.502366 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d76b21-d81e-4865-9198-7d27fd06810a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:24.505861 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d76b21-d81e-4865-9198-7d27fd06810a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:24.506644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d76b21-d81e-4865-9198-7d27fd06810a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:24.507121 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d76b21-d81e-4865-9198-7d27fd06810a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:24.507990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d76b21-d81e-4865-9198-7d27fd06810a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:24.511943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 349/707] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:24.511943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cb48d-7747-46ca-b6f8-6f4d6b8eb65b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:24.515637 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d76b21-d81e-4865-9198-7d27fd06810a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:24.528739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-c1d76b21-d81e-4865-9198-7d27fd06810a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 19:00:24.528739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:24.528739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:00:24.528739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:00:24.528739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:00:24.528739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:00:24.528739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:00:24.528739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:24.528739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 19:00:24.528739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:24.528739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:24.528739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:24.528739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:24.528739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:24.528739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:24.528739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:24.528739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:24.530137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:24.530137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:24.530137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:24.530137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:24.530137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:24.530137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:24.530137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:00:24.530137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:00:24.530137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:00:24.530137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:00:24.530137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:24.530137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:24.530137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:24.530137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:24.530137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:24.530137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:24.531539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:24.531539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:24.531539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:24.531539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:24.531539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:24.531539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:24.531539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:24.531539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:24.531539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:24.531539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:24.531539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:00:24.531539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:24.531539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 19:00:24.531539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:24.534388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:24.539591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 359/708] 10.222.0.65 () {56 vars in 1129 bytes} [Tue Aug 9 19:00:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:24.539591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d76b21-d81e-4865-9198-7d27fd06810a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:24.629599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cb48d-7747-46ca-b6f8-6f4d6b8eb65b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:24.642225 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d76b21-d81e-4865-9198-7d27fd06810a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:24.660738 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:24.669611 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09d317-8c4b-46ab-8a39-0a6cc5cb19ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:24.670507 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09d317-8c4b-46ab-8a39-0a6cc5cb19ae None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:24.671266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09d317-8c4b-46ab-8a39-0a6cc5cb19ae None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:24.676847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09d317-8c4b-46ab-8a39-0a6cc5cb19ae None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:24.676847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09d317-8c4b-46ab-8a39-0a6cc5cb19ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:24.676847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09d317-8c4b-46ab-8a39-0a6cc5cb19ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:24.676847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09d317-8c4b-46ab-8a39-0a6cc5cb19ae None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:24.677806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f11c1f-3424-47e1-9922-45c5fefd663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:24.678389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f11c1f-3424-47e1-9922-45c5fefd663d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:24.678672 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f11c1f-3424-47e1-9922-45c5fefd663d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:24.678943 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f11c1f-3424-47e1-9922-45c5fefd663d None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:24.679648 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f11c1f-3424-47e1-9922-45c5fefd663d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:24.679953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f11c1f-3424-47e1-9922-45c5fefd663d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:24.681383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f11c1f-3424-47e1-9922-45c5fefd663d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:24.689680 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 350/709] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:24.690463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09d317-8c4b-46ab-8a39-0a6cc5cb19ae None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:24.694708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 360/710] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:24.695511 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289b4dd-9d37-4e21-92a2-e39e1efe985e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:24.695799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289b4dd-9d37-4e21-92a2-e39e1efe985e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:24.696073 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289b4dd-9d37-4e21-92a2-e39e1efe985e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:24.697544 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 361/711] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:24.698254 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289b4dd-9d37-4e21-92a2-e39e1efe985e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:24.780093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:24.799959 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09d317-8c4b-46ab-8a39-0a6cc5cb19ae None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:24.808039 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289b4dd-9d37-4e21-92a2-e39e1efe985e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:24.838837 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de171a1b-01af-458f-be15-cac1cc0cea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:24.839432 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de171a1b-01af-458f-be15-cac1cc0cea9e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:24.839703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de171a1b-01af-458f-be15-cac1cc0cea9e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:24.839969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de171a1b-01af-458f-be15-cac1cc0cea9e None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:24.840876 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de171a1b-01af-458f-be15-cac1cc0cea9e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:24.841178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de171a1b-01af-458f-be15-cac1cc0cea9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:24.842578 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de171a1b-01af-458f-be15-cac1cc0cea9e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:24.843929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229bf0c-bc90-4ac4-943a-0301432fce4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:24.844802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229bf0c-bc90-4ac4-943a-0301432fce4b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:24.845083 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229bf0c-bc90-4ac4-943a-0301432fce4b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:24.845531 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229bf0c-bc90-4ac4-943a-0301432fce4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:24.846257 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229bf0c-bc90-4ac4-943a-0301432fce4b None admin] RBAC: Adding query filter params (role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=2cfda1bec35145f3bbcc13fae0b7af2e) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:24.846567 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229bf0c-bc90-4ac4-943a-0301432fce4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:24.851688 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 351/712] 10.222.0.65 () {56 vars in 1124 bytes} [Tue Aug 9 19:00:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:24.851688 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de171a1b-01af-458f-be15-cac1cc0cea9e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:24.851881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229bf0c-bc90-4ac4-943a-0301432fce4b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:24.856279 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 362/713] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:00:24 2022] GET /identity/v3/role_assignments?user.id=2cfda1bec35145f3bbcc13fae0b7af2e&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:24.857554 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78b733-9919-45e5-842f-4996086d6d1b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:24.857864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78b733-9919-45e5-842f-4996086d6d1b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:24.858139 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78b733-9919-45e5-842f-4996086d6d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:24.877766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8e78b733-9919-45e5-842f-4996086d6d1b None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:24.878992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8e78b733-9919-45e5-842f-4996086d6d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:24.919320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:24.964689 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 363/714] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:24.966418 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78b733-9919-45e5-842f-4996086d6d1b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:25.004234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de171a1b-01af-458f-be15-cac1cc0cea9e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:25.051835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324446df-4081-4415-adac-36f6cc09e200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:25.052457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324446df-4081-4415-adac-36f6cc09e200 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:25.052736 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324446df-4081-4415-adac-36f6cc09e200 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:25.053291 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324446df-4081-4415-adac-36f6cc09e200 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:25.054053 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324446df-4081-4415-adac-36f6cc09e200 None admin] RBAC: Adding query filter params (role.id=973d37db3ba74af0b63e3570ab311e21, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=aac48cd591b44f2999d2f172262019da) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:25.054367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324446df-4081-4415-adac-36f6cc09e200 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:25.056309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324446df-4081-4415-adac-36f6cc09e200 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:25.064022 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 352/715] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:00:24 2022] GET /identity/v3/role_assignments?user.id=aac48cd591b44f2999d2f172262019da&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=973d37db3ba74af0b63e3570ab311e21 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:25.064825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324446df-4081-4415-adac-36f6cc09e200 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:25.085489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:25.128550 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78b733-9919-45e5-842f-4996086d6d1b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:25.197586 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df374340-506b-45e1-9130-a73c69aac744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:25.198131 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df374340-506b-45e1-9130-a73c69aac744 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:25.198408 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df374340-506b-45e1-9130-a73c69aac744 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:25.198677 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df374340-506b-45e1-9130-a73c69aac744 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:25.199317 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df374340-506b-45e1-9130-a73c69aac744 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:25.199621 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df374340-506b-45e1-9130-a73c69aac744 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:25.201029 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df374340-506b-45e1-9130-a73c69aac744 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:25.208234 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 364/716] 10.222.0.65 () {56 vars in 1124 bytes} [Tue Aug 9 19:00:24 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:25.236622 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324446df-4081-4415-adac-36f6cc09e200 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:25.286194 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc388f-6758-4162-be51-2413e91ea705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:25.286858 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc388f-6758-4162-be51-2413e91ea705 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:25.287141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc388f-6758-4162-be51-2413e91ea705 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:25.287419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc388f-6758-4162-be51-2413e91ea705 None admin] PATH_INFO: `/v3/services/network` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:25.288011 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc388f-6758-4162-be51-2413e91ea705 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:25.289392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc388f-6758-4162-be51-2413e91ea705 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:25.303209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-78dc388f-6758-4162-be51-2413e91ea705 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 19:00:25.303209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:25.303209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:00:25.303209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:00:25.303209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:00:25.303209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:00:25.303209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:00:25.303209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:25.303209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 19:00:25.303209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:25.303209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:25.303209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:25.303209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:25.303209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:25.303209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:25.303209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:25.303209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:25.306366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:25.306366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:25.306366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:25.306366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:25.306366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:25.306366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:25.306366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:00:25.306366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:00:25.306366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:00:25.306366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:00:25.306366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:25.306366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:25.306366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:25.306366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:25.306366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:25.306366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:25.307220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:25.307220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:25.307220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:25.307220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:25.307220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:25.307220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:25.307220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:25.307220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:25.307220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:25.307220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:25.307220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:00:25.307220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:25.307220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 19:00:25.307220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:25.307220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 353/717] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:25 2022] GET /identity/v3/services/network => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:25.315807 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df374340-506b-45e1-9130-a73c69aac744 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:25.407363 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:25.488889 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df374340-506b-45e1-9130-a73c69aac744 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:25.532702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969333b0-91db-49cf-b733-ce93e6f912f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:25.533320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969333b0-91db-49cf-b733-ce93e6f912f7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:25.533629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969333b0-91db-49cf-b733-ce93e6f912f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:25.533961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969333b0-91db-49cf-b733-ce93e6f912f7 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:25.534605 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969333b0-91db-49cf-b733-ce93e6f912f7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:25.534916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969333b0-91db-49cf-b733-ce93e6f912f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:25.536403 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969333b0-91db-49cf-b733-ce93e6f912f7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:25.545409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 365/718] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Aug 9 19:00:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:25.551497 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc388f-6758-4162-be51-2413e91ea705 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:25.647459 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:25.677913 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc388f-6758-4162-be51-2413e91ea705 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:25.729646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85cca3e-f4a1-436d-83ee-023087af8d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:25.730261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cca3e-f4a1-436d-83ee-023087af8d1c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:25.730541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cca3e-f4a1-436d-83ee-023087af8d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:25.730810 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cca3e-f4a1-436d-83ee-023087af8d1c None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:25.731442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85cca3e-f4a1-436d-83ee-023087af8d1c None admin] RBAC: Adding query filter params (type=network) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:25.731743 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85cca3e-f4a1-436d-83ee-023087af8d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:25.733129 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85cca3e-f4a1-436d-83ee-023087af8d1c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:25.748719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 354/719] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Aug 9 19:00:25 2022] GET /identity/v3/services?type=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:26.571209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a997e-35c2-4bf0-9b8e-9890cbfcb8ad None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:26.571722 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a997e-35c2-4bf0-9b8e-9890cbfcb8ad None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:26.571801 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a997e-35c2-4bf0-9b8e-9890cbfcb8ad None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:26.573336 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 366/720] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:26.579300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b85791-0556-476d-ae7a-6f1b6bb4b245 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:26.579743 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b85791-0556-476d-ae7a-6f1b6bb4b245 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:26.579846 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b85791-0556-476d-ae7a-6f1b6bb4b245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:26.606540 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-11b85791-0556-476d-ae7a-6f1b6bb4b245 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:26.607868 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-11b85791-0556-476d-ae7a-6f1b6bb4b245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:26.696718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 355/721] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:26.740303 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a997e-35c2-4bf0-9b8e-9890cbfcb8ad None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:26.852973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:26.860797 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a997e-35c2-4bf0-9b8e-9890cbfcb8ad None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:26.904946 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf6412-9af1-473e-b084-be0024e31cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:26.906301 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf6412-9af1-473e-b084-be0024e31cbb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:26.906585 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf6412-9af1-473e-b084-be0024e31cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:26.906855 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf6412-9af1-473e-b084-be0024e31cbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:26.920635 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf6412-9af1-473e-b084-be0024e31cbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:26.925405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-e1bf6412-9af1-473e-b084-be0024e31cbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:26.925405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:26.925405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:26.925405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:26.925405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:26.925405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:26.925405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:26.925405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:26.925405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:26.925405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:26.925405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:26.925405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:26.925405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:26.925405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:26.925405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:26.925405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:26.926352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:26.926352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:26.926352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:26.926352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:26.926352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:26.926352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:26.926352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:26.926352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:26.926352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:26.926352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:26.926352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:26.926352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:26.926352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:26.926352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:26.926352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:26.926352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:26.927206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:26.927206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:26.927206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:26.927206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:26.927206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:26.927206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:26.927206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:26.927206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:26.927206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:26.927206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:26.927206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:26.927206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:26.927206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 367/722] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:26.932627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b85791-0556-476d-ae7a-6f1b6bb4b245 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:27.014003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:27.048926 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b85791-0556-476d-ae7a-6f1b6bb4b245 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:27.091186 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2770079-63de-431d-9cda-9081b5632c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:27.091798 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2770079-63de-431d-9cda-9081b5632c30 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:27.092074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2770079-63de-431d-9cda-9081b5632c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:27.092342 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2770079-63de-431d-9cda-9081b5632c30 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:27.093234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2770079-63de-431d-9cda-9081b5632c30 None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:27.093514 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2770079-63de-431d-9cda-9081b5632c30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:27.095021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2770079-63de-431d-9cda-9081b5632c30 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:27.105664 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 356/723] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:00:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:27.111619 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf6412-9af1-473e-b084-be0024e31cbb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:27.240691 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf6412-9af1-473e-b084-be0024e31cbb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:27.275880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b912980-92f7-4f13-817d-ebe236449dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:27.276508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b912980-92f7-4f13-817d-ebe236449dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:27.276790 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b912980-92f7-4f13-817d-ebe236449dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:27.277061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b912980-92f7-4f13-817d-ebe236449dd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:27.287880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b912980-92f7-4f13-817d-ebe236449dd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:27.289330 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b912980-92f7-4f13-817d-ebe236449dd1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:27.304390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1b912980-92f7-4f13-817d-ebe236449dd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:27.304390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:27.304390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:27.304390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:27.304390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:27.304390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:27.304390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:27.304390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:27.304390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:27.304390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:27.304390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:27.304390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:27.304390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:27.304390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:27.304390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:27.304390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:27.305372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:27.305372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:27.305372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:27.305372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:27.305372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:27.305372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:27.305372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:27.305372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:27.305372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:27.305372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:27.305372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:27.305372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:27.305372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:27.305372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:27.305372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:27.305372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:27.305372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:27.306402 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:27.306402 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:27.306402 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:27.306402 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 368/724] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:27.311078 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2770079-63de-431d-9cda-9081b5632c30 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:27.431258 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24d3a2-1f4a-4cf7-b4c4-446f297e9086 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:27.431616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24d3a2-1f4a-4cf7-b4c4-446f297e9086 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:27.431800 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24d3a2-1f4a-4cf7-b4c4-446f297e9086 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:27.433496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 369/725] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:27.445856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2f93c-2927-400f-b8b3-4ffc03a80123 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:27.446147 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2f93c-2927-400f-b8b3-4ffc03a80123 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:27.446425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2f93c-2927-400f-b8b3-4ffc03a80123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:27.478001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-30b2f93c-2927-400f-b8b3-4ffc03a80123 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:27.480854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-30b2f93c-2927-400f-b8b3-4ffc03a80123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:27.508633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:27.523872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2770079-63de-431d-9cda-9081b5632c30 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:27.578004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:27.591663 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d824a65-8525-4537-b499-94f6d719e1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:27.592281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d824a65-8525-4537-b499-94f6d719e1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:27.592550 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d824a65-8525-4537-b499-94f6d719e1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:27.592856 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d824a65-8525-4537-b499-94f6d719e1a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:27.593993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d824a65-8525-4537-b499-94f6d719e1a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:27.594307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d824a65-8525-4537-b499-94f6d719e1a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:27.595697 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d824a65-8525-4537-b499-94f6d719e1a4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:27.618806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 370/726] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:27.621084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 357/727] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:27.626867 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2f93c-2927-400f-b8b3-4ffc03a80123 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:27.642369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d824a65-8525-4537-b499-94f6d719e1a4 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:27.740217 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2f93c-2927-400f-b8b3-4ffc03a80123 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:27.779688 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccddc8-3f0e-40c3-be9a-44ceadaff316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:27.781230 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccddc8-3f0e-40c3-be9a-44ceadaff316 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:27.781771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccddc8-3f0e-40c3-be9a-44ceadaff316 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:27.782158 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccddc8-3f0e-40c3-be9a-44ceadaff316 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:27.790604 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccddc8-3f0e-40c3-be9a-44ceadaff316 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:27.792097 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccddc8-3f0e-40c3-be9a-44ceadaff316 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:27.805906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-c2ccddc8-3f0e-40c3-be9a-44ceadaff316 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 19:00:27.805906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:27.805906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:27.805906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:27.805906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:27.805906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:27.805906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:27.805906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:27.805906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:27.805906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:27.805906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:27.805906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:27.805906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:27.805906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:27.805906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:27.805906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:27.806980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:27.806980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:27.806980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:27.806980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:27.806980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:27.806980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:27.806980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:27.806980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:27.806980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:27.806980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:27.806980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:27.806980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:27.806980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:27.806980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:27.806980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:27.806980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:27.806980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:27.806980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:27.807938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:27.807938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:27.807938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:27.807938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:27.807938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:27.807938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:27.807938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:27.807938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:27.807938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 19:00:27.807938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:27.807938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 371/728] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Aug 9 19:00:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:27.809137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253d3d0-d65a-468c-bfd8-9b6bdfd76498 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:27.809137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253d3d0-d65a-468c-bfd8-9b6bdfd76498 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:27.809313 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253d3d0-d65a-468c-bfd8-9b6bdfd76498 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:27.810880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 372/729] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:27.818540 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253d3d0-d65a-468c-bfd8-9b6bdfd76498 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:27.821538 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:27.928113 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253d3d0-d65a-468c-bfd8-9b6bdfd76498 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:27.942433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d824a65-8525-4537-b499-94f6d719e1a4 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:27.963169 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f37fc-8136-4309-a6c1-ea1cf197857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:27.963780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f37fc-8136-4309-a6c1-ea1cf197857d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:27.964063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f37fc-8136-4309-a6c1-ea1cf197857d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:27.964334 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f37fc-8136-4309-a6c1-ea1cf197857d None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:27.965061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f37fc-8136-4309-a6c1-ea1cf197857d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:27.965365 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f37fc-8136-4309-a6c1-ea1cf197857d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:27.966820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f37fc-8136-4309-a6c1-ea1cf197857d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:27.976859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa598d51-0fdf-431a-bcbf-1a45761677ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:27.977532 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa598d51-0fdf-431a-bcbf-1a45761677ac None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:27.977817 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa598d51-0fdf-431a-bcbf-1a45761677ac None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:27.978091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa598d51-0fdf-431a-bcbf-1a45761677ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:27.987623 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 373/730] 10.222.0.65 () {56 vars in 1149 bytes} [Tue Aug 9 19:00:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:27.988950 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e7da6-752b-4f26-88ca-fa9b2b4ec616 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:27.989293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e7da6-752b-4f26-88ca-fa9b2b4ec616 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:27.989595 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e7da6-752b-4f26-88ca-fa9b2b4ec616 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:27.991329 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa598d51-0fdf-431a-bcbf-1a45761677ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:27.995193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 374/731] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:27.996340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632707a9-9716-4ba3-9297-95be1af714b6 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:27.996541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-fa598d51-0fdf-431a-bcbf-1a45761677ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:00:27.996541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:27.996541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:27.996541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:27.996541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:27.996541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:27.996541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:27.996541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:27.996541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:27.996541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:27.996541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:27.996541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:27.996541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:27.996541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:27.996541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:27.996541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:27.997720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:27.997720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:27.997720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:27.997720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:27.997720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:27.997720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:27.997720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:27.997720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:27.997720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:27.997720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:27.997720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:27.997720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:27.997720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:27.997720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:27.997720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:27.997720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:27.998617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:27.998617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:27.998617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:27.998617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:27.998617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:27.998617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:27.998617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:27.998617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:27.998617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:27.998617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:27.998617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:00:27.998617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:28.000137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632707a9-9716-4ba3-9297-95be1af714b6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:28.000137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632707a9-9716-4ba3-9297-95be1af714b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:28.000273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 358/732] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:00:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:28.000273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa598d51-0fdf-431a-bcbf-1a45761677ac None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:28.022169 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-632707a9-9716-4ba3-9297-95be1af714b6 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:28.023346 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-632707a9-9716-4ba3-9297-95be1af714b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:28.056064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:28.081371 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:28.097679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 375/733] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:28.097679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705d6c1-141a-4939-8df6-64032ef5f35a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:28.097679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705d6c1-141a-4939-8df6-64032ef5f35a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:28.097679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705d6c1-141a-4939-8df6-64032ef5f35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:28.114020 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa598d51-0fdf-431a-bcbf-1a45761677ac None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:28.115811 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c705d6c1-141a-4939-8df6-64032ef5f35a None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:28.118012 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c705d6c1-141a-4939-8df6-64032ef5f35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:28.149520 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb0a0c-abb4-408b-9498-48c6d2acfee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:28.150131 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb0a0c-abb4-408b-9498-48c6d2acfee6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:28.150409 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb0a0c-abb4-408b-9498-48c6d2acfee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:28.150682 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb0a0c-abb4-408b-9498-48c6d2acfee6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:28.201482 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 376/734] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:28.201482 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705d6c1-141a-4939-8df6-64032ef5f35a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:28.242652 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb0a0c-abb4-408b-9498-48c6d2acfee6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:28.244062 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb0a0c-abb4-408b-9498-48c6d2acfee6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:28.292895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:28.304130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705d6c1-141a-4939-8df6-64032ef5f35a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:28.324999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:28.339970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ea692-ba12-48b2-80b2-f4fa57df5afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:28.340588 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ea692-ba12-48b2-80b2-f4fa57df5afa None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:28.340866 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ea692-ba12-48b2-80b2-f4fa57df5afa None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:28.341169 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ea692-ba12-48b2-80b2-f4fa57df5afa None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:28.341840 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ea692-ba12-48b2-80b2-f4fa57df5afa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:28.342732 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ea692-ba12-48b2-80b2-f4fa57df5afa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:28.343611 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ea692-ba12-48b2-80b2-f4fa57df5afa None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:28.350805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 359/735] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:00:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 19:00:28.350805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb0a0c-abb4-408b-9498-48c6d2acfee6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:28.359503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 377/736] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:00:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:28.359503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ea692-ba12-48b2-80b2-f4fa57df5afa None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:28.454545 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb0a0c-abb4-408b-9498-48c6d2acfee6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:28.458717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ea692-ba12-48b2-80b2-f4fa57df5afa None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:28.487133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80440d3a-7e74-45ac-a68b-31b9ece78cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:28.487745 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440d3a-7e74-45ac-a68b-31b9ece78cc7 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:28.488025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440d3a-7e74-45ac-a68b-31b9ece78cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:28.488296 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440d3a-7e74-45ac-a68b-31b9ece78cc7 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:28.488937 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80440d3a-7e74-45ac-a68b-31b9ece78cc7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:28.490338 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80440d3a-7e74-45ac-a68b-31b9ece78cc7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:28.491656 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c382438-433f-4dc2-a55e-bda756faadd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:28.492277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c382438-433f-4dc2-a55e-bda756faadd8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:28.492587 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c382438-433f-4dc2-a55e-bda756faadd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:28.492910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c382438-433f-4dc2-a55e-bda756faadd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:28.503627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c382438-433f-4dc2-a55e-bda756faadd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:28.509015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-3c382438-433f-4dc2-a55e-bda756faadd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:00:28.509015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:28.509015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:28.509015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:28.509015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:28.509015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:28.509015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:28.509015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:28.509015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:28.509015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:28.509015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:28.509015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:28.509015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:28.509015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:28.509015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:28.509015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:28.510163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:28.510163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:28.510163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:28.510163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:28.510163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:28.510163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:28.510163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:28.510163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:28.510163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:28.510163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:28.510163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:28.510163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:28.510163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:28.510163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:28.510163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:28.510163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:28.511033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:28.511033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:28.511033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:28.511033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:28.511033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:28.511033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:28.511033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:28.511033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:28.511033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:28.511033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:28.511033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:00:28.511033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:28.515001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 378/737] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:00:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:28.515971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c382438-433f-4dc2-a55e-bda756faadd8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:28.557763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:28.590524 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 360/738] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Aug 9 19:00:28 2022] POST /identity/v3/services => generated 251 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:00:28.591359 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80440d3a-7e74-45ac-a68b-31b9ece78cc7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:28.604431 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:28.623575 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c382438-433f-4dc2-a55e-bda756faadd8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:28.676836 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c062e-6e88-413a-81ef-25bda271642f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:28.677528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c062e-6e88-413a-81ef-25bda271642f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:28.677814 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c062e-6e88-413a-81ef-25bda271642f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:28.678090 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c062e-6e88-413a-81ef-25bda271642f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:28.689529 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c062e-6e88-413a-81ef-25bda271642f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:28.691019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c062e-6e88-413a-81ef-25bda271642f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:28.706826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1c7c062e-6e88-413a-81ef-25bda271642f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:28.706826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:28.706826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:28.706826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:28.706826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:28.706826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:28.706826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:28.706826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:28.706826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:28.706826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:28.706826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:28.706826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:28.706826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:28.706826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:28.706826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:28.706826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:28.707886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:28.707886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:28.707886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:28.707886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:28.707886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:28.707886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:28.707886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:28.707886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:28.707886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:28.707886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:28.707886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:28.707886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:28.707886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:28.707886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:28.707886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:28.707886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:28.707886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:28.708799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:28.708799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:28.708799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:28.708799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 379/739] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:28.709591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead3bb2-3477-48aa-be78-4de1ecfb5e47 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:28.709880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead3bb2-3477-48aa-be78-4de1ecfb5e47 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:28.710152 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead3bb2-3477-48aa-be78-4de1ecfb5e47 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:28.711610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 380/740] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:28.712203 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead3bb2-3477-48aa-be78-4de1ecfb5e47 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:28.718629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80440d3a-7e74-45ac-a68b-31b9ece78cc7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:28.757345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21362fe4-933a-442d-9d56-4340becb4413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:28.757966 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21362fe4-933a-442d-9d56-4340becb4413 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:28.758254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21362fe4-933a-442d-9d56-4340becb4413 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:28.758535 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21362fe4-933a-442d-9d56-4340becb4413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:28.771094 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21362fe4-933a-442d-9d56-4340becb4413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:28.772547 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21362fe4-933a-442d-9d56-4340becb4413 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:28.787973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-21362fe4-933a-442d-9d56-4340becb4413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:28.787973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:28.787973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:28.787973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:28.787973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:28.787973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:28.787973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:28.787973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:28.787973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:28.787973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:28.787973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:28.787973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:28.787973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:28.787973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:28.787973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:28.787973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:28.788970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:28.788970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:28.788970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:28.788970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:28.788970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:28.788970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:28.788970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:28.788970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:28.788970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:28.788970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:28.788970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:28.788970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:28.788970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:28.788970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:28.788970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:28.788970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:28.788970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:28.789903 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:28.789903 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:28.789903 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:28.789903 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 361/741] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:28.790567 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21362fe4-933a-442d-9d56-4340becb4413 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:28.817367 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:28.828640 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead3bb2-3477-48aa-be78-4de1ecfb5e47 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:28.858906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:28.864601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f0854-90ab-44e1-b789-cffef4af9f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:28.865210 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f0854-90ab-44e1-b789-cffef4af9f17 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:28.865512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f0854-90ab-44e1-b789-cffef4af9f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:28.865787 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f0854-90ab-44e1-b789-cffef4af9f17 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:28.866517 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f0854-90ab-44e1-b789-cffef4af9f17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:28.866815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f0854-90ab-44e1-b789-cffef4af9f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:28.868205 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f0854-90ab-44e1-b789-cffef4af9f17 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:28.877604 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 381/742] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:00:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:28.879198 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf34762-1584-4021-b9b2-ca5c041b1013 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:28.879520 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf34762-1584-4021-b9b2-ca5c041b1013 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:28.879797 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf34762-1584-4021-b9b2-ca5c041b1013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:28.898923 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-cbf34762-1584-4021-b9b2-ca5c041b1013 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:28.900117 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cbf34762-1584-4021-b9b2-ca5c041b1013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:28.906724 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21362fe4-933a-442d-9d56-4340becb4413 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:28.942096 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3956fd-f7bb-42df-a09a-6c5f71ce7c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:28.942820 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3956fd-f7bb-42df-a09a-6c5f71ce7c3a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:28.943184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3956fd-f7bb-42df-a09a-6c5f71ce7c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:28.943523 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3956fd-f7bb-42df-a09a-6c5f71ce7c3a None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:28.944229 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3956fd-f7bb-42df-a09a-6c5f71ce7c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:28.944598 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3956fd-f7bb-42df-a09a-6c5f71ce7c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:28.946117 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3956fd-f7bb-42df-a09a-6c5f71ce7c3a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:28.961858 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 362/743] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:28.963306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3956fd-f7bb-42df-a09a-6c5f71ce7c3a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:28.976354 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 382/744] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:28 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 19:00:28.977630 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf34762-1584-4021-b9b2-ca5c041b1013 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:29.074320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:29.074766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3956fd-f7bb-42df-a09a-6c5f71ce7c3a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:29.094188 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf34762-1584-4021-b9b2-ca5c041b1013 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:29.096051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:29.112891 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59defa30-e561-4bea-9db7-87687fd1c6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:29.113917 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59defa30-e561-4bea-9db7-87687fd1c6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:29.114196 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59defa30-e561-4bea-9db7-87687fd1c6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:29.114467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59defa30-e561-4bea-9db7-87687fd1c6b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:29.115113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59defa30-e561-4bea-9db7-87687fd1c6b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:29.115414 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59defa30-e561-4bea-9db7-87687fd1c6b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:29.117610 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59defa30-e561-4bea-9db7-87687fd1c6b7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:29.131771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2621ff-8c77-4608-86e2-103715f07393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:29.136648 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 363/745] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:29.136773 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2621ff-8c77-4608-86e2-103715f07393 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:29.136773 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2621ff-8c77-4608-86e2-103715f07393 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:29.136773 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2621ff-8c77-4608-86e2-103715f07393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:29.136992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59defa30-e561-4bea-9db7-87687fd1c6b7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:29.144345 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2621ff-8c77-4608-86e2-103715f07393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:29.145933 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2621ff-8c77-4608-86e2-103715f07393 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:29.161970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-8e2621ff-8c77-4608-86e2-103715f07393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:29.161970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:29.161970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:29.161970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:29.161970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:29.161970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:29.161970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:29.161970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:29.161970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:29.161970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:29.161970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:29.161970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:29.161970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:29.161970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:29.161970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:29.161970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:29.162971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:29.162971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:29.162971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:29.162971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:29.162971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:29.162971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:29.162971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:29.162971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:29.162971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:29.162971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:29.162971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:29.162971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:29.162971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:29.162971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:29.162971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:29.162971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:29.162971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:29.163869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:29.163869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:29.163869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:29.163869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 383/746] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:29.163869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2621ff-8c77-4608-86e2-103715f07393 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:29.247034 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59defa30-e561-4bea-9db7-87687fd1c6b7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:29.275867 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2621ff-8c77-4608-86e2-103715f07393 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:29.284745 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28bb5b-262d-4b5b-baf4-5146a1d266ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:29.285535 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28bb5b-262d-4b5b-baf4-5146a1d266ee None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:29.285902 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28bb5b-262d-4b5b-baf4-5146a1d266ee None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:29.286244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28bb5b-262d-4b5b-baf4-5146a1d266ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:29.293175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28bb5b-262d-4b5b-baf4-5146a1d266ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:29.294768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28bb5b-262d-4b5b-baf4-5146a1d266ee None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:29.306557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-2a28bb5b-262d-4b5b-baf4-5146a1d266ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:29.306557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:29.306557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:29.306557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:29.306557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:29.306557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:29.306557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:29.306557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:29.306557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:29.306557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:29.306557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:29.306557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:29.306557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:29.306557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:29.306557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:29.307772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:29.307772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:29.307772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:29.307772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:29.307772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:29.307772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:29.307772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:29.307772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:29.307772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:29.307772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:29.307772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:29.307772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:29.307772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:29.307772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:29.307772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:29.307772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:29.307772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:29.308855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:29.308855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:29.308855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:29.308855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:29.308855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:29.308855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:29.308855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:29.308855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:29.314850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 364/747] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:29.314850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28bb5b-262d-4b5b-baf4-5146a1d266ee None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:29.320738 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900f847-52c5-4c73-a706-2fe51398ed50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:29.321579 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900f847-52c5-4c73-a706-2fe51398ed50 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:29.321858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900f847-52c5-4c73-a706-2fe51398ed50 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:29.322131 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900f847-52c5-4c73-a706-2fe51398ed50 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:29.322774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900f847-52c5-4c73-a706-2fe51398ed50 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:29.324272 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5900f847-52c5-4c73-a706-2fe51398ed50 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:29.328523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:29.354966 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:29.401487 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 384/748] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Aug 9 19:00:29 2022] POST /identity/v3/services => generated 240 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:00:29.401487 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900f847-52c5-4c73-a706-2fe51398ed50 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:29.427935 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28bb5b-262d-4b5b-baf4-5146a1d266ee None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:29.475809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8ec8e-8b77-42f9-8222-628ccc1f269d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:29.476651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8ec8e-8b77-42f9-8222-628ccc1f269d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:29.477117 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8ec8e-8b77-42f9-8222-628ccc1f269d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:29.477491 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8ec8e-8b77-42f9-8222-628ccc1f269d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:29.487990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8ec8e-8b77-42f9-8222-628ccc1f269d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:29.489870 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8ec8e-8b77-42f9-8222-628ccc1f269d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:29.507165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-23d8ec8e-8b77-42f9-8222-628ccc1f269d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 19:00:29.507165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:29.507165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:29.507165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:29.507165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:29.507165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:29.507165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:29.507165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:29.507165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:29.507165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:29.507165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:29.507165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:29.507165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:29.507165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:29.507165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:29.507165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:29.508130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:29.508130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:29.508130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:29.508130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:29.508130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:29.508130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:29.508130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:29.508130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:29.508130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:29.508130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:29.508130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:29.508130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:29.508130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:29.508130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:29.508130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:29.508130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:29.508130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:29.508130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:29.509091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:29.509091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:29.509091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:29.509091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:29.509091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:29.509091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:29.509091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:29.509091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:29.509091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 19:00:29.509091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:29.513281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 365/749] 10.222.0.65 () {56 vars in 1093 bytes} [Tue Aug 9 19:00:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:29.517417 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8ec8e-8b77-42f9-8222-628ccc1f269d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:29.554918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900f847-52c5-4c73-a706-2fe51398ed50 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:29.599766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00c314-333c-4025-89cd-9f95fcba0560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:29.600456 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00c314-333c-4025-89cd-9f95fcba0560 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:29.600743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00c314-333c-4025-89cd-9f95fcba0560 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:29.601317 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00c314-333c-4025-89cd-9f95fcba0560 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:29.602268 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00c314-333c-4025-89cd-9f95fcba0560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:29.603104 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00c314-333c-4025-89cd-9f95fcba0560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:29.603946 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00c314-333c-4025-89cd-9f95fcba0560 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:29.619073 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 385/750] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:29.619774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00c314-333c-4025-89cd-9f95fcba0560 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:29.644216 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:29.653130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8ec8e-8b77-42f9-8222-628ccc1f269d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:29.693392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa16cfa-b5c2-4b94-b897-5571a9ab39bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:29.694378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa16cfa-b5c2-4b94-b897-5571a9ab39bc None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:29.694859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa16cfa-b5c2-4b94-b897-5571a9ab39bc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:29.695348 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa16cfa-b5c2-4b94-b897-5571a9ab39bc None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:29.696247 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa16cfa-b5c2-4b94-b897-5571a9ab39bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:29.696805 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:29.697993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa16cfa-b5c2-4b94-b897-5571a9ab39bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:29.699701 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa16cfa-b5c2-4b94-b897-5571a9ab39bc None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:29.714323 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 366/751] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:29.720307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa16cfa-b5c2-4b94-b897-5571a9ab39bc None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:29.749413 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00c314-333c-4025-89cd-9f95fcba0560 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:29.787982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29345143-f3f8-4bc7-8762-a4760ac43538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:29.788601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29345143-f3f8-4bc7-8762-a4760ac43538 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:29.788887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29345143-f3f8-4bc7-8762-a4760ac43538 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:29.789151 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29345143-f3f8-4bc7-8762-a4760ac43538 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:29.789923 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29345143-f3f8-4bc7-8762-a4760ac43538 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:29.790226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29345143-f3f8-4bc7-8762-a4760ac43538 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:29.791657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29345143-f3f8-4bc7-8762-a4760ac43538 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:29.815960 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 386/752] 10.222.0.65 () {56 vars in 1133 bytes} [Tue Aug 9 19:00:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:29.816969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29345143-f3f8-4bc7-8762-a4760ac43538 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:29.854926 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa16cfa-b5c2-4b94-b897-5571a9ab39bc None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:29.892890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b002f-1e80-48f6-ad03-4c4e2ada975c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:29.893988 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b002f-1e80-48f6-ad03-4c4e2ada975c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:29.894563 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b002f-1e80-48f6-ad03-4c4e2ada975c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:29.895032 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b002f-1e80-48f6-ad03-4c4e2ada975c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:29.903262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b002f-1e80-48f6-ad03-4c4e2ada975c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:29.905102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b002f-1e80-48f6-ad03-4c4e2ada975c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:29.918351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-6d5b002f-1e80-48f6-ad03-4c4e2ada975c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 19:00:29.918351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:29.918351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:29.918351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:29.918351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:29.918351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:29.918351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:29.918351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:29.918351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:29.918351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:29.918351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:29.918351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:29.918351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:29.918351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:29.918351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:29.918351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:29.919341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:29.919341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:29.919341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:29.919341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:29.919341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:29.919341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:29.919341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:29.919341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:29.919341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:29.919341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:29.919341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:29.919341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:29.919341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:29.919341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:29.919341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:29.919341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:29.919341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:29.919341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:29.920299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:29.920299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:29.920299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:29.920299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:29.920299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:29.920299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:29.920299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:29.920299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:29.920299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 19:00:29.920299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:29.923027 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 367/753] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:00:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:29.924014 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b002f-1e80-48f6-ad03-4c4e2ada975c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:29.929789 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29345143-f3f8-4bc7-8762-a4760ac43538 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:29.946424 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:29.954074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:29.967290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ddc85-709d-40bb-9908-2882dbb47691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:29.968925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ddc85-709d-40bb-9908-2882dbb47691 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:29.969430 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ddc85-709d-40bb-9908-2882dbb47691 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:29.969762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ddc85-709d-40bb-9908-2882dbb47691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:29.970498 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ddc85-709d-40bb-9908-2882dbb47691 None admin] RBAC: Adding query filter params (role.id=973d37db3ba74af0b63e3570ab311e21, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=5c29eab582a64a8991b171766d321e39) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:29.970808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ddc85-709d-40bb-9908-2882dbb47691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:29.972239 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ddc85-709d-40bb-9908-2882dbb47691 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:29.985483 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 387/754] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:00:29 2022] GET /identity/v3/role_assignments?user.id=5c29eab582a64a8991b171766d321e39&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=973d37db3ba74af0b63e3570ab311e21 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:29.985483 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ddc85-709d-40bb-9908-2882dbb47691 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:30.047962 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b002f-1e80-48f6-ad03-4c4e2ada975c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:30.086496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ebe7-7863-4ab7-832c-0d4c8efb0e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:30.087506 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ebe7-7863-4ab7-832c-0d4c8efb0e49 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:30.087990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ebe7-7863-4ab7-832c-0d4c8efb0e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:30.088465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235ebe7-7863-4ab7-832c-0d4c8efb0e49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:30.112604 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235ebe7-7863-4ab7-832c-0d4c8efb0e49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:30.116774 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235ebe7-7863-4ab7-832c-0d4c8efb0e49 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:30.135953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-c235ebe7-7863-4ab7-832c-0d4c8efb0e49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:30.135953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:30.135953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:30.135953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:30.135953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:30.135953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:30.135953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:30.135953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:30.135953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:30.135953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:30.135953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:30.135953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:30.135953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:30.135953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:30.135953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:30.135953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:30.136998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:30.136998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:30.136998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:30.136998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:30.136998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:30.136998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:30.136998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:30.136998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:30.136998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:30.136998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:30.136998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:30.136998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:30.136998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:30.136998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:30.136998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:30.136998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:30.136998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:30.137942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:30.137942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:30.137942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:30.140750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 368/755] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:30.146492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ebe7-7863-4ab7-832c-0d4c8efb0e49 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:30.183362 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ddc85-709d-40bb-9908-2882dbb47691 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:30.230340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cb9f7-c441-4e1d-8d90-264c72e3a246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:30.230897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cb9f7-c441-4e1d-8d90-264c72e3a246 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:30.231185 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cb9f7-c441-4e1d-8d90-264c72e3a246 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:30.231465 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cb9f7-c441-4e1d-8d90-264c72e3a246 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:30.232217 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cb9f7-c441-4e1d-8d90-264c72e3a246 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:30.232530 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cb9f7-c441-4e1d-8d90-264c72e3a246 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:30.234892 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cb9f7-c441-4e1d-8d90-264c72e3a246 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:30.253999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:30.262053 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235ebe7-7863-4ab7-832c-0d4c8efb0e49 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:30.266713 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 388/756] 10.222.0.65 () {56 vars in 1135 bytes} [Tue Aug 9 19:00:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:30.270476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cb9f7-c441-4e1d-8d90-264c72e3a246 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:30.327302 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:30.337964 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc3d4c-30e7-460d-99fa-59bf78fb5837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:30.338441 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc3d4c-30e7-460d-99fa-59bf78fb5837 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:30.338715 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc3d4c-30e7-460d-99fa-59bf78fb5837 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:30.338983 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc3d4c-30e7-460d-99fa-59bf78fb5837 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:30.339655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc3d4c-30e7-460d-99fa-59bf78fb5837 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:30.339958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc3d4c-30e7-460d-99fa-59bf78fb5837 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:30.341327 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc3d4c-30e7-460d-99fa-59bf78fb5837 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:30.369977 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 369/757] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:30.375551 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc3d4c-30e7-460d-99fa-59bf78fb5837 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:30.416228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cb9f7-c441-4e1d-8d90-264c72e3a246 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:30.487175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c876fb9-ee7f-4c71-8eb5-f3fd957bb483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:30.487796 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c876fb9-ee7f-4c71-8eb5-f3fd957bb483 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:30.488074 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c876fb9-ee7f-4c71-8eb5-f3fd957bb483 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:30.488365 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c876fb9-ee7f-4c71-8eb5-f3fd957bb483 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:30.519292 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc3d4c-30e7-460d-99fa-59bf78fb5837 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:30.573838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:30.583138 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ee821-e6f7-4cc7-bfae-cf927ad2b79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:30.584102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ee821-e6f7-4cc7-bfae-cf927ad2b79c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:30.584592 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ee821-e6f7-4cc7-bfae-cf927ad2b79c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:30.585063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ee821-e6f7-4cc7-bfae-cf927ad2b79c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:30.592358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ee821-e6f7-4cc7-bfae-cf927ad2b79c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:30.594710 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ee821-e6f7-4cc7-bfae-cf927ad2b79c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:30.613492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-a83ee821-e6f7-4cc7-bfae-cf927ad2b79c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:30.613492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:30.613492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:30.613492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:30.613492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:30.613492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:30.613492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:30.613492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:30.613492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:30.613492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:30.613492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:30.613492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:30.613492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:30.613492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:30.613492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:30.614458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:30.614458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:30.614458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:30.614458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:30.614458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:30.614458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:30.614458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:30.614458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:30.614458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:30.614458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:30.614458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:30.614458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:30.614458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:30.614458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:30.614458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:30.614458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:30.614458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:30.615349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:30.615349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:30.615349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:30.615349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:30.615349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:30.615349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:30.615349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:30.615349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:30.615349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 370/758] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:30.618812 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ee821-e6f7-4cc7-bfae-cf927ad2b79c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:30.635279 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c876fb9-ee7f-4c71-8eb5-f3fd957bb483 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:30.636762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c876fb9-ee7f-4c71-8eb5-f3fd957bb483 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:30.718239 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:30.756409 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ee821-e6f7-4cc7-bfae-cf927ad2b79c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:30.792060 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d326750-6fb2-4ea4-842b-2aad687d0813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:30.792677 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d326750-6fb2-4ea4-842b-2aad687d0813 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:30.792964 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d326750-6fb2-4ea4-842b-2aad687d0813 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:30.793237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d326750-6fb2-4ea4-842b-2aad687d0813 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:30.793965 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d326750-6fb2-4ea4-842b-2aad687d0813 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:30.794274 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d326750-6fb2-4ea4-842b-2aad687d0813 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:30.796065 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d326750-6fb2-4ea4-842b-2aad687d0813 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:30.813549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 371/759] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:30.813549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb87b-a585-4c69-8d27-780559fe3eca None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:30.813549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb87b-a585-4c69-8d27-780559fe3eca None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:30.813549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb87b-a585-4c69-8d27-780559fe3eca None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:30.813549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 372/760] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:30.815275 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bb87b-a585-4c69-8d27-780559fe3eca None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:30.826094 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 389/761] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:00:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:00:30.828224 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8feb9-87cd-4862-be35-02c5a39a9c13 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:30.828710 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8feb9-87cd-4862-be35-02c5a39a9c13 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:30.829177 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8feb9-87cd-4862-be35-02c5a39a9c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:30.856874 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a0b8feb9-87cd-4862-be35-02c5a39a9c13 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:30.860264 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a0b8feb9-87cd-4862-be35-02c5a39a9c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:30.881866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:30.931680 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bb87b-a585-4c69-8d27-780559fe3eca None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:30.948697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 390/762] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:30.949918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8feb9-87cd-4862-be35-02c5a39a9c13 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:30.969446 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97b26a-941f-499c-b05b-11b7b7653195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:30.970258 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97b26a-941f-499c-b05b-11b7b7653195 None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:30.970624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97b26a-941f-499c-b05b-11b7b7653195 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:30.970978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97b26a-941f-499c-b05b-11b7b7653195 None admin] PATH_INFO: `/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/2cfda1bec35145f3bbcc13fae0b7af2e/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:30.973106 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97b26a-941f-499c-b05b-11b7b7653195 None admin] RBAC: Authorizing `identity:create_grant(project_id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user_id=2cfda1bec35145f3bbcc13fae0b7af2e, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:30.974709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97b26a-941f-499c-b05b-11b7b7653195 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:31.018635 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:31.054341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 373/763] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 19:00:30 2022] PUT /identity/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/2cfda1bec35145f3bbcc13fae0b7af2e/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:00:31.055820 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97b26a-941f-499c-b05b-11b7b7653195 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:31.056382 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8feb9-87cd-4862-be35-02c5a39a9c13 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:31.133715 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889dca7a-d62e-44f0-9cf7-cb3c50dd7340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:31.134365 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dca7a-d62e-44f0-9cf7-cb3c50dd7340 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:31.134649 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dca7a-d62e-44f0-9cf7-cb3c50dd7340 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:31.134933 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dca7a-d62e-44f0-9cf7-cb3c50dd7340 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:31.159127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889dca7a-d62e-44f0-9cf7-cb3c50dd7340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:31.160694 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889dca7a-d62e-44f0-9cf7-cb3c50dd7340 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:31.190326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-889dca7a-d62e-44f0-9cf7-cb3c50dd7340 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:31.190326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:31.190326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:31.190326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:31.190326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:31.190326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:31.190326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:31.190326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:31.190326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:31.190326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:31.190326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:31.190326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:31.190326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:31.190326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:31.190326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:31.190326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:31.191319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:31.191319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:31.191319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:31.191319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:31.191319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:31.191319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:31.191319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:31.191319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:31.191319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:31.191319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:31.191319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:31.191319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:31.191319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:31.191319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:31.191319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:31.191319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:31.191319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:31.192219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:31.192219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:31.192219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:31.194741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97b26a-941f-499c-b05b-11b7b7653195 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:31.197854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 391/764] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:31.199425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889dca7a-d62e-44f0-9cf7-cb3c50dd7340 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:31.208978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:31.241851 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8817813-2ffb-49b5-beaa-b0d3137911d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:31.243522 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8817813-2ffb-49b5-beaa-b0d3137911d8 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:31.244023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8817813-2ffb-49b5-beaa-b0d3137911d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:31.244765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8817813-2ffb-49b5-beaa-b0d3137911d8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:31.245745 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8817813-2ffb-49b5-beaa-b0d3137911d8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:31.247965 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8817813-2ffb-49b5-beaa-b0d3137911d8 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:31.262646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-a8817813-2ffb-49b5-beaa-b0d3137911d8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 19:00:31.262646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:31.262646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:00:31.262646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:00:31.262646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:00:31.262646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:00:31.262646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:00:31.262646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:31.262646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 19:00:31.262646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:31.262646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:31.262646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:31.262646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:31.262646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:31.262646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:31.262646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:31.262646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:31.268753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:31.268753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:31.268753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:31.268753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:31.268753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:31.268753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:31.268753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:00:31.268753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:00:31.268753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:00:31.268753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:00:31.268753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:31.268753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:31.268753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:31.268753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:31.268753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:31.268753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:31.269848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:31.269848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:31.269848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:31.269848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:31.269848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:31.269848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:31.269848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:31.269848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:31.269848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:31.269848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:31.269848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:00:31.269848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:31.269848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 19:00:31.269848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:31.269848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 374/765] 10.222.0.65 () {56 vars in 1129 bytes} [Tue Aug 9 19:00:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:31.275755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8817813-2ffb-49b5-beaa-b0d3137911d8 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:31.336045 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889dca7a-d62e-44f0-9cf7-cb3c50dd7340 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:31.358928 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:31.378572 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c47275-384c-4d4a-802b-c6a978cfa471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:31.379189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c47275-384c-4d4a-802b-c6a978cfa471 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:31.379470 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c47275-384c-4d4a-802b-c6a978cfa471 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:31.379777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c47275-384c-4d4a-802b-c6a978cfa471 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:31.380432 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c47275-384c-4d4a-802b-c6a978cfa471 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:31.381439 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c47275-384c-4d4a-802b-c6a978cfa471 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:31.382426 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c47275-384c-4d4a-802b-c6a978cfa471 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:31.396168 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 392/766] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:31.401606 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c47275-384c-4d4a-802b-c6a978cfa471 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:31.416210 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8817813-2ffb-49b5-beaa-b0d3137911d8 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:31.469221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9afa82-5bb3-4ec6-b762-5636c9abf0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:31.470310 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9afa82-5bb3-4ec6-b762-5636c9abf0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:31.471703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9afa82-5bb3-4ec6-b762-5636c9abf0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:31.473605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9afa82-5bb3-4ec6-b762-5636c9abf0e9 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:31.474470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9afa82-5bb3-4ec6-b762-5636c9abf0e9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:31.476443 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9afa82-5bb3-4ec6-b762-5636c9abf0e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:31.478124 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9afa82-5bb3-4ec6-b762-5636c9abf0e9 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:31.499127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 375/767] 10.222.0.65 () {56 vars in 1124 bytes} [Tue Aug 9 19:00:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:31.518514 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9afa82-5bb3-4ec6-b762-5636c9abf0e9 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:31.550352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c47275-384c-4d4a-802b-c6a978cfa471 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:31.593868 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe38ca-7282-42b5-8eda-48524957cfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:31.594509 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe38ca-7282-42b5-8eda-48524957cfd0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:31.594791 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe38ca-7282-42b5-8eda-48524957cfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:31.595063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe38ca-7282-42b5-8eda-48524957cfd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:31.610122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:31.614627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe38ca-7282-42b5-8eda-48524957cfd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:31.616101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe38ca-7282-42b5-8eda-48524957cfd0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:31.635979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-6dfe38ca-7282-42b5-8eda-48524957cfd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:31.635979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:31.635979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:31.635979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:31.635979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:31.635979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:31.635979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:31.635979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:31.635979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:31.635979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:31.635979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:31.635979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:31.635979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:31.635979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:31.635979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:31.636941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:31.636941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:31.636941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:31.636941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:31.636941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:31.636941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:31.636941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:31.636941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:31.636941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:31.636941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:31.636941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:31.636941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:31.636941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:31.636941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:31.636941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:31.636941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:31.636941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:31.637851 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:31.637851 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:31.637851 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:31.637851 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:31.637851 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:31.637851 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:31.637851 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:31.637851 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:31.637851 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 393/768] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:31.642825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe38ca-7282-42b5-8eda-48524957cfd0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:31.683807 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9afa82-5bb3-4ec6-b762-5636c9abf0e9 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:31.686844 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:31.730531 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5924df-176d-414f-84c1-fc8e3b414db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:31.731067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5924df-176d-414f-84c1-fc8e3b414db3 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:31.731346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5924df-176d-414f-84c1-fc8e3b414db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:31.731615 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5924df-176d-414f-84c1-fc8e3b414db3 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:31.732251 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5924df-176d-414f-84c1-fc8e3b414db3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:31.732553 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5924df-176d-414f-84c1-fc8e3b414db3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:31.736805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5924df-176d-414f-84c1-fc8e3b414db3 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:31.747093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 376/769] 10.222.0.65 () {56 vars in 1124 bytes} [Tue Aug 9 19:00:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:31.752344 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5924df-176d-414f-84c1-fc8e3b414db3 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:31.815311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe38ca-7282-42b5-8eda-48524957cfd0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:31.851598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd69cb8-7819-45c1-8f24-cb2761fa9add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:31.852203 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd69cb8-7819-45c1-8f24-cb2761fa9add None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:31.852479 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd69cb8-7819-45c1-8f24-cb2761fa9add None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:31.852747 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd69cb8-7819-45c1-8f24-cb2761fa9add None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:31.853437 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd69cb8-7819-45c1-8f24-cb2761fa9add None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:31.853767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd69cb8-7819-45c1-8f24-cb2761fa9add None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:31.855187 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd69cb8-7819-45c1-8f24-cb2761fa9add None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:31.860300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:31.863637 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5924df-176d-414f-84c1-fc8e3b414db3 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:31.867289 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 394/770] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:31.874179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986c01c-6efb-49d4-8af5-fdd15aa0519f None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:31.874179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986c01c-6efb-49d4-8af5-fdd15aa0519f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:31.874179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986c01c-6efb-49d4-8af5-fdd15aa0519f None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:31.874179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 395/771] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:31.875373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986c01c-6efb-49d4-8af5-fdd15aa0519f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:31.902093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded2466-547f-4b05-92d3-efa7d5fc0e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:31.902720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded2466-547f-4b05-92d3-efa7d5fc0e9c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:31.903002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded2466-547f-4b05-92d3-efa7d5fc0e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:31.903274 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded2466-547f-4b05-92d3-efa7d5fc0e9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:31.904090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded2466-547f-4b05-92d3-efa7d5fc0e9c None admin] RBAC: Adding query filter params (interface=public, service_id=f8c6bd2a016e4bb6a6de1907543e6390, region_id=RegionOne) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:31.904433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded2466-547f-4b05-92d3-efa7d5fc0e9c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:31.906721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded2466-547f-4b05-92d3-efa7d5fc0e9c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:31.919357 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 377/772] 10.222.0.65 () {56 vars in 1251 bytes} [Tue Aug 9 19:00:31 2022] GET /identity/v3/endpoints?service_id=f8c6bd2a016e4bb6a6de1907543e6390&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:31.920831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf295112-cfe2-4624-97b0-67adcf15321c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:31.921232 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf295112-cfe2-4624-97b0-67adcf15321c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:31.921755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf295112-cfe2-4624-97b0-67adcf15321c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:31.941068 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-cf295112-cfe2-4624-97b0-67adcf15321c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:31.942385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cf295112-cfe2-4624-97b0-67adcf15321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:31.972787 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:31.979325 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986c01c-6efb-49d4-8af5-fdd15aa0519f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:32.014867 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced0c9c-d119-4b29-bd50-4e75aba6f37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:32.015361 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced0c9c-d119-4b29-bd50-4e75aba6f37f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:32.015634 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced0c9c-d119-4b29-bd50-4e75aba6f37f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:32.015903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced0c9c-d119-4b29-bd50-4e75aba6f37f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:32.016910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced0c9c-d119-4b29-bd50-4e75aba6f37f None admin] RBAC: Adding query filter params (role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=aac48cd591b44f2999d2f172262019da) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:32.017218 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced0c9c-d119-4b29-bd50-4e75aba6f37f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:32.018394 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 378/773] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:32.018700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced0c9c-d119-4b29-bd50-4e75aba6f37f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:32.019252 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf295112-cfe2-4624-97b0-67adcf15321c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:32.037900 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 396/774] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:00:31 2022] GET /identity/v3/role_assignments?user.id=aac48cd591b44f2999d2f172262019da&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:32.047195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced0c9c-d119-4b29-bd50-4e75aba6f37f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:32.129335 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:32.137177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf295112-cfe2-4624-97b0-67adcf15321c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:32.179837 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3a714-8e95-4008-b0ac-1d279971b6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:32.180481 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3a714-8e95-4008-b0ac-1d279971b6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:32.180765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3a714-8e95-4008-b0ac-1d279971b6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:32.181042 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3a714-8e95-4008-b0ac-1d279971b6a1 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:32.181697 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3a714-8e95-4008-b0ac-1d279971b6a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:32.183124 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3a714-8e95-4008-b0ac-1d279971b6a1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:32.194276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 379/775] 10.222.0.65 () {56 vars in 1087 bytes} [Tue Aug 9 19:00:32 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:32.197297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced0c9c-d119-4b29-bd50-4e75aba6f37f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:32.237691 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126e00d-cbd6-447d-8cbe-bbe146426990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:32.238357 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126e00d-cbd6-447d-8cbe-bbe146426990 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:32.238640 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126e00d-cbd6-447d-8cbe-bbe146426990 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:32.238916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126e00d-cbd6-447d-8cbe-bbe146426990 None admin] PATH_INFO: `/v3/services/network` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:32.239531 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126e00d-cbd6-447d-8cbe-bbe146426990 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:32.240992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126e00d-cbd6-447d-8cbe-bbe146426990 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:32.255968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-6126e00d-cbd6-447d-8cbe-bbe146426990 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 19:00:32.255968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:32.255968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:00:32.255968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:00:32.255968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:00:32.255968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:00:32.255968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:00:32.255968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:32.255968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 19:00:32.255968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:32.255968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:32.255968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:32.255968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:32.255968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:32.255968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:32.255968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:32.255968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:32.257291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:32.257291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:32.257291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:32.257291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:32.257291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:32.257291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:32.257291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:00:32.257291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:00:32.257291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:00:32.257291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:00:32.257291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:32.257291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:32.257291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:32.257291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:32.257291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:32.257291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:32.258184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:32.258184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:32.258184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:32.258184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:32.258184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:32.258184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:32.258184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:32.258184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:32.258184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:32.258184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:32.258184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:00:32.258184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:32.258184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 19:00:32.258184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:32.261873 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 397/776] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:32 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:32.263446 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3a714-8e95-4008-b0ac-1d279971b6a1 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:32.400429 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3a714-8e95-4008-b0ac-1d279971b6a1 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:32.446236 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc50bfc-ec6d-4a6b-8073-34bce4bf10da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:32.446871 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc50bfc-ec6d-4a6b-8073-34bce4bf10da None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:32.447137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc50bfc-ec6d-4a6b-8073-34bce4bf10da None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:32.447410 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc50bfc-ec6d-4a6b-8073-34bce4bf10da None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:32.448042 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc50bfc-ec6d-4a6b-8073-34bce4bf10da None admin] RBAC: Adding query filter params (name=network) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:32.448344 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc50bfc-ec6d-4a6b-8073-34bce4bf10da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:32.449924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc50bfc-ec6d-4a6b-8073-34bce4bf10da None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:32.457483 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 380/777] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Aug 9 19:00:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:32.462682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126e00d-cbd6-447d-8cbe-bbe146426990 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:32.518639 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:32.581693 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff07440-a367-441e-8e0e-17ba4c7d8de5 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:32.582031 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff07440-a367-441e-8e0e-17ba4c7d8de5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:32.582253 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff07440-a367-441e-8e0e-17ba4c7d8de5 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:32.583819 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 381/778] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:32.589197 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d86289-7e56-423d-a63e-8b1be19d8c8b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:32.589893 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d86289-7e56-423d-a63e-8b1be19d8c8b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:32.590277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d86289-7e56-423d-a63e-8b1be19d8c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:32.612183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126e00d-cbd6-447d-8cbe-bbe146426990 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:32.624726 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-b6d86289-7e56-423d-a63e-8b1be19d8c8b None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:32.626162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b6d86289-7e56-423d-a63e-8b1be19d8c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:32.654473 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:32.674529 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17e75a-7993-496b-abe1-2d299542f3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:32.675574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17e75a-7993-496b-abe1-2d299542f3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:32.676736 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17e75a-7993-496b-abe1-2d299542f3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:32.677213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17e75a-7993-496b-abe1-2d299542f3e2 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:32.678694 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17e75a-7993-496b-abe1-2d299542f3e2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:32.679411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17e75a-7993-496b-abe1-2d299542f3e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:32.681803 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17e75a-7993-496b-abe1-2d299542f3e2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:32.694458 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 398/779] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Aug 9 19:00:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:32.699648 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17e75a-7993-496b-abe1-2d299542f3e2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:32.750854 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 382/780] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:32.773055 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d86289-7e56-423d-a63e-8b1be19d8c8b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:32.849848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:32.869269 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17e75a-7993-496b-abe1-2d299542f3e2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:32.937175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d86289-7e56-423d-a63e-8b1be19d8c8b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:32.941629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da699340-5ae6-4951-a81b-e6361414f706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:32.942505 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da699340-5ae6-4951-a81b-e6361414f706 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:32.943007 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da699340-5ae6-4951-a81b-e6361414f706 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:32.943509 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da699340-5ae6-4951-a81b-e6361414f706 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:32.944462 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da699340-5ae6-4951-a81b-e6361414f706 None admin] RBAC: Adding query filter params (interface=public, service_id=557be6a0caa34cc6b48041e6e53d2ee1, region_id=RegionOne) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:32.945058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da699340-5ae6-4951-a81b-e6361414f706 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:32.946658 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da699340-5ae6-4951-a81b-e6361414f706 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:32.962994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 399/781] 10.222.0.65 () {56 vars in 1251 bytes} [Tue Aug 9 19:00:32 2022] GET /identity/v3/endpoints?service_id=557be6a0caa34cc6b48041e6e53d2ee1&interface=public®ion_id=RegionOne => generated 194 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:32.968505 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da699340-5ae6-4951-a81b-e6361414f706 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:32.973444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584951ca-187a-4716-863b-5c4f5db50085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:32.974112 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584951ca-187a-4716-863b-5c4f5db50085 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:32.974394 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584951ca-187a-4716-863b-5c4f5db50085 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:32.974666 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584951ca-187a-4716-863b-5c4f5db50085 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:32.985812 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584951ca-187a-4716-863b-5c4f5db50085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:32.990548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-584951ca-187a-4716-863b-5c4f5db50085 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:32.990548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:32.990548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:32.990548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:32.990548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:32.990548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:32.990548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:32.990548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:32.990548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:32.990548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:32.990548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:32.990548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:32.990548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:32.990548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:32.990548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:32.990548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:32.991493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:32.991493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:32.991493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:32.991493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:32.991493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:32.991493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:32.991493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:32.991493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:32.991493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:32.991493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:32.991493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:32.991493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:32.991493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:32.991493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:32.991493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:32.991493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:32.992354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:32.992354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:32.992354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:32.992354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:32.992354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:32.992354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:32.992354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:32.992354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:32.992354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:32.992354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:32.992354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:32.992354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:32.992354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 383/782] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:32.998420 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584951ca-187a-4716-863b-5c4f5db50085 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:33.028920 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:33.149363 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da699340-5ae6-4951-a81b-e6361414f706 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:33.150449 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584951ca-187a-4716-863b-5c4f5db50085 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:33.197763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0e5b7-a1df-4e8b-bcb3-4265d22f223d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:33.198806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0e5b7-a1df-4e8b-bcb3-4265d22f223d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:33.199309 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0e5b7-a1df-4e8b-bcb3-4265d22f223d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:33.199790 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0e5b7-a1df-4e8b-bcb3-4265d22f223d None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:33.200603 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0e5b7-a1df-4e8b-bcb3-4265d22f223d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:33.204395 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0e5b7-a1df-4e8b-bcb3-4265d22f223d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:33.216688 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 400/783] 10.222.0.65 () {56 vars in 1087 bytes} [Tue Aug 9 19:00:32 2022] GET /identity/v3/services => generated 772 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:33.225261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49551fb-d83e-4195-8b87-4d5f22c44488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:33.226354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49551fb-d83e-4195-8b87-4d5f22c44488 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:33.226873 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49551fb-d83e-4195-8b87-4d5f22c44488 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:33.227441 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49551fb-d83e-4195-8b87-4d5f22c44488 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:33.228359 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49551fb-d83e-4195-8b87-4d5f22c44488 None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:33.228909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49551fb-d83e-4195-8b87-4d5f22c44488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:33.230624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49551fb-d83e-4195-8b87-4d5f22c44488 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:33.240305 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 384/784] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:00:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:33.246128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0e5b7-a1df-4e8b-bcb3-4265d22f223d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:33.285831 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:33.382528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0e5b7-a1df-4e8b-bcb3-4265d22f223d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:33.436560 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c70f2-1ec0-480b-acf0-a92cffbe6b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:33.437406 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c70f2-1ec0-480b-acf0-a92cffbe6b40 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:33.437714 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c70f2-1ec0-480b-acf0-a92cffbe6b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:33.437988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c70f2-1ec0-480b-acf0-a92cffbe6b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:33.454453 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c70f2-1ec0-480b-acf0-a92cffbe6b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:33.455845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c70f2-1ec0-480b-acf0-a92cffbe6b40 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:33.474903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-af2c70f2-1ec0-480b-acf0-a92cffbe6b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:33.474903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:33.474903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:33.474903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:33.474903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:33.474903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:33.474903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:33.474903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:33.474903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:33.474903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:33.474903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:33.474903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:33.474903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:33.474903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:33.474903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:33.474903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:33.475919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:33.475919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:33.475919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:33.475919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:33.475919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:33.475919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:33.475919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:33.475919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:33.475919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:33.475919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:33.475919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:33.475919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:33.475919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:33.475919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:33.475919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:33.475919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:33.475919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:33.476842 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:33.476842 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:33.476842 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:33.480637 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 401/785] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:33.481997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49551fb-d83e-4195-8b87-4d5f22c44488 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:33.504982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31221d64-7c72-4e15-b73a-113ac024d5b8 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:33.505306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31221d64-7c72-4e15-b73a-113ac024d5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:33.505569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31221d64-7c72-4e15-b73a-113ac024d5b8 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:33.507860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 402/786] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:33.515816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e52c62-9313-49a4-9089-687a8a20d5a3 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:33.516102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e52c62-9313-49a4-9089-687a8a20d5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:33.516381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e52c62-9313-49a4-9089-687a8a20d5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:33.538224 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c0e52c62-9313-49a4-9089-687a8a20d5a3 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:33.539431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c0e52c62-9313-49a4-9089-687a8a20d5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:33.579603 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:33.605942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49551fb-d83e-4195-8b87-4d5f22c44488 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:33.608670 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:33.615168 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 403/787] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:33.646534 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b46fd4-c852-4d12-a5e0-2b6a537fac33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:33.647145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46fd4-c852-4d12-a5e0-2b6a537fac33 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:33.647426 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46fd4-c852-4d12-a5e0-2b6a537fac33 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:33.647698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46fd4-c852-4d12-a5e0-2b6a537fac33 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:33.648454 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b46fd4-c852-4d12-a5e0-2b6a537fac33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:33.648631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b46fd4-c852-4d12-a5e0-2b6a537fac33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:33.650269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b46fd4-c852-4d12-a5e0-2b6a537fac33 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:33.652372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e52c62-9313-49a4-9089-687a8a20d5a3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:33.664662 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 385/788] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:33.669045 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b46fd4-c852-4d12-a5e0-2b6a537fac33 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:33.777241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b46fd4-c852-4d12-a5e0-2b6a537fac33 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:33.814633 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc1905-00bc-4d4a-a271-2ea38a22feaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:33.816732 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc1905-00bc-4d4a-a271-2ea38a22feaf None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:33.817031 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc1905-00bc-4d4a-a271-2ea38a22feaf None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:33.817307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc1905-00bc-4d4a-a271-2ea38a22feaf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:33.830101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc1905-00bc-4d4a-a271-2ea38a22feaf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:33.832768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc1905-00bc-4d4a-a271-2ea38a22feaf None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:33.837757 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:33.852221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-26dc1905-00bc-4d4a-a271-2ea38a22feaf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 19:00:33.852221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:33.852221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:33.852221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:33.852221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:33.852221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:33.852221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:33.852221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:33.852221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:33.852221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:33.852221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:33.852221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:33.852221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:33.852221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:33.852221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:33.852221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:33.853245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:33.853245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:33.853245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:33.853245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:33.853245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:33.853245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:33.853245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:33.853245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:33.853245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:33.853245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:33.853245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:33.853245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:33.853245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:33.853245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:33.853245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:33.853245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:33.853245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:33.853245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:33.854234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:33.854234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:33.854234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:33.854234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:33.854234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:33.854234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:33.854234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:33.854234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:33.854234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 19:00:33.854234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:33.860700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 386/789] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Aug 9 19:00:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:33.864501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e52c62-9313-49a4-9089-687a8a20d5a3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:33.865953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc1905-00bc-4d4a-a271-2ea38a22feaf None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:33.932505 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb5412-b2a9-4d97-bbaf-90b4f83fc4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:33.933155 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb5412-b2a9-4d97-bbaf-90b4f83fc4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:33.933441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb5412-b2a9-4d97-bbaf-90b4f83fc4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:33.933753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb5412-b2a9-4d97-bbaf-90b4f83fc4f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:33.949158 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb5412-b2a9-4d97-bbaf-90b4f83fc4f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:33.954897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-8cfb5412-b2a9-4d97-bbaf-90b4f83fc4f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:00:33.954897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:33.954897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:33.954897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:33.954897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:33.954897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:33.954897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:33.954897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:33.954897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:33.954897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:33.954897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:33.954897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:33.954897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:33.954897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:33.954897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:33.954897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:33.955925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:33.955925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:33.955925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:33.955925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:33.955925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:33.955925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:33.955925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:33.955925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:33.955925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:33.955925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:33.955925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:33.955925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:33.955925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:33.955925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:33.955925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:33.955925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:33.956918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:33.956918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:33.956918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:33.956918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:33.956918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:33.956918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:33.956918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:33.956918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:33.956918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:33.956918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:33.956918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:00:33.956918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:33.956918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 404/790] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:00:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:33.962228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb5412-b2a9-4d97-bbaf-90b4f83fc4f5 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:34.024689 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc1905-00bc-4d4a-a271-2ea38a22feaf None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:34.055830 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3a4db-dad5-4cd3-b561-1d1c7ccd4adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:34.056364 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3a4db-dad5-4cd3-b561-1d1c7ccd4adb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:34.056642 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3a4db-dad5-4cd3-b561-1d1c7ccd4adb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:34.056913 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3a4db-dad5-4cd3-b561-1d1c7ccd4adb None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:34.057665 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3a4db-dad5-4cd3-b561-1d1c7ccd4adb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:34.057966 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3a4db-dad5-4cd3-b561-1d1c7ccd4adb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:34.059559 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3a4db-dad5-4cd3-b561-1d1c7ccd4adb None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:34.078544 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 387/791] 10.222.0.65 () {56 vars in 1149 bytes} [Tue Aug 9 19:00:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:34.080641 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:34.084060 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3a4db-dad5-4cd3-b561-1d1c7ccd4adb None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:34.147413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:34.183677 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb5412-b2a9-4d97-bbaf-90b4f83fc4f5 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:34.203425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3a4db-dad5-4cd3-b561-1d1c7ccd4adb None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:34.243495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c1a75-30ff-402d-964e-5331be7c5bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:34.244492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c1a75-30ff-402d-964e-5331be7c5bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:34.244966 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c1a75-30ff-402d-964e-5331be7c5bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:34.245428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c1a75-30ff-402d-964e-5331be7c5bf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:34.258733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c1a75-30ff-402d-964e-5331be7c5bf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:34.261021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c1a75-30ff-402d-964e-5331be7c5bf5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:34.280178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-8f2c1a75-30ff-402d-964e-5331be7c5bf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:34.280178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:34.280178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:34.280178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:34.280178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:34.280178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:34.280178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:34.280178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:34.280178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:34.280178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:34.280178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:34.280178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:34.280178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:34.280178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:34.280178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:34.280178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:34.281999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:34.281999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:34.281999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:34.281999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:34.281999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:34.281999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:34.281999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:34.281999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:34.281999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:34.281999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:34.281999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:34.281999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:34.281999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:34.281999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:34.281999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:34.281999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:34.281999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:34.283013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:34.283013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:34.283013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:34.283184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07122de-a129-4fcc-85f2-b26197de15fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:34.283184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07122de-a129-4fcc-85f2-b26197de15fd None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:34.283184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07122de-a129-4fcc-85f2-b26197de15fd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:34.283393 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07122de-a129-4fcc-85f2-b26197de15fd None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:34.283961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07122de-a129-4fcc-85f2-b26197de15fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:34.284266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07122de-a129-4fcc-85f2-b26197de15fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:34.285290 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 388/792] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:34.285742 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07122de-a129-4fcc-85f2-b26197de15fd None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:34.293921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c1a75-30ff-402d-964e-5331be7c5bf5 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:34.305042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 405/793] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:00:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:34.310273 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07122de-a129-4fcc-85f2-b26197de15fd None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:34.479249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c1a75-30ff-402d-964e-5331be7c5bf5 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:34.482967 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:34.495756 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07122de-a129-4fcc-85f2-b26197de15fd None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:34.532454 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:34.547095 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e0d6-d268-4bb4-897e-8f19806b5aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:34.547712 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e0d6-d268-4bb4-897e-8f19806b5aeb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:34.547993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e0d6-d268-4bb4-897e-8f19806b5aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:34.548266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3e0d6-d268-4bb4-897e-8f19806b5aeb None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:34.548907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3e0d6-d268-4bb4-897e-8f19806b5aeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:34.549213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3e0d6-d268-4bb4-897e-8f19806b5aeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:34.550739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3e0d6-d268-4bb4-897e-8f19806b5aeb None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:34.564885 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942165ba-a2e5-4571-a821-b910a80bbd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:34.565436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942165ba-a2e5-4571-a821-b910a80bbd22 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:34.565807 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942165ba-a2e5-4571-a821-b910a80bbd22 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:34.566080 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942165ba-a2e5-4571-a821-b910a80bbd22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:34.571941 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 389/794] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:34.577197 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e0d6-d268-4bb4-897e-8f19806b5aeb None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:34.584356 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942165ba-a2e5-4571-a821-b910a80bbd22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:34.585850 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942165ba-a2e5-4571-a821-b910a80bbd22 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:34.611194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-942165ba-a2e5-4571-a821-b910a80bbd22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:34.611194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:34.611194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:34.611194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:34.611194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:34.611194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:34.611194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:34.611194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:34.611194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:34.611194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:34.611194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:34.611194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:34.611194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:34.611194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:34.611194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:34.611194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:34.612195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:34.612195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:34.612195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:34.612195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:34.612195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:34.612195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:34.612195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:34.612195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:34.612195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:34.612195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:34.612195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:34.612195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:34.612195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:34.612195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:34.612195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:34.612195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:34.612195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:34.613079 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:34.613079 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:34.613079 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:34.615058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 406/795] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:34.618570 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942165ba-a2e5-4571-a821-b910a80bbd22 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:34.733548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3e0d6-d268-4bb4-897e-8f19806b5aeb None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:34.746898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942165ba-a2e5-4571-a821-b910a80bbd22 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:34.773511 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6611d-f6c4-47af-87df-44d7ae2ef4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:34.774395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6611d-f6c4-47af-87df-44d7ae2ef4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:34.774679 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6611d-f6c4-47af-87df-44d7ae2ef4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:34.775359 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6611d-f6c4-47af-87df-44d7ae2ef4b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:34.782681 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e196b6-eecb-42db-a7e3-ff52d233392c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:34.783288 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e196b6-eecb-42db-a7e3-ff52d233392c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:34.783571 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e196b6-eecb-42db-a7e3-ff52d233392c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:34.783669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6611d-f6c4-47af-87df-44d7ae2ef4b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:34.783849 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e196b6-eecb-42db-a7e3-ff52d233392c None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:34.784489 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e196b6-eecb-42db-a7e3-ff52d233392c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:34.784795 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e196b6-eecb-42db-a7e3-ff52d233392c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:34.785056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6611d-f6c4-47af-87df-44d7ae2ef4b5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:34.786193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e196b6-eecb-42db-a7e3-ff52d233392c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:34.798622 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 407/796] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:34.799118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-00a6611d-f6c4-47af-87df-44d7ae2ef4b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:34.799118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:34.799118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:34.799118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:34.799118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:34.799118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:34.799118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:34.799118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:34.799118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:34.799118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:34.799118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:34.799118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:34.799118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:34.799118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:34.799118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:34.800004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:34.800004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:34.800004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:34.800004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:34.800004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:34.800004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:34.800004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:34.800004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:34.800004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:34.800004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:34.800004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:34.800004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:34.800004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:34.800004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:34.800004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:34.800004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:34.800004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:34.800941 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:34.800941 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:34.800941 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:34.800941 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:34.800941 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:34.800941 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:34.800941 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:34.800941 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:34.801380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966f8cc-5c0e-4a3c-9d5e-91519ca90a1c None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:34.801380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966f8cc-5c0e-4a3c-9d5e-91519ca90a1c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:34.801380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966f8cc-5c0e-4a3c-9d5e-91519ca90a1c None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:34.802030 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 408/797] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:34.803032 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5710da6-0629-4215-b525-c437dc7c3d25 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:34.803320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5710da6-0629-4215-b525-c437dc7c3d25 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:34.803594 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5710da6-0629-4215-b525-c437dc7c3d25 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:34.804251 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 390/798] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:34.805738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6611d-f6c4-47af-87df-44d7ae2ef4b5 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:34.809572 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 409/799] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:34.810781 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5710da6-0629-4215-b525-c437dc7c3d25 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:34.834954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:34.842834 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:34.911655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6611d-f6c4-47af-87df-44d7ae2ef4b5 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:34.915326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5710da6-0629-4215-b525-c437dc7c3d25 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:34.945934 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b76c9-42df-4974-8c7d-3acd29a45fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:34.946561 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b76c9-42df-4974-8c7d-3acd29a45fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:34.946841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b76c9-42df-4974-8c7d-3acd29a45fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:34.947118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b76c9-42df-4974-8c7d-3acd29a45fa2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:34.952403 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903cfb7-83e1-46e4-96a3-d0d27adc13fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:34.953189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903cfb7-83e1-46e4-96a3-d0d27adc13fd None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:34.953661 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903cfb7-83e1-46e4-96a3-d0d27adc13fd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:34.954076 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903cfb7-83e1-46e4-96a3-d0d27adc13fd None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:34.954904 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903cfb7-83e1-46e4-96a3-d0d27adc13fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:34.955161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b76c9-42df-4974-8c7d-3acd29a45fa2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:34.955506 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903cfb7-83e1-46e4-96a3-d0d27adc13fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:34.956611 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b76c9-42df-4974-8c7d-3acd29a45fa2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:34.957425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903cfb7-83e1-46e4-96a3-d0d27adc13fd None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:34.967613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-ce9b76c9-42df-4974-8c7d-3acd29a45fa2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 19:00:34.967613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:34.967613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:34.967613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:34.967613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:34.967613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:34.967613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:34.967613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:34.967613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:34.967613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:34.967613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:34.967613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:34.967613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:34.967613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:34.967613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:34.967613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:34.968750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:34.968750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:34.968750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:34.968750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:34.968750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:34.968750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:34.968750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:34.968750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:34.968750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:34.968750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:34.968750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:34.968750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:34.968750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:34.968750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:34.968750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:34.968750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:34.968750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:34.968750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:34.969956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:34.969956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:34.969956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:34.969956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:34.969956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:34.969956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:34.969956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:34.969956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:34.969956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 19:00:34.969956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:34.973501 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 391/800] 10.222.0.65 () {56 vars in 1093 bytes} [Tue Aug 9 19:00:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:34.974613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be0691-2971-4dfa-a9c5-67f179242da7 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:34.974895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be0691-2971-4dfa-a9c5-67f179242da7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:34.975168 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be0691-2971-4dfa-a9c5-67f179242da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:34.977230 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 410/801] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:34.978573 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2b446-5240-4409-80a5-7df47f458418 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:34.978957 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2b446-5240-4409-80a5-7df47f458418 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:34.979237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2b446-5240-4409-80a5-7df47f458418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:34.992910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-38be0691-2971-4dfa-a9c5-67f179242da7 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:34.994120 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-38be0691-2971-4dfa-a9c5-67f179242da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:34.997464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8df2b446-5240-4409-80a5-7df47f458418 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:34.999375 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8df2b446-5240-4409-80a5-7df47f458418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:35.062934 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 392/802] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:35.074026 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be0691-2971-4dfa-a9c5-67f179242da7 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:35.090191 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:35.090358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 411/803] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:35.091465 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2b446-5240-4409-80a5-7df47f458418 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:35.118185 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:35.179273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be0691-2971-4dfa-a9c5-67f179242da7 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:35.198576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2b446-5240-4409-80a5-7df47f458418 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:35.216994 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0a6fe-78ae-4e84-8beb-c82b4d69240b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:35.218400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0a6fe-78ae-4e84-8beb-c82b4d69240b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:35.218893 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0a6fe-78ae-4e84-8beb-c82b4d69240b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:35.219352 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0a6fe-78ae-4e84-8beb-c82b4d69240b None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:35.220312 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0a6fe-78ae-4e84-8beb-c82b4d69240b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:35.220833 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0a6fe-78ae-4e84-8beb-c82b4d69240b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:35.222297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0a6fe-78ae-4e84-8beb-c82b4d69240b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:35.235480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4b362-5e26-4a23-922d-5c26cf532b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:35.236137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4b362-5e26-4a23-922d-5c26cf532b0e None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:35.236414 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4b362-5e26-4a23-922d-5c26cf532b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:35.236686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4b362-5e26-4a23-922d-5c26cf532b0e None admin] PATH_INFO: `/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/5c29eab582a64a8991b171766d321e39/roles/973d37db3ba74af0b63e3570ab311e21` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:35.245866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 393/804] 10.222.0.65 () {56 vars in 1133 bytes} [Tue Aug 9 19:00:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:35.245866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0a6fe-78ae-4e84-8beb-c82b4d69240b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:35.254019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4b362-5e26-4a23-922d-5c26cf532b0e None admin] RBAC: Authorizing `identity:create_grant(project_id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user_id=5c29eab582a64a8991b171766d321e39, role_id=973d37db3ba74af0b63e3570ab311e21)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:35.255469 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4b362-5e26-4a23-922d-5c26cf532b0e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:35.315541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:35.335482 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 412/805] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 19:00:35 2022] PUT /identity/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/5c29eab582a64a8991b171766d321e39/roles/973d37db3ba74af0b63e3570ab311e21 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:00:35.336577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4b362-5e26-4a23-922d-5c26cf532b0e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:35.354768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0a6fe-78ae-4e84-8beb-c82b4d69240b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:35.407073 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869eca4-5ee7-4c46-9313-d200afeacc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:35.407737 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869eca4-5ee7-4c46-9313-d200afeacc5d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:35.408019 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869eca4-5ee7-4c46-9313-d200afeacc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:35.408297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869eca4-5ee7-4c46-9313-d200afeacc5d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:35.409200 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869eca4-5ee7-4c46-9313-d200afeacc5d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:35.410931 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869eca4-5ee7-4c46-9313-d200afeacc5d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:35.423974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-4869eca4-5ee7-4c46-9313-d200afeacc5d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 19:00:35.423974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:35.423974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:00:35.423974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:00:35.423974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:00:35.423974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:00:35.423974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:00:35.423974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:35.423974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 19:00:35.423974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:35.423974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:35.423974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:35.423974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:35.423974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:35.423974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:35.423974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:35.423974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:35.425101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:35.425101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:35.425101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:35.425101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:35.425101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:35.425101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:35.425101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:00:35.425101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:00:35.425101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:00:35.425101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:00:35.425101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:35.425101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:35.425101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:35.425101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:35.425101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:35.425101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:35.426001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:35.426001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:35.426001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:35.426001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:35.426001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:35.426001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:35.426001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:35.426001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:35.426001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:35.426001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:35.426001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:00:35.426001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:35.426001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 19:00:35.426001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:35.426001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 394/806] 10.222.0.65 () {56 vars in 1129 bytes} [Tue Aug 9 19:00:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:35.426821 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869eca4-5ee7-4c46-9313-d200afeacc5d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:35.444173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:35.493443 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4b362-5e26-4a23-922d-5c26cf532b0e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:35.544266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0cff1-b3fb-4230-899d-a5f0b8367195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:35.544895 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0cff1-b3fb-4230-899d-a5f0b8367195 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:35.545714 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0cff1-b3fb-4230-899d-a5f0b8367195 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:35.545986 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0cff1-b3fb-4230-899d-a5f0b8367195 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:35.557733 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0cff1-b3fb-4230-899d-a5f0b8367195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:35.563146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-baf0cff1-b3fb-4230-899d-a5f0b8367195 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:00:35.563146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:35.563146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:35.563146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:35.563146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:35.563146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:35.563146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:35.563146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:35.563146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:35.563146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:35.563146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:35.563146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:35.563146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:35.563146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:35.563146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:35.563146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:35.564089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:35.564089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:35.564089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:35.564089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:35.564089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:35.564089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:35.564089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:35.564089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:35.564089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:35.564089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:35.564089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:35.564089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:35.564089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:35.564089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:35.564089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:35.564089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:35.564952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:35.564952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:35.564952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:35.564952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:35.564952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:35.564952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:35.564952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:35.564952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:35.564952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:35.564952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:35.564952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:00:35.564952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:35.564952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 413/807] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:00:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:35.565674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0cff1-b3fb-4230-899d-a5f0b8367195 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:35.570068 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869eca4-5ee7-4c46-9313-d200afeacc5d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:35.607463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff05e9-8c44-461b-9494-b0e8cde6a4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:35.608650 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff05e9-8c44-461b-9494-b0e8cde6a4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:35.608934 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff05e9-8c44-461b-9494-b0e8cde6a4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:35.609206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff05e9-8c44-461b-9494-b0e8cde6a4c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:35.613482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:35.671926 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0cff1-b3fb-4230-899d-a5f0b8367195 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:35.679594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff05e9-8c44-461b-9494-b0e8cde6a4c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:35.681056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff05e9-8c44-461b-9494-b0e8cde6a4c0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:35.703864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:35.710966 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e75d5-6a9b-47d9-86de-c7decc00f8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:35.711571 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e75d5-6a9b-47d9-86de-c7decc00f8cd None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:35.712120 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e75d5-6a9b-47d9-86de-c7decc00f8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:35.712397 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e75d5-6a9b-47d9-86de-c7decc00f8cd None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:35.713331 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e75d5-6a9b-47d9-86de-c7decc00f8cd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:35.713800 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e75d5-6a9b-47d9-86de-c7decc00f8cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:35.715159 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e75d5-6a9b-47d9-86de-c7decc00f8cd None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:35.720477 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 414/808] 10.222.0.65 () {56 vars in 1124 bytes} [Tue Aug 9 19:00:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:35.722881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e75d5-6a9b-47d9-86de-c7decc00f8cd None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:35.791321 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 395/809] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:00:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:00:35.793382 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8e02d-4ff2-43ee-a9ad-c28e0f4fe833 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:35.793699 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8e02d-4ff2-43ee-a9ad-c28e0f4fe833 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:35.793981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8e02d-4ff2-43ee-a9ad-c28e0f4fe833 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:35.796718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 396/810] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:35.797550 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8e02d-4ff2-43ee-a9ad-c28e0f4fe833 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:35.835676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e75d5-6a9b-47d9-86de-c7decc00f8cd None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:35.840305 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:35.879772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0729714-ce18-4db2-848c-e221e50c922a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:35.880380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0729714-ce18-4db2-848c-e221e50c922a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:35.880665 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0729714-ce18-4db2-848c-e221e50c922a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:35.880958 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0729714-ce18-4db2-848c-e221e50c922a None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:35.881896 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0729714-ce18-4db2-848c-e221e50c922a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:35.882206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0729714-ce18-4db2-848c-e221e50c922a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:35.883563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0729714-ce18-4db2-848c-e221e50c922a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:35.891938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 415/811] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:00:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:35.892741 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0729714-ce18-4db2-848c-e221e50c922a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:35.928184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8e02d-4ff2-43ee-a9ad-c28e0f4fe833 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:35.953591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:35.964283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace4450-166a-4fae-a32d-d3e86c220677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:35.964890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace4450-166a-4fae-a32d-d3e86c220677 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:35.965172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace4450-166a-4fae-a32d-d3e86c220677 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:35.965443 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace4450-166a-4fae-a32d-d3e86c220677 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:35.966335 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace4450-166a-4fae-a32d-d3e86c220677 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:35.966443 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace4450-166a-4fae-a32d-d3e86c220677 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:35.968447 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace4450-166a-4fae-a32d-d3e86c220677 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:35.978192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 397/812] 10.222.0.65 () {56 vars in 1124 bytes} [Tue Aug 9 19:00:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:35.978192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953b334-c88f-416e-9156-45905a95bcb9 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:35.978192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953b334-c88f-416e-9156-45905a95bcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:35.978192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953b334-c88f-416e-9156-45905a95bcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:35.995984 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2953b334-c88f-416e-9156-45905a95bcb9 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:35.997190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2953b334-c88f-416e-9156-45905a95bcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:36.002228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0729714-ce18-4db2-848c-e221e50c922a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:36.037302 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e7178-b089-4db0-a532-fc32269eca44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:36.038027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e7178-b089-4db0-a532-fc32269eca44 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:36.038303 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e7178-b089-4db0-a532-fc32269eca44 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:36.038575 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e7178-b089-4db0-a532-fc32269eca44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:36.050129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e7178-b089-4db0-a532-fc32269eca44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:36.051596 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e7178-b089-4db0-a532-fc32269eca44 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:36.066071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-f93e7178-b089-4db0-a532-fc32269eca44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:36.066071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:36.066071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:36.066071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:36.066071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:36.066071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:36.066071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:36.066071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:36.066071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:36.066071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:36.066071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:36.066071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:36.066071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:36.066071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:36.066071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:36.066071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:36.066997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:36.066997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:36.066997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:36.066997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:36.066997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:36.066997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:36.066997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:36.066997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:36.066997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:36.066997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:36.066997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:36.066997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:36.066997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:36.066997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:36.066997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:36.066997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:36.066997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:36.067881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:36.067881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:36.067881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:36.067881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 416/813] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:36.067881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e7178-b089-4db0-a532-fc32269eca44 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:36.075817 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 398/814] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:36.076877 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953b334-c88f-416e-9156-45905a95bcb9 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:36.116925 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:36.188082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e7178-b089-4db0-a532-fc32269eca44 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:36.190965 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953b334-c88f-416e-9156-45905a95bcb9 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:36.198574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:36.224783 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0228f5-7c9b-434d-9845-ac498390c1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:36.225175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de5e21-b350-43d4-8853-de30862a668e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:36.225809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0228f5-7c9b-434d-9845-ac498390c1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:36.225944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de5e21-b350-43d4-8853-de30862a668e None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:36.226042 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de5e21-b350-43d4-8853-de30862a668e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:36.226209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0228f5-7c9b-434d-9845-ac498390c1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:36.226304 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de5e21-b350-43d4-8853-de30862a668e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:36.226683 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0228f5-7c9b-434d-9845-ac498390c1a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:36.227040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de5e21-b350-43d4-8853-de30862a668e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:36.228401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de5e21-b350-43d4-8853-de30862a668e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:36.239431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0228f5-7c9b-434d-9845-ac498390c1a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:36.240875 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0228f5-7c9b-434d-9845-ac498390c1a1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:36.254881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-7a0228f5-7c9b-434d-9845-ac498390c1a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:36.254881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:36.254881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:36.254881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:36.254881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:36.254881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:36.254881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:36.254881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:36.254881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:36.254881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:36.254881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:36.254881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:36.254881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:36.254881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:36.254881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:36.254881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:36.256206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:36.256206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:36.256206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:36.256206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:36.256206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:36.256206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:36.256206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:36.256206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:36.256206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:36.256206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:36.256206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:36.256206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:36.256206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:36.256206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:36.256206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:36.256206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:36.256206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:36.257627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:36.257627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:36.257627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:36.257627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 417/815] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:36.257627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0228f5-7c9b-434d-9845-ac498390c1a1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:36.309492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 399/816] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:00:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:00:36.309492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de5e21-b350-43d4-8853-de30862a668e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:36.394453 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0228f5-7c9b-434d-9845-ac498390c1a1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:36.420184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:36.445940 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed0078-813b-48f0-99a0-8d6c443af5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:36.446627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed0078-813b-48f0-99a0-8d6c443af5ef None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:36.447024 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed0078-813b-48f0-99a0-8d6c443af5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:36.447298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed0078-813b-48f0-99a0-8d6c443af5ef None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:36.448005 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed0078-813b-48f0-99a0-8d6c443af5ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:36.448172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de5e21-b350-43d4-8853-de30862a668e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:36.448448 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed0078-813b-48f0-99a0-8d6c443af5ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:36.450329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed0078-813b-48f0-99a0-8d6c443af5ef None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:36.475941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 418/817] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:36.478693 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed0078-813b-48f0-99a0-8d6c443af5ef None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:36.490531 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978f0a0-1dbf-4ede-a159-4b87c493524e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:36.491176 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978f0a0-1dbf-4ede-a159-4b87c493524e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:36.491460 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978f0a0-1dbf-4ede-a159-4b87c493524e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:36.491721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978f0a0-1dbf-4ede-a159-4b87c493524e None admin] PATH_INFO: `/v3/services/network` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:36.492376 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978f0a0-1dbf-4ede-a159-4b87c493524e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:36.493699 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978f0a0-1dbf-4ede-a159-4b87c493524e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:36.504605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-8978f0a0-1dbf-4ede-a159-4b87c493524e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 19:00:36.504605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:36.504605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:00:36.504605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:00:36.504605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:00:36.504605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:00:36.504605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:00:36.504605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:36.504605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 19:00:36.504605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:36.504605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:36.504605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:36.504605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:36.504605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:36.504605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:36.504605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:36.504605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:36.505755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:36.505755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:36.505755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:36.505755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:36.505755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:36.505755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:36.505755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:00:36.505755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:00:36.505755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:00:36.505755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:00:36.505755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:36.505755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:36.505755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:36.505755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:36.505755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:36.505755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:36.506869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:36.506869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:36.506869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:36.506869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:36.506869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:36.506869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:36.506869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:36.506869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:36.506869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:36.506869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:36.506869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:00:36.506869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:36.506869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 19:00:36.506869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:36.507652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:36.511860 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 400/818] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:36 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:36.512320 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978f0a0-1dbf-4ede-a159-4b87c493524e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:36.618683 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed0078-813b-48f0-99a0-8d6c443af5ef None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:36.643505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978f0a0-1dbf-4ede-a159-4b87c493524e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:36.665572 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744f8ad-eed3-4bf9-9187-7f6378025818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:36.666687 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744f8ad-eed3-4bf9-9187-7f6378025818 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:36.667146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744f8ad-eed3-4bf9-9187-7f6378025818 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:36.667812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744f8ad-eed3-4bf9-9187-7f6378025818 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:36.669035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744f8ad-eed3-4bf9-9187-7f6378025818 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:36.669761 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744f8ad-eed3-4bf9-9187-7f6378025818 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:36.671998 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744f8ad-eed3-4bf9-9187-7f6378025818 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:36.679848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34811e9-ee01-4863-a40e-21f4dba1c9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:36.680480 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34811e9-ee01-4863-a40e-21f4dba1c9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:36.680757 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34811e9-ee01-4863-a40e-21f4dba1c9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:36.681433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34811e9-ee01-4863-a40e-21f4dba1c9a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:36.687699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 419/819] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:36.688886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744f8ad-eed3-4bf9-9187-7f6378025818 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:36.694131 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34811e9-ee01-4863-a40e-21f4dba1c9a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:36.695600 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34811e9-ee01-4863-a40e-21f4dba1c9a6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:36.707990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-a34811e9-ee01-4863-a40e-21f4dba1c9a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:36.707990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:36.707990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:36.707990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:36.707990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:36.707990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:36.707990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:36.707990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:36.707990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:36.707990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:36.707990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:36.707990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:36.707990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:36.707990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:36.707990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:36.709159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:36.709159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:36.709159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:36.709159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:36.709159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:36.709159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:36.709159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:36.709159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:36.709159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:36.709159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:36.709159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:36.709159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:36.709159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:36.709159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:36.709159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:36.709159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:36.709159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:36.710269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:36.710269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:36.710269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:36.710269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:36.710269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:36.710269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:36.710269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:36.710269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:36.713703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 401/820] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:36.714538 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34811e9-ee01-4863-a40e-21f4dba1c9a6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:36.724942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:36.795359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:36.824517 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744f8ad-eed3-4bf9-9187-7f6378025818 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:36.825661 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34811e9-ee01-4863-a40e-21f4dba1c9a6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:36.862630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cceb2ed-0bfc-49c2-920a-f779ce9f71a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:36.863205 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceb2ed-0bfc-49c2-920a-f779ce9f71a9 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:36.863467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceb2ed-0bfc-49c2-920a-f779ce9f71a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:36.863736 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceb2ed-0bfc-49c2-920a-f779ce9f71a9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:36.871577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb9696-ad2c-4c28-80ae-1fba19da222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:36.871820 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cceb2ed-0bfc-49c2-920a-f779ce9f71a9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:36.872528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb9696-ad2c-4c28-80ae-1fba19da222f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:36.873035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb9696-ad2c-4c28-80ae-1fba19da222f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:36.873300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cceb2ed-0bfc-49c2-920a-f779ce9f71a9 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:36.873879 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb9696-ad2c-4c28-80ae-1fba19da222f None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:36.874727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb9696-ad2c-4c28-80ae-1fba19da222f None admin] RBAC: Adding query filter params (name=network) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:36.875193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb9696-ad2c-4c28-80ae-1fba19da222f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:36.877622 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb9696-ad2c-4c28-80ae-1fba19da222f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:36.883359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 420/821] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Aug 9 19:00:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:36.884315 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb9696-ad2c-4c28-80ae-1fba19da222f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:36.892782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-3cceb2ed-0bfc-49c2-920a-f779ce9f71a9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 19:00:36.892782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:36.892782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:36.892782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:36.892782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:36.892782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:36.892782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:36.892782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:36.892782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:36.892782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:36.892782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:36.892782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:36.892782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:36.892782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:36.892782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:36.892782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:36.894002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:36.894002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:36.894002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:36.894002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:36.894002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:36.894002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:36.894002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:36.894002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:36.894002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:36.894002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:36.894002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:36.894002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:36.894002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:36.894002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:36.894002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:36.894002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:36.894002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:36.894002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:36.895177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:36.895177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:36.895177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:36.895177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:36.895177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:36.895177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:36.895177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:36.895177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:36.895177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 19:00:36.895177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:36.901535 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 402/822] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:00:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:36.902500 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cceb2ed-0bfc-49c2-920a-f779ce9f71a9 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:36.972048 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:37.011431 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cceb2ed-0bfc-49c2-920a-f779ce9f71a9 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:37.015770 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb9696-ad2c-4c28-80ae-1fba19da222f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:37.050534 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fea0b3-b23c-4741-91f1-36e0fb690a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:37.051290 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fea0b3-b23c-4741-91f1-36e0fb690a3f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:37.051686 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fea0b3-b23c-4741-91f1-36e0fb690a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:37.052038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fea0b3-b23c-4741-91f1-36e0fb690a3f None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:37.052808 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fea0b3-b23c-4741-91f1-36e0fb690a3f None admin] RBAC: Adding query filter params (type=network) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:37.053178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fea0b3-b23c-4741-91f1-36e0fb690a3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:37.054311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854972b-7178-43a2-a74a-c1cd7fda729a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:37.054847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fea0b3-b23c-4741-91f1-36e0fb690a3f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:37.055235 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854972b-7178-43a2-a74a-c1cd7fda729a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:37.055658 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854972b-7178-43a2-a74a-c1cd7fda729a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:37.056070 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854972b-7178-43a2-a74a-c1cd7fda729a None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:37.057027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854972b-7178-43a2-a74a-c1cd7fda729a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:37.057584 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854972b-7178-43a2-a74a-c1cd7fda729a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:37.059140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854972b-7178-43a2-a74a-c1cd7fda729a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:37.065436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 403/823] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Aug 9 19:00:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:37.066435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fea0b3-b23c-4741-91f1-36e0fb690a3f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:37.072607 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 421/824] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:37.073602 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854972b-7178-43a2-a74a-c1cd7fda729a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:37.077692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:37.181022 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854972b-7178-43a2-a74a-c1cd7fda729a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:37.183782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fea0b3-b23c-4741-91f1-36e0fb690a3f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:37.215225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:37.219907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311f22e-f0c4-4602-8a91-4b35fd6a6eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:37.220636 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311f22e-f0c4-4602-8a91-4b35fd6a6eb0 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:37.220917 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311f22e-f0c4-4602-8a91-4b35fd6a6eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:37.221285 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311f22e-f0c4-4602-8a91-4b35fd6a6eb0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:37.221976 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311f22e-f0c4-4602-8a91-4b35fd6a6eb0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:37.228181 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adfc44-d4e3-4dc8-96e1-2a906f23dc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:37.228307 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311f22e-f0c4-4602-8a91-4b35fd6a6eb0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:37.228385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adfc44-d4e3-4dc8-96e1-2a906f23dc6f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:37.228385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adfc44-d4e3-4dc8-96e1-2a906f23dc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:37.228385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adfc44-d4e3-4dc8-96e1-2a906f23dc6f None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:37.228385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adfc44-d4e3-4dc8-96e1-2a906f23dc6f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:37.228385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adfc44-d4e3-4dc8-96e1-2a906f23dc6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:37.228385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adfc44-d4e3-4dc8-96e1-2a906f23dc6f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:37.250660 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 404/825] 10.222.0.65 () {56 vars in 1135 bytes} [Tue Aug 9 19:00:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:37.250660 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adfc44-d4e3-4dc8-96e1-2a906f23dc6f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:37.318056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 422/826] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:00:37 2022] POST /identity/v3/endpoints => generated 337 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:00:37.319702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311f22e-f0c4-4602-8a91-4b35fd6a6eb0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:37.419948 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adfc44-d4e3-4dc8-96e1-2a906f23dc6f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:37.448167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:37.479613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3d732-bef7-43b1-9888-b5dccd1de254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:37.480439 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3d732-bef7-43b1-9888-b5dccd1de254 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:37.480719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3d732-bef7-43b1-9888-b5dccd1de254 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:37.480992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3d732-bef7-43b1-9888-b5dccd1de254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:37.482269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3d732-bef7-43b1-9888-b5dccd1de254 None admin] RBAC: Adding query filter params (role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=2cfda1bec35145f3bbcc13fae0b7af2e) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:37.482816 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3d732-bef7-43b1-9888-b5dccd1de254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:37.484626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3d732-bef7-43b1-9888-b5dccd1de254 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:37.493337 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 405/827] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:00:37 2022] GET /identity/v3/role_assignments?user.id=2cfda1bec35145f3bbcc13fae0b7af2e&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:37.494695 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b796a-ad87-4383-91ff-0051bfc68200 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:37.494985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b796a-ad87-4383-91ff-0051bfc68200 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:37.495260 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b796a-ad87-4383-91ff-0051bfc68200 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:37.500728 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311f22e-f0c4-4602-8a91-4b35fd6a6eb0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:37.501890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 406/828] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:37.503330 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abae8eb-1d2f-47b2-b665-3959b2ce8d08 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:37.503618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abae8eb-1d2f-47b2-b665-3959b2ce8d08 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:37.503892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abae8eb-1d2f-47b2-b665-3959b2ce8d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:37.535718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9abae8eb-1d2f-47b2-b665-3959b2ce8d08 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:37.537036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9abae8eb-1d2f-47b2-b665-3959b2ce8d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:37.574895 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca57d6-5092-4042-be9f-b6c829d79df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:37.575107 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca57d6-5092-4042-be9f-b6c829d79df7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:37.575447 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca57d6-5092-4042-be9f-b6c829d79df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:37.575631 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca57d6-5092-4042-be9f-b6c829d79df7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:37.599081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca57d6-5092-4042-be9f-b6c829d79df7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:37.600609 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca57d6-5092-4042-be9f-b6c829d79df7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:37.606435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:37.617287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-69ca57d6-5092-4042-be9f-b6c829d79df7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:37.617287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:37.617287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:37.617287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:37.617287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:37.617287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:37.617287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:37.617287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:37.617287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:37.617287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:37.617287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:37.617287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:37.617287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:37.617287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:37.617287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:37.617287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:37.618355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:37.618355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:37.618355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:37.618355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:37.618355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:37.618355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:37.618355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:37.618355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:37.618355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:37.618355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:37.618355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:37.618355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:37.618355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:37.618355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:37.618355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:37.618355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:37.618355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:37.619251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:37.619251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:37.619251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:37.619914 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 423/829] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:37.625485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca57d6-5092-4042-be9f-b6c829d79df7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:37.634055 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 407/830] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 19:00:37.679002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abae8eb-1d2f-47b2-b665-3959b2ce8d08 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:37.749376 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca57d6-5092-4042-be9f-b6c829d79df7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:37.763310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:37.789247 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f28c6-d26d-435a-ba0a-b089b5d41750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:37.789820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f28c6-d26d-435a-ba0a-b089b5d41750 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:37.790104 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f28c6-d26d-435a-ba0a-b089b5d41750 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:37.790378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f28c6-d26d-435a-ba0a-b089b5d41750 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:37.791057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f28c6-d26d-435a-ba0a-b089b5d41750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:37.791635 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f28c6-d26d-435a-ba0a-b089b5d41750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:37.793753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f28c6-d26d-435a-ba0a-b089b5d41750 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:37.810715 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 424/831] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:37.811880 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abae8eb-1d2f-47b2-b665-3959b2ce8d08 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:37.816175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f28c6-d26d-435a-ba0a-b089b5d41750 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:37.863292 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd7e10-059e-44c7-8f1a-7574d648c7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:37.864073 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd7e10-059e-44c7-8f1a-7574d648c7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:37.864352 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd7e10-059e-44c7-8f1a-7574d648c7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:37.864663 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd7e10-059e-44c7-8f1a-7574d648c7f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:37.882059 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd7e10-059e-44c7-8f1a-7574d648c7f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:37.888470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-c5cd7e10-059e-44c7-8f1a-7574d648c7f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:37.888470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:37.888470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:37.888470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:37.888470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:37.888470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:37.888470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:37.888470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:37.888470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:37.888470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:37.888470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:37.888470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:37.888470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:37.888470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:37.888470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:37.888470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:37.889529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:37.889529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:37.889529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:37.889529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:37.889529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:37.889529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:37.889529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:37.889529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:37.889529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:37.889529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:37.889529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:37.889529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:37.889529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:37.889529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:37.889529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:37.889529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:37.890979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:37.890979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:37.890979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:37.890979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:37.890979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:37.890979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:37.890979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:37.890979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:37.890979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:37.890979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:37.890979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:00:37.890979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:37.890979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 408/832] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:00:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:37.898399 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd7e10-059e-44c7-8f1a-7574d648c7f8 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:37.937171 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f28c6-d26d-435a-ba0a-b089b5d41750 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:37.944076 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:37.980955 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa408528-2425-4a0c-9de8-3123d9399b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:37.980955 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa408528-2425-4a0c-9de8-3123d9399b0c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:37.980955 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa408528-2425-4a0c-9de8-3123d9399b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:37.980955 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa408528-2425-4a0c-9de8-3123d9399b0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:37.986816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa408528-2425-4a0c-9de8-3123d9399b0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:37.988349 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa408528-2425-4a0c-9de8-3123d9399b0c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:38.002237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-aa408528-2425-4a0c-9de8-3123d9399b0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:38.002237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:38.002237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:38.002237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:38.002237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:38.002237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:38.002237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:38.002237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:38.002237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:38.002237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:38.002237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:38.002237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:38.002237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:38.002237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:38.002237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:38.003174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:38.003174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:38.003174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:38.003174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:38.003174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:38.003174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:38.003174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:38.003174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:38.003174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:38.003174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:38.003174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:38.003174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:38.003174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:38.003174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:38.003174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:38.003174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:38.003174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:38.004052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:38.004052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:38.004052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:38.004052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:38.004052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:38.004052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:38.004052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:38.004052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:38.008277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 425/833] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:38.009612 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa408528-2425-4a0c-9de8-3123d9399b0c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:38.027839 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd7e10-059e-44c7-8f1a-7574d648c7f8 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:38.043353 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:38.079560 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e47306-3194-44e1-96d5-c62b8ec6a575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:38.080759 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e47306-3194-44e1-96d5-c62b8ec6a575 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:38.081242 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e47306-3194-44e1-96d5-c62b8ec6a575 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:38.081971 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e47306-3194-44e1-96d5-c62b8ec6a575 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:38.083390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e47306-3194-44e1-96d5-c62b8ec6a575 None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:38.083877 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e47306-3194-44e1-96d5-c62b8ec6a575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:38.085760 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e47306-3194-44e1-96d5-c62b8ec6a575 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:38.103278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 409/834] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:00:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:38.104358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e47306-3194-44e1-96d5-c62b8ec6a575 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:38.124208 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa408528-2425-4a0c-9de8-3123d9399b0c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:38.170281 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a48f5-1b93-4e24-8baa-fa0fd7e22f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:38.170899 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a48f5-1b93-4e24-8baa-fa0fd7e22f91 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:38.171177 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a48f5-1b93-4e24-8baa-fa0fd7e22f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:38.171450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a48f5-1b93-4e24-8baa-fa0fd7e22f91 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:38.172414 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a48f5-1b93-4e24-8baa-fa0fd7e22f91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:38.172723 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a48f5-1b93-4e24-8baa-fa0fd7e22f91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:38.174849 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a48f5-1b93-4e24-8baa-fa0fd7e22f91 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:38.201551 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 426/835] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:38.206194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a48f5-1b93-4e24-8baa-fa0fd7e22f91 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:38.238583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:38.244382 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e47306-3194-44e1-96d5-c62b8ec6a575 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:38.291067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e87ef3-3f24-4dd7-9310-612df8aabd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:38.293058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e87ef3-3f24-4dd7-9310-612df8aabd38 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:38.293529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e87ef3-3f24-4dd7-9310-612df8aabd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:38.294011 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e87ef3-3f24-4dd7-9310-612df8aabd38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:38.309355 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e87ef3-3f24-4dd7-9310-612df8aabd38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:38.311618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e87ef3-3f24-4dd7-9310-612df8aabd38 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:38.317098 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:38.332564 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a48f5-1b93-4e24-8baa-fa0fd7e22f91 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:38.333278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-f7e87ef3-3f24-4dd7-9310-612df8aabd38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:38.333278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:38.333278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:38.333278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:38.333278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:38.333278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:38.333278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:38.333278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:38.333278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:38.333278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:38.333278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:38.333278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:38.333278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:38.333278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:38.333278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:38.333278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:38.340184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:38.340184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:38.340184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:38.340184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:38.340184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:38.340184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:38.340184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:38.340184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:38.340184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:38.340184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:38.340184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:38.340184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:38.340184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:38.340184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:38.340184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:38.340184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:38.340184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:38.341090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:38.341090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:38.341090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:38.341090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 410/836] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:38.344874 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e87ef3-3f24-4dd7-9310-612df8aabd38 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:38.381640 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a5542-f609-4e9c-92dd-048e8787da87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:38.382307 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a5542-f609-4e9c-92dd-048e8787da87 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:38.382583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a5542-f609-4e9c-92dd-048e8787da87 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:38.382856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a5542-f609-4e9c-92dd-048e8787da87 None admin] PATH_INFO: `/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/aac48cd591b44f2999d2f172262019da/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:38.385264 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a5542-f609-4e9c-92dd-048e8787da87 None admin] RBAC: Authorizing `identity:create_grant(project_id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user_id=aac48cd591b44f2999d2f172262019da, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:38.387000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a5542-f609-4e9c-92dd-048e8787da87 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:38.463115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 427/837] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 19:00:38 2022] PUT /identity/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/aac48cd591b44f2999d2f172262019da/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:00:38.465154 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e87ef3-3f24-4dd7-9310-612df8aabd38 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:38.470537 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014a12a-bb98-4b5f-b0ab-73a596c2a9e0 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:38.470537 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014a12a-bb98-4b5f-b0ab-73a596c2a9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:38.471546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014a12a-bb98-4b5f-b0ab-73a596c2a9e0 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:38.472438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 428/838] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:38.479973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b558da8-a8b8-4bc2-bfe2-1ffec27c9486 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:38.480275 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b558da8-a8b8-4bc2-bfe2-1ffec27c9486 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:38.482279 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b558da8-a8b8-4bc2-bfe2-1ffec27c9486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:38.507859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9b558da8-a8b8-4bc2-bfe2-1ffec27c9486 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:38.509394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9b558da8-a8b8-4bc2-bfe2-1ffec27c9486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:38.516868 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be781c88-ecc2-47d8-b7eb-41fee4b51fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:38.518021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be781c88-ecc2-47d8-b7eb-41fee4b51fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:38.518557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be781c88-ecc2-47d8-b7eb-41fee4b51fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:38.519701 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be781c88-ecc2-47d8-b7eb-41fee4b51fb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:38.520576 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be781c88-ecc2-47d8-b7eb-41fee4b51fb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:38.521203 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be781c88-ecc2-47d8-b7eb-41fee4b51fb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:38.522990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be781c88-ecc2-47d8-b7eb-41fee4b51fb3 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:38.543767 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 411/839] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:38.545509 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be781c88-ecc2-47d8-b7eb-41fee4b51fb3 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:38.561850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:38.606431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 429/840] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 19:00:38.632901 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b558da8-a8b8-4bc2-bfe2-1ffec27c9486 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:38.680628 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be781c88-ecc2-47d8-b7eb-41fee4b51fb3 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:38.722913 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653ed81-4e86-41a5-8659-dbffb7a974e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:38.723926 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653ed81-4e86-41a5-8659-dbffb7a974e8 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:38.724433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653ed81-4e86-41a5-8659-dbffb7a974e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:38.724936 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653ed81-4e86-41a5-8659-dbffb7a974e8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:38.732734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653ed81-4e86-41a5-8659-dbffb7a974e8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:38.734473 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:38.735323 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653ed81-4e86-41a5-8659-dbffb7a974e8 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:38.748763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-f653ed81-4e86-41a5-8659-dbffb7a974e8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 19:00:38.748763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:38.748763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:38.748763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:38.748763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:38.748763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:38.748763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:38.748763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:38.748763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:38.748763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:38.748763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:38.748763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:38.748763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:38.748763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:38.748763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:38.748763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:38.756369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:38.756369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:38.756369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:38.756369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:38.756369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:38.756369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:38.756369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:38.756369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:38.756369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:38.756369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:38.756369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:38.756369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:38.756369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:38.756369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:38.756369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:38.756369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:38.756369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:38.756369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:38.757842 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:38.757842 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:38.757842 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:38.757842 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:38.757842 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:38.757842 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:38.757842 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:38.757842 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:38.757842 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 19:00:38.757842 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:38.757842 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 412/841] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Aug 9 19:00:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:38.758463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b558da8-a8b8-4bc2-bfe2-1ffec27c9486 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:38.759772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653ed81-4e86-41a5-8659-dbffb7a974e8 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:38.798716 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed158e8-589c-4f0e-ba09-02c1660a9643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:38.799334 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed158e8-589c-4f0e-ba09-02c1660a9643 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:38.799616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed158e8-589c-4f0e-ba09-02c1660a9643 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:38.799891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed158e8-589c-4f0e-ba09-02c1660a9643 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:38.800483 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed158e8-589c-4f0e-ba09-02c1660a9643 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:38.801918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed158e8-589c-4f0e-ba09-02c1660a9643 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:38.811633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-fed158e8-589c-4f0e-ba09-02c1660a9643 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 19:00:38.811633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:38.811633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:00:38.811633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:00:38.811633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:00:38.811633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:00:38.811633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:00:38.811633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:38.811633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 19:00:38.811633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:38.811633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:38.811633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:38.811633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:38.811633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:38.811633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:38.811633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:38.811633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:38.812806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:38.812806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:38.812806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:38.812806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:38.812806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:38.812806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:38.812806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:00:38.812806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:00:38.812806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:00:38.812806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:00:38.812806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:38.812806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:38.812806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:38.812806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:38.812806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:38.812806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:38.814260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:38.814260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:38.814260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:38.814260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:38.814260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:38.814260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:38.814260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:38.814260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:38.814260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:38.814260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:38.814260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:00:38.814260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:38.814260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 19:00:38.814260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:38.814260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 430/842] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 19:00:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:38.818806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed158e8-589c-4f0e-ba09-02c1660a9643 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:38.868797 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:38.902293 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653ed81-4e86-41a5-8659-dbffb7a974e8 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:38.931961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed158e8-589c-4f0e-ba09-02c1660a9643 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:38.941985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99563923-82ae-4960-8093-3c038cabee06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:38.942965 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99563923-82ae-4960-8093-3c038cabee06 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:38.943463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99563923-82ae-4960-8093-3c038cabee06 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:38.943943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99563923-82ae-4960-8093-3c038cabee06 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:38.944888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99563923-82ae-4960-8093-3c038cabee06 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:38.945520 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99563923-82ae-4960-8093-3c038cabee06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:38.947265 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99563923-82ae-4960-8093-3c038cabee06 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:38.967735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b0098-d216-4398-ac6b-955cfbe4583f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:38.968332 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b0098-d216-4398-ac6b-955cfbe4583f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:38.968561 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b0098-d216-4398-ac6b-955cfbe4583f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:38.968798 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 413/843] 10.222.0.65 () {56 vars in 1149 bytes} [Tue Aug 9 19:00:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:38.968901 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b0098-d216-4398-ac6b-955cfbe4583f None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:38.969471 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b0098-d216-4398-ac6b-955cfbe4583f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:38.975929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b0098-d216-4398-ac6b-955cfbe4583f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:38.975929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b0098-d216-4398-ac6b-955cfbe4583f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:38.976139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99563923-82ae-4960-8093-3c038cabee06 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:38.978053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 431/844] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 19:00:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:38.983467 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b0098-d216-4398-ac6b-955cfbe4583f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:39.001104 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:39.094517 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99563923-82ae-4960-8093-3c038cabee06 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:39.111799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b0098-d216-4398-ac6b-955cfbe4583f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:39.134587 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:39.146655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a14841-4e07-4c86-8264-180ab4174e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:39.147272 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a14841-4e07-4c86-8264-180ab4174e80 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:39.147553 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a14841-4e07-4c86-8264-180ab4174e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:39.147824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a14841-4e07-4c86-8264-180ab4174e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:39.152997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeeaf7-95ee-44bb-9258-d452b92b5a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:39.153646 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeeaf7-95ee-44bb-9258-d452b92b5a5a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:39.153933 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeeaf7-95ee-44bb-9258-d452b92b5a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:39.154235 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeeaf7-95ee-44bb-9258-d452b92b5a5a None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:39.155075 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feeeaf7-95ee-44bb-9258-d452b92b5a5a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:39.155386 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feeeaf7-95ee-44bb-9258-d452b92b5a5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:39.156780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feeeaf7-95ee-44bb-9258-d452b92b5a5a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:39.170432 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 432/845] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 19:00:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:39.236080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a14841-4e07-4c86-8264-180ab4174e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:39.237951 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a14841-4e07-4c86-8264-180ab4174e80 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:39.352536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 414/846] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:00:38 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:00:39.359459 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeeaf7-95ee-44bb-9258-d452b92b5a5a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:39.436938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:39.471719 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeeaf7-95ee-44bb-9258-d452b92b5a5a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:39.508700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d45c1-b616-438f-9639-bb70af5e903f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:39.508700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d45c1-b616-438f-9639-bb70af5e903f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:39.508700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d45c1-b616-438f-9639-bb70af5e903f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:39.508700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d45c1-b616-438f-9639-bb70af5e903f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:39.524858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d45c1-b616-438f-9639-bb70af5e903f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:39.526357 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d45c1-b616-438f-9639-bb70af5e903f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:39.541577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-156d45c1-b616-438f-9639-bb70af5e903f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:39.541577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:39.541577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:39.541577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:39.541577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:39.541577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:39.541577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:39.541577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:39.541577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:39.541577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:39.541577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:39.541577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:39.541577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:39.541577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:39.541577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:39.541577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:39.542553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:39.542553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:39.542553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:39.542553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:39.542553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:39.542553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:39.542553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:39.542553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:39.542553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:39.542553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:39.542553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:39.542553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:39.542553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:39.542553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:39.542553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:39.542553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:39.542553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:39.544005 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:39.544005 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:39.544005 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:39.544005 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 433/847] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:39.548943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a14841-4e07-4c86-8264-180ab4174e80 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:39.582046 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:39.662714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a14841-4e07-4c86-8264-180ab4174e80 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:39.699687 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db4713-29aa-4d83-b184-6f8412c34772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:39.700307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db4713-29aa-4d83-b184-6f8412c34772 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:39.700591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db4713-29aa-4d83-b184-6f8412c34772 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:39.700865 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db4713-29aa-4d83-b184-6f8412c34772 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:39.702522 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db4713-29aa-4d83-b184-6f8412c34772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:39.702838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db4713-29aa-4d83-b184-6f8412c34772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:39.704226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db4713-29aa-4d83-b184-6f8412c34772 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:39.716760 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 415/848] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:39.722261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d45c1-b616-438f-9639-bb70af5e903f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:39.744771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317e25d-14e6-4e1f-b9c6-dfaf5ad9f236 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:39.745099 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317e25d-14e6-4e1f-b9c6-dfaf5ad9f236 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:39.745333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317e25d-14e6-4e1f-b9c6-dfaf5ad9f236 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:39.746818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 416/849] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:00:39.752677 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8b7a3-5a94-4c1e-88cd-4a7d2be0f9db None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:39.752964 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8b7a3-5a94-4c1e-88cd-4a7d2be0f9db None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:39.753240 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8b7a3-5a94-4c1e-88cd-4a7d2be0f9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:39.776350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9ed8b7a3-5a94-4c1e-88cd-4a7d2be0f9db None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:39.778243 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9ed8b7a3-5a94-4c1e-88cd-4a7d2be0f9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:39.839613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d45c1-b616-438f-9639-bb70af5e903f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:39.869545 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 417/850] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 19:00:39.870447 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:39.882884 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31454675-d8eb-4acf-a6d7-b65c05cc317a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:39.883529 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31454675-d8eb-4acf-a6d7-b65c05cc317a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:39.883813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31454675-d8eb-4acf-a6d7-b65c05cc317a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:39.884089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31454675-d8eb-4acf-a6d7-b65c05cc317a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:39.892373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8b7a3-5a94-4c1e-88cd-4a7d2be0f9db None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:39.894141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31454675-d8eb-4acf-a6d7-b65c05cc317a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:39.896939 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31454675-d8eb-4acf-a6d7-b65c05cc317a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:39.912277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-31454675-d8eb-4acf-a6d7-b65c05cc317a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:39.912277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:39.912277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:39.912277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:39.912277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:39.912277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:39.912277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:39.912277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:39.912277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:39.912277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:39.912277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:39.912277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:39.912277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:39.912277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:39.912277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:39.913223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:39.913223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:39.913223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:39.913223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:39.913223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:39.913223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:39.913223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:39.913223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:39.913223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:39.913223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:39.913223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:39.913223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:39.913223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:39.913223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:39.913223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:39.913223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:39.913223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:39.914200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:39.914200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:39.914200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:39.914200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:39.914200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:39.914200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:39.914200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:39.914200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:39.915229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 434/851] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:39.921348 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31454675-d8eb-4acf-a6d7-b65c05cc317a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:39.925817 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:40.005114 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8b7a3-5a94-4c1e-88cd-4a7d2be0f9db None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:40.030304 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31454675-d8eb-4acf-a6d7-b65c05cc317a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:40.041994 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722e14b-4582-4e91-ab2f-9e10e0fc2194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:40.042906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722e14b-4582-4e91-ab2f-9e10e0fc2194 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:40.043405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722e14b-4582-4e91-ab2f-9e10e0fc2194 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:40.043897 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722e14b-4582-4e91-ab2f-9e10e0fc2194 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:40.044674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722e14b-4582-4e91-ab2f-9e10e0fc2194 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:40.046906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722e14b-4582-4e91-ab2f-9e10e0fc2194 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:40.056188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-1722e14b-4582-4e91-ab2f-9e10e0fc2194 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 19:00:40.056188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:40.056188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:00:40.056188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:00:40.056188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:00:40.056188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:00:40.056188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:00:40.056188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:40.056188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 19:00:40.056188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:40.056188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:40.056188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:40.056188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:40.056188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:40.056188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:40.056188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:40.057146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:40.057146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:40.057146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:40.057146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:40.057146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:40.057146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:40.057146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:40.057146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:00:40.057146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:00:40.057146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:00:40.057146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:00:40.057146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:40.057146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:40.057146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:40.057146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:40.057146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:40.057146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:40.058402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:40.058402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:40.058402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:40.058402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:40.058402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:40.058402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:40.058402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:40.058402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:40.058402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:40.058402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:40.058402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:00:40.058402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:40.058402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 19:00:40.058402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:40.065826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 418/852] 10.222.0.65 () {56 vars in 1132 bytes} [Tue Aug 9 19:00:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:40.066744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d4f20-d5f7-493a-b006-2251b76df8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:40.067362 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d4f20-d5f7-493a-b006-2251b76df8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:40.067646 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d4f20-d5f7-493a-b006-2251b76df8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:40.067924 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d4f20-d5f7-493a-b006-2251b76df8e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:40.068153 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722e14b-4582-4e91-ab2f-9e10e0fc2194 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:40.068619 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d4f20-d5f7-493a-b006-2251b76df8e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:40.069014 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d4f20-d5f7-493a-b006-2251b76df8e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:40.070489 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d4f20-d5f7-493a-b006-2251b76df8e0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:40.089032 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 435/853] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:40.089936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d4f20-d5f7-493a-b006-2251b76df8e0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:40.138119 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:40.161912 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:40.187152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722e14b-4582-4e91-ab2f-9e10e0fc2194 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:40.196973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d4f20-d5f7-493a-b006-2251b76df8e0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:40.234320 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5b470-fe71-46f8-832f-0b15e9fef9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:40.235919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5b470-fe71-46f8-832f-0b15e9fef9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:40.236373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5b470-fe71-46f8-832f-0b15e9fef9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:40.236814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5b470-fe71-46f8-832f-0b15e9fef9e6 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:40.237672 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5b470-fe71-46f8-832f-0b15e9fef9e6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:40.238142 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5b470-fe71-46f8-832f-0b15e9fef9e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:40.239678 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5b470-fe71-46f8-832f-0b15e9fef9e6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:40.239786 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13662ad3-ef69-4f6b-8d5a-0486d1ab4552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:40.240398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13662ad3-ef69-4f6b-8d5a-0486d1ab4552 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:40.240683 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13662ad3-ef69-4f6b-8d5a-0486d1ab4552 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:40.240956 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13662ad3-ef69-4f6b-8d5a-0486d1ab4552 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:40.241728 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13662ad3-ef69-4f6b-8d5a-0486d1ab4552 None admin] RBAC: Adding query filter params (role.id=973d37db3ba74af0b63e3570ab311e21, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=5c29eab582a64a8991b171766d321e39) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:40.242038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13662ad3-ef69-4f6b-8d5a-0486d1ab4552 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:40.243468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13662ad3-ef69-4f6b-8d5a-0486d1ab4552 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:40.251695 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 419/854] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Aug 9 19:00:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:40.252838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5b470-fe71-46f8-832f-0b15e9fef9e6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:40.261648 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 436/855] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:00:40 2022] GET /identity/v3/role_assignments?user.id=5c29eab582a64a8991b171766d321e39&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=973d37db3ba74af0b63e3570ab311e21 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:40.375536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5b470-fe71-46f8-832f-0b15e9fef9e6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:40.415621 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd287ac-04e9-4b63-b481-caea474a586c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:40.416629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd287ac-04e9-4b63-b481-caea474a586c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:40.417114 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd287ac-04e9-4b63-b481-caea474a586c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:40.417618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd287ac-04e9-4b63-b481-caea474a586c None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:40.418466 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd287ac-04e9-4b63-b481-caea474a586c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:40.418968 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd287ac-04e9-4b63-b481-caea474a586c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:40.421188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd287ac-04e9-4b63-b481-caea474a586c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:40.426986 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 420/856] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Aug 9 19:00:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:40.580989 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefd437-591d-48e1-bb9a-f8d53967ddb3 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:40.581272 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefd437-591d-48e1-bb9a-f8d53967ddb3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:40.581582 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefd437-591d-48e1-bb9a-f8d53967ddb3 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:40.583158 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 437/857] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:40.588583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83141cba-d35b-4a32-ab80-f3ea20c515f9 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:40.588873 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83141cba-d35b-4a32-ab80-f3ea20c515f9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:40.589144 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83141cba-d35b-4a32-ab80-f3ea20c515f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:40.609888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-83141cba-d35b-4a32-ab80-f3ea20c515f9 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:40.611086 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-83141cba-d35b-4a32-ab80-f3ea20c515f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:40.619130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:40.682715 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 421/858] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:40.706668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefd437-591d-48e1-bb9a-f8d53967ddb3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:40.817008 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefd437-591d-48e1-bb9a-f8d53967ddb3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:40.827968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:40.855996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0277c4f-d811-482e-a819-55ecaf793667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:40.856624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0277c4f-d811-482e-a819-55ecaf793667 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:40.856958 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0277c4f-d811-482e-a819-55ecaf793667 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:40.857763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0277c4f-d811-482e-a819-55ecaf793667 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:40.869482 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0277c4f-d811-482e-a819-55ecaf793667 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:40.875179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-e0277c4f-d811-482e-a819-55ecaf793667 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:00:40.875179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:40.875179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:40.875179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:40.875179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:40.875179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:40.875179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:40.875179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:40.875179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:40.875179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:40.875179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:40.875179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:40.875179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:40.875179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:40.875179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:40.875179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:40.876105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:40.876105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:40.876105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:40.876105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:40.876105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:40.876105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:40.876105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:40.876105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:40.876105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:40.876105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:40.876105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:40.876105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:40.876105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:40.876105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:40.876105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:40.876105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:40.877704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:40.877704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:40.877704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:40.877704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:40.877704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:40.877704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:40.877704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:40.877704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:40.877704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:40.877704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:40.877704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:00:40.877704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:40.877704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 438/859] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:00:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:40.882612 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83141cba-d35b-4a32-ab80-f3ea20c515f9 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:40.989149 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83141cba-d35b-4a32-ab80-f3ea20c515f9 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:41.025602 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425249d3-f517-4ad1-abb3-a30314570dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:41.026270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425249d3-f517-4ad1-abb3-a30314570dfd None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:41.026649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425249d3-f517-4ad1-abb3-a30314570dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:41.031078 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425249d3-f517-4ad1-abb3-a30314570dfd None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:41.031778 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425249d3-f517-4ad1-abb3-a30314570dfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:41.032093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425249d3-f517-4ad1-abb3-a30314570dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:41.033489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425249d3-f517-4ad1-abb3-a30314570dfd None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:41.043174 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 422/860] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:00:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:41.049120 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0277c4f-d811-482e-a819-55ecaf793667 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:41.159122 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0277c4f-d811-482e-a819-55ecaf793667 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:41.195345 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6cbdc-0756-4d19-9693-010cd9eddfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:41.196264 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6cbdc-0756-4d19-9693-010cd9eddfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:41.196723 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6cbdc-0756-4d19-9693-010cd9eddfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:41.197192 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6cbdc-0756-4d19-9693-010cd9eddfd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:41.208493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6cbdc-0756-4d19-9693-010cd9eddfd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:41.210218 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6cbdc-0756-4d19-9693-010cd9eddfd6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:41.225766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-5ca6cbdc-0756-4d19-9693-010cd9eddfd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:41.225766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:41.225766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:41.225766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:41.225766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:41.225766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:41.225766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:41.225766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:41.225766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:41.225766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:41.225766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:41.225766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:41.225766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:41.225766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:41.225766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:41.225766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:41.226739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:41.226739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:41.226739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:41.226739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:41.226739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:41.226739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:41.226739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:41.226739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:41.226739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:41.226739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:41.226739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:41.226739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:41.226739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:41.226739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:41.226739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:41.226739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:41.226739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:41.227613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:41.227613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:41.227613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:41.229416 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 439/861] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:41.238803 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425249d3-f517-4ad1-abb3-a30314570dfd None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:41.250859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:41.291449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc58cf5-1b99-4fa7-98a4-f3b15014797f None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:41.291753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc58cf5-1b99-4fa7-98a4-f3b15014797f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:41.292525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc58cf5-1b99-4fa7-98a4-f3b15014797f None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:41.293676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 440/862] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:41.299220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12ed51-6a75-4af9-9425-238d1d07ed9b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:41.299503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12ed51-6a75-4af9-9425-238d1d07ed9b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:41.299776 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12ed51-6a75-4af9-9425-238d1d07ed9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:41.318872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-dd12ed51-6a75-4af9-9425-238d1d07ed9b None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:41.320478 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-dd12ed51-6a75-4af9-9425-238d1d07ed9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:41.335701 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:41.353433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425249d3-f517-4ad1-abb3-a30314570dfd None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:41.389681 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e293f-1c25-479b-b3cb-7ed1074a930c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:41.390428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e293f-1c25-479b-b3cb-7ed1074a930c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:41.390613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e293f-1c25-479b-b3cb-7ed1074a930c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:41.390879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e293f-1c25-479b-b3cb-7ed1074a930c None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:41.391515 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e293f-1c25-479b-b3cb-7ed1074a930c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:41.391809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e293f-1c25-479b-b3cb-7ed1074a930c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:41.393173 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e293f-1c25-479b-b3cb-7ed1074a930c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:41.406994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 441/864] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:41.413700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 423/864] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:41.415058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12ed51-6a75-4af9-9425-238d1d07ed9b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:41.432906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e293f-1c25-479b-b3cb-7ed1074a930c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:41.517029 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:41.544667 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12ed51-6a75-4af9-9425-238d1d07ed9b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:41.563994 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e293f-1c25-479b-b3cb-7ed1074a930c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:41.588977 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afafc50-d03d-4d0e-9be1-1a1d2d3e8406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:41.590437 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afafc50-d03d-4d0e-9be1-1a1d2d3e8406 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:41.590918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afafc50-d03d-4d0e-9be1-1a1d2d3e8406 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:41.591678 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afafc50-d03d-4d0e-9be1-1a1d2d3e8406 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:41.602561 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afafc50-d03d-4d0e-9be1-1a1d2d3e8406 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:41.604971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afafc50-d03d-4d0e-9be1-1a1d2d3e8406 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:41.606908 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac585486-8e3c-44ed-82a4-c6ff34929758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:41.607676 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac585486-8e3c-44ed-82a4-c6ff34929758 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:41.608047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac585486-8e3c-44ed-82a4-c6ff34929758 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:41.608402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac585486-8e3c-44ed-82a4-c6ff34929758 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:41.609304 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac585486-8e3c-44ed-82a4-c6ff34929758 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:41.611413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac585486-8e3c-44ed-82a4-c6ff34929758 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:41.624081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-4afafc50-d03d-4d0e-9be1-1a1d2d3e8406 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 19:00:41.624081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:41.624081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:41.624081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:41.624081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:41.624081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:41.624081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:41.624081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:41.624081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:41.624081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:41.624081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:41.624081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:41.624081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:41.624081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:41.624081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:41.624081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:41.630411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:41.630411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:41.630411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:41.630411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:41.630411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:41.630411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:41.630411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:41.630411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:41.630411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:41.630411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:41.630411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:41.630411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:41.630411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:41.630411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:41.630411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:41.630411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:41.630411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:41.630411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:41.631628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:41.631628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:41.631628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:41.631628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:41.631628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:41.631628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:41.631628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:41.631628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:41.631628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 19:00:41.631628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:41.631628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 442/865] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:00:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:41.633944 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afafc50-d03d-4d0e-9be1-1a1d2d3e8406 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:41.647950 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:41.686425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 424/866] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Aug 9 19:00:41 2022] POST /identity/v3/services => generated 251 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:00:41.756925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afafc50-d03d-4d0e-9be1-1a1d2d3e8406 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:41.803856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af65694-8ab4-4a23-bb49-a1783d6ea501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:41.804888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af65694-8ab4-4a23-bb49-a1783d6ea501 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:41.805446 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af65694-8ab4-4a23-bb49-a1783d6ea501 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:41.805952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af65694-8ab4-4a23-bb49-a1783d6ea501 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:41.807049 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af65694-8ab4-4a23-bb49-a1783d6ea501 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:41.807565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af65694-8ab4-4a23-bb49-a1783d6ea501 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:41.809281 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af65694-8ab4-4a23-bb49-a1783d6ea501 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:41.830606 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 443/867] 10.222.0.65 () {56 vars in 1135 bytes} [Tue Aug 9 19:00:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:41.836653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac585486-8e3c-44ed-82a4-c6ff34929758 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:41.949940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac585486-8e3c-44ed-82a4-c6ff34929758 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:41.974580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:41.985701 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca58a7b-a9de-421f-ae98-4613270c262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:41.986640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca58a7b-a9de-421f-ae98-4613270c262b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:41.987127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca58a7b-a9de-421f-ae98-4613270c262b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:41.987601 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca58a7b-a9de-421f-ae98-4613270c262b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:42.067019 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca58a7b-a9de-421f-ae98-4613270c262b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:42.068485 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca58a7b-a9de-421f-ae98-4613270c262b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:42.173000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 425/868] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:00:41 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 19:00:42.178575 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af65694-8ab4-4a23-bb49-a1783d6ea501 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:42.247372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:42.286704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af65694-8ab4-4a23-bb49-a1783d6ea501 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:42.323427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba687b8c-b5aa-4e0e-8aba-b7f42510883e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:42.324057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba687b8c-b5aa-4e0e-8aba-b7f42510883e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:42.324332 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba687b8c-b5aa-4e0e-8aba-b7f42510883e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:42.324601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba687b8c-b5aa-4e0e-8aba-b7f42510883e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:42.335290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba687b8c-b5aa-4e0e-8aba-b7f42510883e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:42.336733 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba687b8c-b5aa-4e0e-8aba-b7f42510883e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:42.351496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ba687b8c-b5aa-4e0e-8aba-b7f42510883e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:42.351496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:42.351496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:42.351496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:42.351496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:42.351496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:42.351496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:42.351496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:42.351496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:42.351496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:42.351496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:42.351496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:42.351496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:42.351496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:42.351496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:42.351496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:42.352491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:42.352491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:42.352491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:42.352491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:42.352491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:42.352491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:42.352491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:42.352491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:42.352491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:42.352491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:42.352491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:42.352491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:42.352491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:42.352491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:42.352491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:42.352491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:42.352491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:42.353412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:42.353412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:42.353412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:42.357771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 444/869] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:42.359111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca58a7b-a9de-421f-ae98-4613270c262b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:42.384708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:42.461173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a839b-6ef7-4f7b-a0a3-47ba8505c46a None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:42.461528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a839b-6ef7-4f7b-a0a3-47ba8505c46a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:42.461754 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a839b-6ef7-4f7b-a0a3-47ba8505c46a None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:42.463332 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 445/870] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:42.468712 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca58a7b-a9de-421f-ae98-4613270c262b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:42.469184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4319179-1c44-44dc-9d43-b505502953ee None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:42.469370 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4319179-1c44-44dc-9d43-b505502953ee None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:42.469604 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4319179-1c44-44dc-9d43-b505502953ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:42.489080 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b4319179-1c44-44dc-9d43-b505502953ee None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:42.490902 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b4319179-1c44-44dc-9d43-b505502953ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:42.507136 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8cb4d-8f90-4235-b7d8-186cc2bf5a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:42.507755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8cb4d-8f90-4235-b7d8-186cc2bf5a4d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:42.508035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8cb4d-8f90-4235-b7d8-186cc2bf5a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:42.508301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8cb4d-8f90-4235-b7d8-186cc2bf5a4d None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:42.508942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8cb4d-8f90-4235-b7d8-186cc2bf5a4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:42.509241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8cb4d-8f90-4235-b7d8-186cc2bf5a4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:42.512517 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8cb4d-8f90-4235-b7d8-186cc2bf5a4d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:42.523443 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 426/871] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:42.528707 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8cb4d-8f90-4235-b7d8-186cc2bf5a4d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:42.595802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 446/872] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:42 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 19:00:42.619595 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4319179-1c44-44dc-9d43-b505502953ee None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:42.629541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:42.649679 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8cb4d-8f90-4235-b7d8-186cc2bf5a4d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:42.674649 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:42.690031 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818eea3-fd08-44e1-ba49-a5958ed10607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:42.691082 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818eea3-fd08-44e1-ba49-a5958ed10607 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:42.691567 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818eea3-fd08-44e1-ba49-a5958ed10607 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:42.692022 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818eea3-fd08-44e1-ba49-a5958ed10607 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:42.699159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818eea3-fd08-44e1-ba49-a5958ed10607 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:42.700603 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818eea3-fd08-44e1-ba49-a5958ed10607 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:42.712943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-5818eea3-fd08-44e1-ba49-a5958ed10607 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:42.712943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:42.712943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:42.712943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:42.712943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:42.712943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:42.712943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:42.712943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:42.712943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:42.712943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:42.712943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:42.712943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:42.712943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:42.712943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:42.712943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:42.713886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:42.713886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:42.713886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:42.713886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:42.713886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:42.713886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:42.713886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:42.713886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:42.713886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:42.713886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:42.713886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:42.713886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:42.713886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:42.713886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:42.713886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:42.713886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:42.713886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:42.715315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:42.715315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:42.715315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:42.715315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:42.715315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:42.715315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:42.715315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:42.715315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:42.715315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 427/873] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:42.715811 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7d08c-4b51-4ccc-ba3b-d73792f807eb None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:42.715886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7d08c-4b51-4ccc-ba3b-d73792f807eb None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:42.716167 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7d08c-4b51-4ccc-ba3b-d73792f807eb None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:42.717853 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 428/874] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:42.719884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7d08c-4b51-4ccc-ba3b-d73792f807eb None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:42.736560 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4319179-1c44-44dc-9d43-b505502953ee None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:42.773622 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4824d0-819b-436b-a10e-ba34d2c4e3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:42.774183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4824d0-819b-436b-a10e-ba34d2c4e3ef None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:42.774495 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4824d0-819b-436b-a10e-ba34d2c4e3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:42.774730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4824d0-819b-436b-a10e-ba34d2c4e3ef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:42.787157 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4824d0-819b-436b-a10e-ba34d2c4e3ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:42.791839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ca4824d0-819b-436b-a10e-ba34d2c4e3ef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 19:00:42.791839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:42.791839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:42.791839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:42.791839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:42.791839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:42.791839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:42.791839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:42.791839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:42.791839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:42.791839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:42.791839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:42.791839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:42.791839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:42.791839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:42.791839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:42.792765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:42.792765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:42.792765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:42.792765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:42.792765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:42.792765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:42.792765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:42.792765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:42.792765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:42.792765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:42.792765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:42.792765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:42.792765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:42.792765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:42.792765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:42.792765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:42.794146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:42.794146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:42.794146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:42.794146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:42.794146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:42.794146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:42.794146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:42.794146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:42.794146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:42.794146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:42.794146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 19:00:42.794146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:42.794146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 447/875] 10.222.0.65 () {56 vars in 1120 bytes} [Tue Aug 9 19:00:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:42.794146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a341a18-3348-4a97-9557-cd4867d0337a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:42.795468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a341a18-3348-4a97-9557-cd4867d0337a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:42.795468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a341a18-3348-4a97-9557-cd4867d0337a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:42.813519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4a341a18-3348-4a97-9557-cd4867d0337a None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:42.814766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4a341a18-3348-4a97-9557-cd4867d0337a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:42.835125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7d08c-4b51-4ccc-ba3b-d73792f807eb None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:42.875897 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa838324-9d45-4e05-80a0-cd3107f6e9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:42.876818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa838324-9d45-4e05-80a0-cd3107f6e9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:42.877305 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa838324-9d45-4e05-80a0-cd3107f6e9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:42.877775 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa838324-9d45-4e05-80a0-cd3107f6e9d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:42.878631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa838324-9d45-4e05-80a0-cd3107f6e9d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:42.879127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa838324-9d45-4e05-80a0-cd3107f6e9d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:42.880557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa838324-9d45-4e05-80a0-cd3107f6e9d1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:42.893532 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 448/876] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:42 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:42.893532 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a341a18-3348-4a97-9557-cd4867d0337a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:42.904680 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 429/877] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:42.910920 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa838324-9d45-4e05-80a0-cd3107f6e9d1 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:42.917438 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:42.931780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:43.006491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a341a18-3348-4a97-9557-cd4867d0337a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:43.024222 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa838324-9d45-4e05-80a0-cd3107f6e9d1 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:43.042432 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cde6a8-7cba-46e2-9a08-2e403222caea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:43.043050 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cde6a8-7cba-46e2-9a08-2e403222caea None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:43.043337 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cde6a8-7cba-46e2-9a08-2e403222caea None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:43.043612 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cde6a8-7cba-46e2-9a08-2e403222caea None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:43.044279 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cde6a8-7cba-46e2-9a08-2e403222caea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:43.044673 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cde6a8-7cba-46e2-9a08-2e403222caea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:43.046141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cde6a8-7cba-46e2-9a08-2e403222caea None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:43.054653 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 449/878] 10.222.0.65 () {56 vars in 1115 bytes} [Tue Aug 9 19:00:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:43.055428 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cde6a8-7cba-46e2-9a08-2e403222caea None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:43.067002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd803c-bbbc-4d99-85d5-27d77a7eae10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:43.067838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd803c-bbbc-4d99-85d5-27d77a7eae10 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:43.068295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd803c-bbbc-4d99-85d5-27d77a7eae10 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:43.068750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd803c-bbbc-4d99-85d5-27d77a7eae10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:43.069746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd803c-bbbc-4d99-85d5-27d77a7eae10 None admin] RBAC: Adding query filter params (role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=aac48cd591b44f2999d2f172262019da) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:43.070236 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd803c-bbbc-4d99-85d5-27d77a7eae10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:43.071958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd803c-bbbc-4d99-85d5-27d77a7eae10 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:43.079021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 430/879] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:00:42 2022] GET /identity/v3/role_assignments?user.id=aac48cd591b44f2999d2f172262019da&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:43.079973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd803c-bbbc-4d99-85d5-27d77a7eae10 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:43.168642 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:43.194889 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:43.205809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cde6a8-7cba-46e2-9a08-2e403222caea None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:43.221497 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd803c-bbbc-4d99-85d5-27d77a7eae10 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:43.248511 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a391a9f-54ec-4a16-b4da-7fc85287e1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:43.249335 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a391a9f-54ec-4a16-b4da-7fc85287e1d9 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:43.249849 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a391a9f-54ec-4a16-b4da-7fc85287e1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:43.250320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a391a9f-54ec-4a16-b4da-7fc85287e1d9 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:43.253109 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a391a9f-54ec-4a16-b4da-7fc85287e1d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:43.256308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a391a9f-54ec-4a16-b4da-7fc85287e1d9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:43.269752 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6843b5-be62-404e-9444-4f2419cdd61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:43.270483 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6843b5-be62-404e-9444-4f2419cdd61d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:43.271148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6843b5-be62-404e-9444-4f2419cdd61d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:43.271148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6843b5-be62-404e-9444-4f2419cdd61d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:43.284071 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6843b5-be62-404e-9444-4f2419cdd61d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:43.285546 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6843b5-be62-404e-9444-4f2419cdd61d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:43.301361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-aa6843b5-be62-404e-9444-4f2419cdd61d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:43.301361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:43.301361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:43.301361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:43.301361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:43.301361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:43.301361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:43.301361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:43.301361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:43.301361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:43.301361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:43.301361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:43.301361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:43.301361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:43.301361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:43.301361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:43.302401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:43.302401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:43.302401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:43.302401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:43.302401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:43.302401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:43.302401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:43.302401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:43.302401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:43.302401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:43.302401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:43.302401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:43.302401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:43.302401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:43.302401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:43.302401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:43.302401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:43.303285 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:43.303285 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:43.303285 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:43.303285 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 431/880] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:43.308340 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6843b5-be62-404e-9444-4f2419cdd61d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:43.356844 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 450/881] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Aug 9 19:00:43 2022] POST /identity/v3/services => generated 269 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:00:43.431595 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6843b5-be62-404e-9444-4f2419cdd61d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:43.457922 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:43.481606 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eceb6c-e56f-42e6-a967-d45302e4c840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:43.482436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eceb6c-e56f-42e6-a967-d45302e4c840 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:43.482656 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eceb6c-e56f-42e6-a967-d45302e4c840 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:43.482893 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eceb6c-e56f-42e6-a967-d45302e4c840 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:43.483751 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eceb6c-e56f-42e6-a967-d45302e4c840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:43.484053 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eceb6c-e56f-42e6-a967-d45302e4c840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:43.485552 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eceb6c-e56f-42e6-a967-d45302e4c840 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:43.502384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 432/882] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:43.509420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a391a9f-54ec-4a16-b4da-7fc85287e1d9 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:43.630567 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a391a9f-54ec-4a16-b4da-7fc85287e1d9 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:43.668261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064055c-7b11-423f-93ec-6c1097b465ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:43.669326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064055c-7b11-423f-93ec-6c1097b465ea None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:43.669860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064055c-7b11-423f-93ec-6c1097b465ea None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:43.670378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064055c-7b11-423f-93ec-6c1097b465ea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:43.679437 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064055c-7b11-423f-93ec-6c1097b465ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:43.682514 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064055c-7b11-423f-93ec-6c1097b465ea None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:43.700449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9064055c-7b11-423f-93ec-6c1097b465ea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 19:00:43.700449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:43.700449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:43.700449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:43.700449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:43.700449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:43.700449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:43.700449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:43.700449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:43.700449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:43.700449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:43.700449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:43.700449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:43.700449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:43.700449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:43.700449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:43.702311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:43.702311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:43.702311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:43.702311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:43.702311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:43.702311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:43.702311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:43.702311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:43.702311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:43.702311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:43.702311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:43.702311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:43.702311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:43.702311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:43.702311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:43.702311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:43.702311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:43.702311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:43.703292 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:43.703292 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:43.703292 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:43.703292 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:43.703292 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:43.703292 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:43.703292 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:43.703292 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:43.703292 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 19:00:43.703292 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:43.705906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 451/883] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Aug 9 19:00:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:43.713518 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eceb6c-e56f-42e6-a967-d45302e4c840 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:43.824980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eceb6c-e56f-42e6-a967-d45302e4c840 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:43.845557 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bcbfd-0b43-4d3f-9300-7ce4e9fe3f2b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:43.845878 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bcbfd-0b43-4d3f-9300-7ce4e9fe3f2b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:43.846104 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bcbfd-0b43-4d3f-9300-7ce4e9fe3f2b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:43.848628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 452/884] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:00:43.852562 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf8aac-6280-4281-bea8-a58fc93b25c9 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:43.852840 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf8aac-6280-4281-bea8-a58fc93b25c9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:43.853102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf8aac-6280-4281-bea8-a58fc93b25c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:43.863900 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745222e-53fd-427f-a6ce-8b26d4c097f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:43.864559 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745222e-53fd-427f-a6ce-8b26d4c097f0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:43.864845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745222e-53fd-427f-a6ce-8b26d4c097f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:43.865115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745222e-53fd-427f-a6ce-8b26d4c097f0 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:43.865876 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745222e-53fd-427f-a6ce-8b26d4c097f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:43.866623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745222e-53fd-427f-a6ce-8b26d4c097f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:43.868373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745222e-53fd-427f-a6ce-8b26d4c097f0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:43.871525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-58bf8aac-6280-4281-bea8-a58fc93b25c9 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:43.873503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-58bf8aac-6280-4281-bea8-a58fc93b25c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:43.892132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 433/885] 10.222.0.65 () {56 vars in 1149 bytes} [Tue Aug 9 19:00:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:43.896921 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:43.897867 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745222e-53fd-427f-a6ce-8b26d4c097f0 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:43.942071 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:43.953615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 453/886] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:43.973027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf8aac-6280-4281-bea8-a58fc93b25c9 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:44.021610 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745222e-53fd-427f-a6ce-8b26d4c097f0 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:44.066639 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2538a9-888c-4963-8ddc-1f98883a8457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:44.067302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2538a9-888c-4963-8ddc-1f98883a8457 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:44.067588 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2538a9-888c-4963-8ddc-1f98883a8457 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:44.067861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2538a9-888c-4963-8ddc-1f98883a8457 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:44.089256 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf8aac-6280-4281-bea8-a58fc93b25c9 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:44.125990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b8303-7be0-450f-8134-52ffc6354e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:44.126747 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b8303-7be0-450f-8134-52ffc6354e4e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:44.127099 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b8303-7be0-450f-8134-52ffc6354e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:44.127533 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b8303-7be0-450f-8134-52ffc6354e4e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:44.128191 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b8303-7be0-450f-8134-52ffc6354e4e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:44.129740 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b8303-7be0-450f-8134-52ffc6354e4e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:44.140507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-7d9b8303-7be0-450f-8134-52ffc6354e4e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 19:00:44.140507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:44.140507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:00:44.140507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:00:44.140507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:00:44.140507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:00:44.140507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:00:44.140507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:44.140507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 19:00:44.140507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:44.140507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:44.140507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:44.140507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:44.140507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:44.140507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:44.140507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:44.140507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:44.141536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:44.141536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:44.141536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:44.141536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:44.141536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:44.141536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:44.141536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:00:44.141536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:00:44.141536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:00:44.141536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:00:44.141536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:44.141536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:44.141536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:44.141536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:44.141536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:44.141536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:44.142615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:44.142615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:44.142615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:44.142615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:44.142615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:44.142615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:44.142615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:44.142615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:44.142615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:44.142615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:44.142615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:00:44.142615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:44.142615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 19:00:44.142615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:44.142615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 454/887] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 19:00:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:44.143591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2538a9-888c-4963-8ddc-1f98883a8457 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:44.144249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2538a9-888c-4963-8ddc-1f98883a8457 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:44.152262 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b8303-7be0-450f-8134-52ffc6354e4e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:44.165636 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:44.183496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:44.254390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b8303-7be0-450f-8134-52ffc6354e4e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:44.257387 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 434/888] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:00:43 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:00:44.263498 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2538a9-888c-4963-8ddc-1f98883a8457 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:44.292707 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c1b2c-44d1-4b4e-a673-773bcefd4207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:44.293500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c1b2c-44d1-4b4e-a673-773bcefd4207 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:44.293792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c1b2c-44d1-4b4e-a673-773bcefd4207 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:44.294066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c1b2c-44d1-4b4e-a673-773bcefd4207 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:44.295320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c1b2c-44d1-4b4e-a673-773bcefd4207 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:44.295737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c1b2c-44d1-4b4e-a673-773bcefd4207 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:44.297277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c1b2c-44d1-4b4e-a673-773bcefd4207 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:44.307652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 455/889] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 19:00:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:44.309224 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c1b2c-44d1-4b4e-a673-773bcefd4207 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:44.388151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2538a9-888c-4963-8ddc-1f98883a8457 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:44.395130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:44.417644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c1b2c-44d1-4b4e-a673-773bcefd4207 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:44.428371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69d534-daf5-4965-9e72-b6775c427931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:44.429290 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69d534-daf5-4965-9e72-b6775c427931 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:44.429770 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69d534-daf5-4965-9e72-b6775c427931 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:44.430185 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69d534-daf5-4965-9e72-b6775c427931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:44.432292 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:44.442062 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69d534-daf5-4965-9e72-b6775c427931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:44.444074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69d534-daf5-4965-9e72-b6775c427931 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:44.453104 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73b0d8-f2c5-4b5a-88a5-44f8931a9c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:44.453845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73b0d8-f2c5-4b5a-88a5-44f8931a9c09 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:44.454123 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73b0d8-f2c5-4b5a-88a5-44f8931a9c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:44.454395 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73b0d8-f2c5-4b5a-88a5-44f8931a9c09 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:44.455229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73b0d8-f2c5-4b5a-88a5-44f8931a9c09 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:44.455347 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73b0d8-f2c5-4b5a-88a5-44f8931a9c09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:44.456644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73b0d8-f2c5-4b5a-88a5-44f8931a9c09 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:44.462013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-3c69d534-daf5-4965-9e72-b6775c427931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:44.462013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:44.462013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:44.462013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:44.462013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:44.462013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:44.462013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:44.462013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:44.462013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:44.462013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:44.462013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:44.462013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:44.462013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:44.462013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:44.462013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:44.462013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:44.463152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:44.463152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:44.463152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:44.463152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:44.463152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:44.463152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:44.463152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:44.463152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:44.463152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:44.463152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:44.463152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:44.463152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:44.463152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:44.463152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:44.463152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:44.463152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:44.463152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:44.464240 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:44.464240 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:44.464240 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:44.466520 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 456/891] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 19:00:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:44.467021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 435/891] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:44.471131 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73b0d8-f2c5-4b5a-88a5-44f8931a9c09 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:44.471267 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69d534-daf5-4965-9e72-b6775c427931 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:44.592131 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69d534-daf5-4965-9e72-b6775c427931 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:44.618074 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73b0d8-f2c5-4b5a-88a5-44f8931a9c09 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:44.647021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f97516-0c6a-44d2-8726-05dfce9baa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:44.648266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f97516-0c6a-44d2-8726-05dfce9baa0a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:44.649119 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f97516-0c6a-44d2-8726-05dfce9baa0a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:44.649897 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f97516-0c6a-44d2-8726-05dfce9baa0a None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:44.651017 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f97516-0c6a-44d2-8726-05dfce9baa0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:44.651955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f97516-0c6a-44d2-8726-05dfce9baa0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:44.654084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f97516-0c6a-44d2-8726-05dfce9baa0a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:44.657094 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba1e46-e5a2-469c-83d4-191dfe79c86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:44.658009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba1e46-e5a2-469c-83d4-191dfe79c86a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:44.658009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba1e46-e5a2-469c-83d4-191dfe79c86a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:44.658295 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba1e46-e5a2-469c-83d4-191dfe79c86a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:44.658999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba1e46-e5a2-469c-83d4-191dfe79c86a None admin] RBAC: Adding query filter params (interface=public, service_id=490c5360d4b64c99b7f7e43b3c0f5dec, region_id=RegionOne) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:44.659309 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba1e46-e5a2-469c-83d4-191dfe79c86a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:44.660791 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba1e46-e5a2-469c-83d4-191dfe79c86a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:44.674280 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 457/892] 10.222.0.65 () {56 vars in 1251 bytes} [Tue Aug 9 19:00:44 2022] GET /identity/v3/endpoints?service_id=490c5360d4b64c99b7f7e43b3c0f5dec&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:44.675731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba1e46-e5a2-469c-83d4-191dfe79c86a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:44.678924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 436/893] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:44.680047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:44.687109 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f97516-0c6a-44d2-8726-05dfce9baa0a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:44.749306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:44.784923 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba1e46-e5a2-469c-83d4-191dfe79c86a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:44.817929 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f97516-0c6a-44d2-8726-05dfce9baa0a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:44.831811 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f0eeb-bcc7-48e8-b10c-d67c514cde83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:44.833134 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f0eeb-bcc7-48e8-b10c-d67c514cde83 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:44.833883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f0eeb-bcc7-48e8-b10c-d67c514cde83 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:44.834343 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f0eeb-bcc7-48e8-b10c-d67c514cde83 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:44.835315 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f0eeb-bcc7-48e8-b10c-d67c514cde83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:44.837187 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f0eeb-bcc7-48e8-b10c-d67c514cde83 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:44.853914 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 458/894] 10.222.0.65 () {56 vars in 1087 bytes} [Tue Aug 9 19:00:44 2022] GET /identity/v3/services => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:00:44.862767 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2365a-7454-4971-9ea0-e7bf615255ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:44.863418 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2365a-7454-4971-9ea0-e7bf615255ee None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:44.863697 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2365a-7454-4971-9ea0-e7bf615255ee None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:44.863969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2365a-7454-4971-9ea0-e7bf615255ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:44.872175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2365a-7454-4971-9ea0-e7bf615255ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:44.874020 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2365a-7454-4971-9ea0-e7bf615255ee None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:44.887178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-0ff2365a-7454-4971-9ea0-e7bf615255ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:44.887178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:44.887178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:44.887178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:44.887178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:44.887178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:44.887178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:44.887178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:44.887178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:44.887178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:44.887178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:44.887178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:44.887178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:44.887178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:44.887178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:44.888219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:44.888219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:44.888219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:44.888219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:44.888219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:44.888219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:44.888219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:44.888219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:44.888219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:44.888219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:44.888219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:44.888219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:44.888219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:44.888219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:44.888219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:44.888219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:44.888219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:44.889869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:44.889869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:44.889869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:44.889869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:44.889869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:44.889869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:44.889869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:44.889869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:44.889869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 437/895] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:44.894231 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f0eeb-bcc7-48e8-b10c-d67c514cde83 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:44.968425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:45.005195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f0eeb-bcc7-48e8-b10c-d67c514cde83 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:45.049434 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba1a26-9aea-4b43-b384-429dca379485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:45.050510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba1a26-9aea-4b43-b384-429dca379485 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:45.051000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba1a26-9aea-4b43-b384-429dca379485 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:45.051569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba1a26-9aea-4b43-b384-429dca379485 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:45.052471 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba1a26-9aea-4b43-b384-429dca379485 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:45.052981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba1a26-9aea-4b43-b384-429dca379485 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:45.054641 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba1a26-9aea-4b43-b384-429dca379485 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:45.068540 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 459/896] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:45.074239 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2365a-7454-4971-9ea0-e7bf615255ee None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:45.185759 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2365a-7454-4971-9ea0-e7bf615255ee None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:45.201542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:45.233957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd34094-e34a-4e0f-9b98-e632a513a5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:45.234488 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd34094-e34a-4e0f-9b98-e632a513a5ba None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:45.234809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd34094-e34a-4e0f-9b98-e632a513a5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:45.235086 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd34094-e34a-4e0f-9b98-e632a513a5ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:45.235933 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd34094-e34a-4e0f-9b98-e632a513a5ba None admin] RBAC: Adding query filter params (role.id=8ea36b65594142ceb8ea960aa371c2e3, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=5c29eab582a64a8991b171766d321e39) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:45.236295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd34094-e34a-4e0f-9b98-e632a513a5ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:45.237852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd34094-e34a-4e0f-9b98-e632a513a5ba None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:45.243882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 438/897] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:00:45 2022] GET /identity/v3/role_assignments?user.id=5c29eab582a64a8991b171766d321e39&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=8ea36b65594142ceb8ea960aa371c2e3 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:45.264255 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de08d2-231c-4afd-ae6e-6dda24d2548b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:45.266028 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de08d2-231c-4afd-ae6e-6dda24d2548b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:45.266028 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de08d2-231c-4afd-ae6e-6dda24d2548b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:45.266650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 460/898] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:45.272662 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00804c7e-1bfa-40ce-b7b7-50213d9e103b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:45.272974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00804c7e-1bfa-40ce-b7b7-50213d9e103b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:45.273220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00804c7e-1bfa-40ce-b7b7-50213d9e103b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:45.294538 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-00804c7e-1bfa-40ce-b7b7-50213d9e103b None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:45.295792 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-00804c7e-1bfa-40ce-b7b7-50213d9e103b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:45.376430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 439/899] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:45.398937 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de08d2-231c-4afd-ae6e-6dda24d2548b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:45.512609 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de08d2-231c-4afd-ae6e-6dda24d2548b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:45.541056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:45.553612 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8af03-1357-4ec1-8347-238f8101fcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:45.554655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8af03-1357-4ec1-8347-238f8101fcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:45.555100 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8af03-1357-4ec1-8347-238f8101fcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:45.555515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8af03-1357-4ec1-8347-238f8101fcd7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:45.556268 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8af03-1357-4ec1-8347-238f8101fcd7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:45.557847 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8af03-1357-4ec1-8347-238f8101fcd7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:45.567753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-95a8af03-1357-4ec1-8347-238f8101fcd7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 19:00:45.567753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:45.567753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:00:45.567753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:00:45.567753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:00:45.567753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:00:45.567753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:00:45.567753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:45.567753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 19:00:45.567753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:45.567753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:45.567753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:45.567753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:45.567753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:45.567753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:45.567753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:45.567753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:45.568744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:45.568744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:45.568744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:45.568744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:45.568744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:45.568744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:45.568744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:00:45.568744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:00:45.568744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:00:45.568744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:00:45.568744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:45.568744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:45.568744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:45.568744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:45.568744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:45.568744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:45.569615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:45.569615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:45.569615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:45.569615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:45.569615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:45.569615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:45.569615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:45.569615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:45.569615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:45.569615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:45.569615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:00:45.569615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:45.569615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 19:00:45.569615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:45.569615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 461/900] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Aug 9 19:00:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:45.577663 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00804c7e-1bfa-40ce-b7b7-50213d9e103b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:45.659491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d3dc-597c-4c5c-8785-a3b725a87e8e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:45.659836 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d3dc-597c-4c5c-8785-a3b725a87e8e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:45.660046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d3dc-597c-4c5c-8785-a3b725a87e8e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:45.661667 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 462/901] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:00:45.666556 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ff534-375b-4b14-984a-4a19ae1dc36a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:45.666844 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ff534-375b-4b14-984a-4a19ae1dc36a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:45.667124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ff534-375b-4b14-984a-4a19ae1dc36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:45.681888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:45.684797 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00804c7e-1bfa-40ce-b7b7-50213d9e103b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:45.689880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-023ff534-375b-4b14-984a-4a19ae1dc36a None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:45.696126 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-023ff534-375b-4b14-984a-4a19ae1dc36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:45.733042 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36fd58-4772-4ced-bca8-1c2f29052cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:45.734006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36fd58-4772-4ced-bca8-1c2f29052cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:45.734468 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36fd58-4772-4ced-bca8-1c2f29052cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:45.734915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36fd58-4772-4ced-bca8-1c2f29052cc5 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:45.735744 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36fd58-4772-4ced-bca8-1c2f29052cc5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:45.736228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36fd58-4772-4ced-bca8-1c2f29052cc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:45.737804 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36fd58-4772-4ced-bca8-1c2f29052cc5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:45.743170 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 440/902] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Aug 9 19:00:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:45.749575 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36fd58-4772-4ced-bca8-1c2f29052cc5 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:45.772413 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 463/903] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 19:00:45.800602 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ff534-375b-4b14-984a-4a19ae1dc36a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:45.858491 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36fd58-4772-4ced-bca8-1c2f29052cc5 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:45.896742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9a1ed-cad5-49b0-bae6-7aa8c10358af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:45.897405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9a1ed-cad5-49b0-bae6-7aa8c10358af None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:45.897722 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9a1ed-cad5-49b0-bae6-7aa8c10358af None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:45.898053 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9a1ed-cad5-49b0-bae6-7aa8c10358af None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:45.898857 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9a1ed-cad5-49b0-bae6-7aa8c10358af None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:45.899176 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9a1ed-cad5-49b0-bae6-7aa8c10358af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:45.900674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9a1ed-cad5-49b0-bae6-7aa8c10358af None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:45.909482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 441/904] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Aug 9 19:00:45 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:45.915921 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ff534-375b-4b14-984a-4a19ae1dc36a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:45.949464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:45.962733 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daefa2-d257-438d-a5e9-be5f6628a490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:45.963554 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daefa2-d257-438d-a5e9-be5f6628a490 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:45.963788 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daefa2-d257-438d-a5e9-be5f6628a490 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:45.964032 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daefa2-d257-438d-a5e9-be5f6628a490 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:45.964635 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5daefa2-d257-438d-a5e9-be5f6628a490 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:45.966155 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5daefa2-d257-438d-a5e9-be5f6628a490 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:45.976737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-a5daefa2-d257-438d-a5e9-be5f6628a490 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 19:00:45.976737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:45.976737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:00:45.976737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:00:45.976737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:00:45.976737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:00:45.976737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:00:45.976737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:45.976737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 19:00:45.976737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:45.976737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:45.976737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:45.976737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:45.976737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:45.976737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:45.976737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:45.977827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:45.977827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:45.977827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:45.977827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:45.977827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:45.977827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:45.977827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:45.977827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:00:45.977827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:00:45.977827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:00:45.977827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:00:45.977827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:45.977827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:45.977827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:45.977827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:45.977827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:45.977827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:45.978763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:45.978763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:45.978763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:45.978763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:45.978763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:45.978763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:45.978763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:45.978763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:45.978763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:45.978763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:45.978763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:00:45.978763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:45.978763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 19:00:45.978763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:45.978763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 464/905] 10.222.0.65 () {56 vars in 1132 bytes} [Tue Aug 9 19:00:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:45.984122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9a1ed-cad5-49b0-bae6-7aa8c10358af None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:46.021792 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:46.103544 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9a1ed-cad5-49b0-bae6-7aa8c10358af None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:46.143609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264b1e0-b2e4-48da-abec-cc0e8fb6afa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:46.144668 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264b1e0-b2e4-48da-abec-cc0e8fb6afa7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:46.145156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264b1e0-b2e4-48da-abec-cc0e8fb6afa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:46.145714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264b1e0-b2e4-48da-abec-cc0e8fb6afa7 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:46.146589 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264b1e0-b2e4-48da-abec-cc0e8fb6afa7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:46.147314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264b1e0-b2e4-48da-abec-cc0e8fb6afa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:46.149179 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264b1e0-b2e4-48da-abec-cc0e8fb6afa7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:46.155903 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 442/906] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Aug 9 19:00:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:46.161309 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daefa2-d257-438d-a5e9-be5f6628a490 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:46.269070 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daefa2-d257-438d-a5e9-be5f6628a490 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:46.305834 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48ed65-33ba-40a7-a99e-d54e02041926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:46.306445 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48ed65-33ba-40a7-a99e-d54e02041926 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:46.306726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48ed65-33ba-40a7-a99e-d54e02041926 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:46.307000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48ed65-33ba-40a7-a99e-d54e02041926 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:46.307627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48ed65-33ba-40a7-a99e-d54e02041926 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:46.307931 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48ed65-33ba-40a7-a99e-d54e02041926 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:46.309339 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48ed65-33ba-40a7-a99e-d54e02041926 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:46.314644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 465/907] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Aug 9 19:00:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:46.320128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264b1e0-b2e4-48da-abec-cc0e8fb6afa7 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:46.424205 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:46.433222 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264b1e0-b2e4-48da-abec-cc0e8fb6afa7 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:46.470246 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52b907-8029-452c-b3fe-943517bee5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:46.470910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52b907-8029-452c-b3fe-943517bee5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:46.471194 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52b907-8029-452c-b3fe-943517bee5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:46.471465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52b907-8029-452c-b3fe-943517bee5b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:46.472171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52b907-8029-452c-b3fe-943517bee5b1 None admin] RBAC: Adding query filter params (interface=public, service_id=879421749d7741caa07f185b49c75702, region_id=RegionOne) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:46.472477 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52b907-8029-452c-b3fe-943517bee5b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:46.473946 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52b907-8029-452c-b3fe-943517bee5b1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:46.479783 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 443/908] 10.222.0.65 () {56 vars in 1251 bytes} [Tue Aug 9 19:00:46 2022] GET /identity/v3/endpoints?service_id=879421749d7741caa07f185b49c75702&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:46.485558 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48ed65-33ba-40a7-a99e-d54e02041926 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:46.548717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:46.603076 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48ed65-33ba-40a7-a99e-d54e02041926 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:46.638824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a543d0-ca43-43d7-9d7e-cfe4f61e689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:46.639916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a543d0-ca43-43d7-9d7e-cfe4f61e689b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:46.640506 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a543d0-ca43-43d7-9d7e-cfe4f61e689b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:46.640988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a543d0-ca43-43d7-9d7e-cfe4f61e689b None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:46.641818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a543d0-ca43-43d7-9d7e-cfe4f61e689b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:46.643380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a543d0-ca43-43d7-9d7e-cfe4f61e689b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:46.650077 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 466/909] 10.222.0.65 () {56 vars in 1087 bytes} [Tue Aug 9 19:00:46 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:00:47.074465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d83d3-74be-4440-8d87-bc47958f2502 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:47.075660 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d83d3-74be-4440-8d87-bc47958f2502 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:47.076167 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d83d3-74be-4440-8d87-bc47958f2502 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:47.078352 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 444/910] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:47.084207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c6d19-e552-4288-938f-e7a09f6a04b9 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:47.084754 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c6d19-e552-4288-938f-e7a09f6a04b9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:47.085255 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c6d19-e552-4288-938f-e7a09f6a04b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:47.104774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1f5c6d19-e552-4288-938f-e7a09f6a04b9 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:47.106336 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1f5c6d19-e552-4288-938f-e7a09f6a04b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:47.177555 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 467/911] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:47.201406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d83d3-74be-4440-8d87-bc47958f2502 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:47.309336 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d83d3-74be-4440-8d87-bc47958f2502 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:47.312676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56428c-6acf-4558-b452-f998b98378cd None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:47.313137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56428c-6acf-4558-b452-f998b98378cd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:47.313311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56428c-6acf-4558-b452-f998b98378cd None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:47.314872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 468/912] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:47.320097 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514baf77-4d46-4852-8c8f-3f7cdda76085 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:47.320660 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514baf77-4d46-4852-8c8f-3f7cdda76085 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:47.321130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514baf77-4d46-4852-8c8f-3f7cdda76085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:47.341992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-514baf77-4d46-4852-8c8f-3f7cdda76085 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:47.343133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-514baf77-4d46-4852-8c8f-3f7cdda76085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:47.349582 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a28ff-140a-4665-9b64-1bd2194b2c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:47.350212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a28ff-140a-4665-9b64-1bd2194b2c6f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:47.350490 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a28ff-140a-4665-9b64-1bd2194b2c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:47.350764 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a28ff-140a-4665-9b64-1bd2194b2c6f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:47.351350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a28ff-140a-4665-9b64-1bd2194b2c6f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:47.352723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a28ff-140a-4665-9b64-1bd2194b2c6f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:47.364125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-964a28ff-140a-4665-9b64-1bd2194b2c6f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 19:00:47.364125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:47.364125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:00:47.364125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:00:47.364125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:00:47.364125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:00:47.364125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:00:47.364125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:47.364125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 19:00:47.364125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:47.364125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:47.364125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:47.364125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:47.364125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:47.364125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:47.364125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:47.364125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:47.365146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:47.365146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:47.365146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:47.365146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:47.365146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:47.365146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:47.365146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:00:47.365146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:00:47.365146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:00:47.365146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:00:47.365146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:47.365146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:47.365146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:47.365146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:47.365146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:47.365146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:47.366351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:47.366351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:47.366351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:47.366351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:47.366351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:47.366351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:47.366351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:47.366351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:47.366351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:47.366351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:47.366351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:00:47.366351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:47.366351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 19:00:47.366351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:47.368966 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 445/913] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 19:00:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:47.382462 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a28ff-140a-4665-9b64-1bd2194b2c6f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:47.390355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:47.420385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 469/914] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 19:00:47.420868 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:47.444502 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514baf77-4d46-4852-8c8f-3f7cdda76085 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:47.499448 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a28ff-140a-4665-9b64-1bd2194b2c6f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:47.552400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98f4a7-1d3b-4b0c-887b-2feee03c0691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:47.553801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98f4a7-1d3b-4b0c-887b-2feee03c0691 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:47.554227 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98f4a7-1d3b-4b0c-887b-2feee03c0691 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:47.554929 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98f4a7-1d3b-4b0c-887b-2feee03c0691 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:47.555699 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98f4a7-1d3b-4b0c-887b-2feee03c0691 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:47.556399 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98f4a7-1d3b-4b0c-887b-2feee03c0691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:47.558644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98f4a7-1d3b-4b0c-887b-2feee03c0691 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:47.568266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514baf77-4d46-4852-8c8f-3f7cdda76085 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:47.571708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 446/915] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 19:00:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:47.571967 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98f4a7-1d3b-4b0c-887b-2feee03c0691 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:47.618186 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d61f0-5cdf-4472-a67a-fb1d19332011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:47.619073 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d61f0-5cdf-4472-a67a-fb1d19332011 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:47.619532 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d61f0-5cdf-4472-a67a-fb1d19332011 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:47.620549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d61f0-5cdf-4472-a67a-fb1d19332011 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:47.635421 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d61f0-5cdf-4472-a67a-fb1d19332011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:47.643068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-283d61f0-5cdf-4472-a67a-fb1d19332011 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 19:00:47.643068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:47.643068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:47.643068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:47.643068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:47.643068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:47.643068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:47.643068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:47.643068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:47.643068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:47.643068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:47.643068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:47.643068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:47.643068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:47.643068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:47.643068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:47.644173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:47.644173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:47.644173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:47.644173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:47.644173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:47.644173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:47.644173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:47.644173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:47.644173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:47.644173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:47.644173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:47.644173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:47.644173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:47.644173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:47.644173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:47.644173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:47.645193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:47.645193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:47.645193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:47.645193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:47.645193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:47.645193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:47.645193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:47.645193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:47.645193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:47.645193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:47.645193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 19:00:47.645193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:47.653194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 470/916] 10.222.0.65 () {56 vars in 1120 bytes} [Tue Aug 9 19:00:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:47.655416 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d61f0-5cdf-4472-a67a-fb1d19332011 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:47.674788 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:47.692537 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98f4a7-1d3b-4b0c-887b-2feee03c0691 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:47.702745 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:47.730917 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60b110-85a2-4fcd-9ac8-d6d31c9c48c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:47.731708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60b110-85a2-4fcd-9ac8-d6d31c9c48c4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:47.732361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60b110-85a2-4fcd-9ac8-d6d31c9c48c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:47.732602 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60b110-85a2-4fcd-9ac8-d6d31c9c48c4 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:47.733390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60b110-85a2-4fcd-9ac8-d6d31c9c48c4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:47.733860 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60b110-85a2-4fcd-9ac8-d6d31c9c48c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:47.735329 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60b110-85a2-4fcd-9ac8-d6d31c9c48c4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:47.745468 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 447/917] 10.222.0.65 () {56 vars in 1114 bytes} [Tue Aug 9 19:00:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:47.746502 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60b110-85a2-4fcd-9ac8-d6d31c9c48c4 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:47.787641 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d61f0-5cdf-4472-a67a-fb1d19332011 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:47.832497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba0b44-213b-4520-b08f-4091c58f6372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:47.833353 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba0b44-213b-4520-b08f-4091c58f6372 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:47.833835 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba0b44-213b-4520-b08f-4091c58f6372 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:47.834697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba0b44-213b-4520-b08f-4091c58f6372 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:47.835508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba0b44-213b-4520-b08f-4091c58f6372 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:47.835956 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba0b44-213b-4520-b08f-4091c58f6372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:47.838149 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba0b44-213b-4520-b08f-4091c58f6372 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:47.853753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 471/918] 10.222.0.65 () {56 vars in 1115 bytes} [Tue Aug 9 19:00:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:47.856070 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba0b44-213b-4520-b08f-4091c58f6372 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:47.866620 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60b110-85a2-4fcd-9ac8-d6d31c9c48c4 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:47.906490 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7ee65-9176-44d0-9fbf-9d38c1ac9bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:47.907143 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7ee65-9176-44d0-9fbf-9d38c1ac9bf6 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:47.907488 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7ee65-9176-44d0-9fbf-9d38c1ac9bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:47.907825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7ee65-9176-44d0-9fbf-9d38c1ac9bf6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:47.908487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7ee65-9176-44d0-9fbf-9d38c1ac9bf6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:47.910070 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7ee65-9176-44d0-9fbf-9d38c1ac9bf6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:47.963859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:47.969764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba0b44-213b-4520-b08f-4091c58f6372 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:48.004596 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbe2f7-8676-423a-a4ba-ddea5dc818d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:48.005601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbe2f7-8676-423a-a4ba-ddea5dc818d8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:48.006027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbe2f7-8676-423a-a4ba-ddea5dc818d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:48.006301 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbe2f7-8676-423a-a4ba-ddea5dc818d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:48.006822 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 448/919] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:00:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:00:48.008464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15f70e-8f32-4081-80db-68efc9d64135 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:48.008762 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15f70e-8f32-4081-80db-68efc9d64135 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:48.009034 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15f70e-8f32-4081-80db-68efc9d64135 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:48.011039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 449/920] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:48.018781 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d473a-eeb4-42eb-8e1e-15c4c80f4c63 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:48.019237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d473a-eeb4-42eb-8e1e-15c4c80f4c63 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:48.019467 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbe2f7-8676-423a-a4ba-ddea5dc818d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:48.019693 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d473a-eeb4-42eb-8e1e-15c4c80f4c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:48.021140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbe2f7-8676-423a-a4ba-ddea5dc818d8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:48.030204 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:48.040599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-b7bbe2f7-8676-423a-a4ba-ddea5dc818d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:48.040599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:48.040599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:48.040599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:48.040599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:48.040599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:48.040599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:48.040599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:48.040599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:48.040599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:48.040599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:48.040599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:48.040599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:48.040599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:48.040599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:48.040599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:48.042827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:48.042827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:48.042827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:48.042827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:48.042827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:48.042827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:48.042827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:48.042827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:48.042827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:48.042827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:48.042827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:48.042827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:48.042827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:48.042827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:48.042827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:48.042827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:48.042827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:48.043846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:48.043846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:48.043846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:48.047527 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 472/921] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:48.048906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-6e0d473a-eeb4-42eb-8e1e-15c4c80f4c63 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:48.049117 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbe2f7-8676-423a-a4ba-ddea5dc818d8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:48.050654 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6e0d473a-eeb4-42eb-8e1e-15c4c80f4c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:48.151806 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 450/922] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:48.175107 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d473a-eeb4-42eb-8e1e-15c4c80f4c63 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:48.187271 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbe2f7-8676-423a-a4ba-ddea5dc818d8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:48.239215 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127339c8-dcc1-4c55-bc5f-0fffe9ba7ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:48.239981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127339c8-dcc1-4c55-bc5f-0fffe9ba7ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:48.240277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127339c8-dcc1-4c55-bc5f-0fffe9ba7ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:48.240544 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127339c8-dcc1-4c55-bc5f-0fffe9ba7ff3 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:48.241185 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127339c8-dcc1-4c55-bc5f-0fffe9ba7ff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:48.241521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127339c8-dcc1-4c55-bc5f-0fffe9ba7ff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:48.242895 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127339c8-dcc1-4c55-bc5f-0fffe9ba7ff3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:48.257691 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 473/923] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:48.265521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127339c8-dcc1-4c55-bc5f-0fffe9ba7ff3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:48.276334 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:48.304447 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d473a-eeb4-42eb-8e1e-15c4c80f4c63 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:48.349779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:48.360378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d92c1-fe75-4a55-ad16-b993cb5d36aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:48.361215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d92c1-fe75-4a55-ad16-b993cb5d36aa None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:48.361675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d92c1-fe75-4a55-ad16-b993cb5d36aa None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:48.370803 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d92c1-fe75-4a55-ad16-b993cb5d36aa None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:48.370803 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d92c1-fe75-4a55-ad16-b993cb5d36aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:48.370803 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d92c1-fe75-4a55-ad16-b993cb5d36aa None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:48.391289 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127339c8-dcc1-4c55-bc5f-0fffe9ba7ff3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:48.427110 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00c7df-7e98-4c3a-b13d-a57e70e3b93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:48.427661 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00c7df-7e98-4c3a-b13d-a57e70e3b93a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:48.427940 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00c7df-7e98-4c3a-b13d-a57e70e3b93a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:48.428211 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00c7df-7e98-4c3a-b13d-a57e70e3b93a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:48.435588 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00c7df-7e98-4c3a-b13d-a57e70e3b93a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:48.437011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00c7df-7e98-4c3a-b13d-a57e70e3b93a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:48.448675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9a00c7df-7e98-4c3a-b13d-a57e70e3b93a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 19:00:48.448675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:48.448675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:48.448675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:48.448675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:48.448675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:48.448675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:48.448675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:48.448675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:48.448675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:48.448675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:48.448675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:48.448675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:48.448675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:48.448675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:48.448675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:48.453813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:48.453813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:48.453813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:48.453813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:48.453813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:48.453813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:48.453813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:48.453813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:48.453813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:48.453813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:48.453813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:48.453813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:48.453813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:48.453813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:48.453813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:48.453813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:48.453813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:48.453813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:48.454809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:48.454809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:48.454809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:48.454809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:48.454809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:48.454809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:48.454809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:48.454809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:48.454809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 19:00:48.454809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:48.455359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 474/924] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Aug 9 19:00:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:48.456009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00c7df-7e98-4c3a-b13d-a57e70e3b93a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:48.466920 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 451/925] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Aug 9 19:00:48 2022] POST /identity/v3/services => generated 241 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:00:48.553953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:48.589794 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00c7df-7e98-4c3a-b13d-a57e70e3b93a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:48.637599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de349d7-c4bb-414d-aad8-e5fdf785a604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:48.639521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de349d7-c4bb-414d-aad8-e5fdf785a604 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:48.640021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de349d7-c4bb-414d-aad8-e5fdf785a604 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:48.640500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de349d7-c4bb-414d-aad8-e5fdf785a604 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:48.641524 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de349d7-c4bb-414d-aad8-e5fdf785a604 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:48.642090 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de349d7-c4bb-414d-aad8-e5fdf785a604 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:48.643800 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de349d7-c4bb-414d-aad8-e5fdf785a604 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:48.663754 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 475/926] 10.222.0.65 () {56 vars in 1149 bytes} [Tue Aug 9 19:00:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:48.669797 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d92c1-fe75-4a55-ad16-b993cb5d36aa None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:48.730240 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854ead7-680a-4d3c-9ed0-7b7331fce71b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:48.730535 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854ead7-680a-4d3c-9ed0-7b7331fce71b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:48.730715 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854ead7-680a-4d3c-9ed0-7b7331fce71b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:48.732278 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 476/927] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:00:48.737230 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c8abc-4856-48a6-b351-d6e5b0144731 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:48.737556 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c8abc-4856-48a6-b351-d6e5b0144731 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:48.737845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c8abc-4856-48a6-b351-d6e5b0144731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:48.756699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f00c8abc-4856-48a6-b351-d6e5b0144731 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:48.757930 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f00c8abc-4856-48a6-b351-d6e5b0144731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:48.787677 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d92c1-fe75-4a55-ad16-b993cb5d36aa None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:48.830933 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12ed4d-3dc4-4239-8c6d-1cb252f821ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:48.831432 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 477/928] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 19:00:48.831796 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12ed4d-3dc4-4239-8c6d-1cb252f821ad None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:48.832239 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12ed4d-3dc4-4239-8c6d-1cb252f821ad None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:48.832525 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12ed4d-3dc4-4239-8c6d-1cb252f821ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:48.845406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12ed4d-3dc4-4239-8c6d-1cb252f821ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:48.846996 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12ed4d-3dc4-4239-8c6d-1cb252f821ad None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:48.854166 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c8abc-4856-48a6-b351-d6e5b0144731 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:48.863958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-9a12ed4d-3dc4-4239-8c6d-1cb252f821ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:48.863958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:48.863958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:48.863958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:48.863958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:48.863958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:48.863958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:48.863958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:48.863958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:48.863958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:48.863958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:48.863958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:48.863958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:48.863958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:48.863958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:48.863958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:48.865162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:48.865162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:48.865162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:48.865162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:48.865162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:48.865162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:48.865162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:48.865162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:48.865162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:48.865162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:48.865162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:48.865162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:48.865162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:48.865162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:48.865162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:48.865162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:48.865162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:48.866314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:48.866314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:48.866314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:48.869534 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 452/929] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:48.872613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12ed4d-3dc4-4239-8c6d-1cb252f821ad None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:48.914462 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:48.937809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:48.970561 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c8abc-4856-48a6-b351-d6e5b0144731 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:48.999262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12ed4d-3dc4-4239-8c6d-1cb252f821ad None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:49.014750 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13afb3-4be5-492a-b3dc-4ec44ba64c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:49.016128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13afb3-4be5-492a-b3dc-4ec44ba64c5f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:49.016509 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13afb3-4be5-492a-b3dc-4ec44ba64c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:49.016882 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13afb3-4be5-492a-b3dc-4ec44ba64c5f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:49.017621 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13afb3-4be5-492a-b3dc-4ec44ba64c5f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:49.019480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13afb3-4be5-492a-b3dc-4ec44ba64c5f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:49.030994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-3b13afb3-4be5-492a-b3dc-4ec44ba64c5f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 19:00:49.030994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:49.030994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:00:49.030994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:00:49.030994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:00:49.030994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:00:49.030994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:00:49.030994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:49.030994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 19:00:49.030994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:49.030994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:49.030994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:49.030994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:49.030994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:49.030994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:49.030994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:49.033485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:49.033485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:49.033485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:49.033485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:49.033485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:49.033485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:49.033485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:49.033485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:00:49.033485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:00:49.033485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:00:49.033485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:00:49.033485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:49.033485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:49.033485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:49.033485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:49.033485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:49.033485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:49.034508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:49.034508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:49.034508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:49.034508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:49.034508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:49.034508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:49.034508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:49.034508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:49.034508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:49.034508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:49.034508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:00:49.034508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:49.034508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 19:00:49.034508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:49.038573 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 478/930] 10.222.0.65 () {56 vars in 1132 bytes} [Tue Aug 9 19:00:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:49.039615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13afb3-4be5-492a-b3dc-4ec44ba64c5f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:49.042846 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b6fa5-674a-4e73-9af3-6c60f9ffa95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:49.043746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b6fa5-674a-4e73-9af3-6c60f9ffa95b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:49.044754 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b6fa5-674a-4e73-9af3-6c60f9ffa95b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:49.045228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b6fa5-674a-4e73-9af3-6c60f9ffa95b None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:49.046075 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b6fa5-674a-4e73-9af3-6c60f9ffa95b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:49.046520 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b6fa5-674a-4e73-9af3-6c60f9ffa95b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:49.048045 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b6fa5-674a-4e73-9af3-6c60f9ffa95b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:49.064538 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 453/931] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:49.071298 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b6fa5-674a-4e73-9af3-6c60f9ffa95b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:49.171413 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13afb3-4be5-492a-b3dc-4ec44ba64c5f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:49.189718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b6fa5-674a-4e73-9af3-6c60f9ffa95b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:49.191685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:49.195317 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:49.217508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e19473-0752-4ef4-9a27-02904f981346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:49.218938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e19473-0752-4ef4-9a27-02904f981346 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:49.219423 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e19473-0752-4ef4-9a27-02904f981346 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:49.220167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e19473-0752-4ef4-9a27-02904f981346 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:49.220994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e19473-0752-4ef4-9a27-02904f981346 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:49.221757 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e19473-0752-4ef4-9a27-02904f981346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:49.223920 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e19473-0752-4ef4-9a27-02904f981346 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:49.234984 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776edd1-33e3-4994-9fde-5227b31c946b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:49.234984 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776edd1-33e3-4994-9fde-5227b31c946b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:49.234984 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776edd1-33e3-4994-9fde-5227b31c946b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:49.234984 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776edd1-33e3-4994-9fde-5227b31c946b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:49.235876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 479/932] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Aug 9 19:00:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:49.237182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e19473-0752-4ef4-9a27-02904f981346 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:49.243879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776edd1-33e3-4994-9fde-5227b31c946b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:49.246040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776edd1-33e3-4994-9fde-5227b31c946b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:49.262629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-5776edd1-33e3-4994-9fde-5227b31c946b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:49.262629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:49.262629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:49.262629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:49.262629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:49.262629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:49.262629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:49.262629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:49.262629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:49.262629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:49.262629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:49.262629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:49.262629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:49.262629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:49.262629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:49.264445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:49.264445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:49.264445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:49.264445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:49.264445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:49.264445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:49.264445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:49.264445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:49.264445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:49.264445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:49.264445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:49.264445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:49.264445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:49.264445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:49.264445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:49.264445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:49.264445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:49.265590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:49.265590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:49.265590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:49.265590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:49.265590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:49.265590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:49.265590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:49.265590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:49.271980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 454/933] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:49.273376 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776edd1-33e3-4994-9fde-5227b31c946b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:49.359984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e19473-0752-4ef4-9a27-02904f981346 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:49.396341 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16dbfd-bce6-4c58-85dd-392099a64f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:49.397164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16dbfd-bce6-4c58-85dd-392099a64f93 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:49.397575 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16dbfd-bce6-4c58-85dd-392099a64f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:49.397949 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16dbfd-bce6-4c58-85dd-392099a64f93 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:49.398774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16dbfd-bce6-4c58-85dd-392099a64f93 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:49.399184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16dbfd-bce6-4c58-85dd-392099a64f93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:49.400635 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16dbfd-bce6-4c58-85dd-392099a64f93 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:49.406760 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 480/934] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Aug 9 19:00:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:49.407173 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776edd1-33e3-4994-9fde-5227b31c946b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:49.414321 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16dbfd-bce6-4c58-85dd-392099a64f93 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:49.445229 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c4a51-ca42-4343-b399-d29c152d53f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:49.446066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c4a51-ca42-4343-b399-d29c152d53f0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:49.446534 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c4a51-ca42-4343-b399-d29c152d53f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:49.446876 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c4a51-ca42-4343-b399-d29c152d53f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:49.447626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c4a51-ca42-4343-b399-d29c152d53f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:49.448065 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c4a51-ca42-4343-b399-d29c152d53f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:49.449862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c4a51-ca42-4343-b399-d29c152d53f0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:49.467679 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 455/935] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:49.468973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c4a51-ca42-4343-b399-d29c152d53f0 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:49.474060 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:49.495645 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:49.542331 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16dbfd-bce6-4c58-85dd-392099a64f93 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:49.585211 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f20719-87e7-495e-8e40-8d52569e1d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:49.585866 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20719-87e7-495e-8e40-8d52569e1d65 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:49.586276 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20719-87e7-495e-8e40-8d52569e1d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:49.586571 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20719-87e7-495e-8e40-8d52569e1d65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:49.587224 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f20719-87e7-495e-8e40-8d52569e1d65 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:49.589207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f20719-87e7-495e-8e40-8d52569e1d65 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:49.590706 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c4a51-ca42-4343-b399-d29c152d53f0 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:49.628196 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef3f7d-c605-4d97-89b7-9300309d56fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:49.628858 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef3f7d-c605-4d97-89b7-9300309d56fc None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:49.629143 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef3f7d-c605-4d97-89b7-9300309d56fc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:49.629479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef3f7d-c605-4d97-89b7-9300309d56fc None admin] PATH_INFO: `/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/5c29eab582a64a8991b171766d321e39/roles/8ea36b65594142ceb8ea960aa371c2e3` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:49.631910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef3f7d-c605-4d97-89b7-9300309d56fc None admin] RBAC: Authorizing `identity:create_grant(project_id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user_id=5c29eab582a64a8991b171766d321e39, role_id=8ea36b65594142ceb8ea960aa371c2e3)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:49.633347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef3f7d-c605-4d97-89b7-9300309d56fc None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:49.676366 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 481/936] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:00:49 2022] POST /identity/v3/endpoints => generated 347 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:00:49.705748 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 456/937] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 19:00:49 2022] PUT /identity/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/5c29eab582a64a8991b171766d321e39/roles/8ea36b65594142ceb8ea960aa371c2e3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:00:50.217571 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec0303-828b-480e-96e6-97b23a15eecf None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:50.218116 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec0303-828b-480e-96e6-97b23a15eecf None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:50.218552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec0303-828b-480e-96e6-97b23a15eecf None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:50.220336 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 482/938] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:50.225814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c11440-3a29-4a24-b99d-52acf6c4c1ed None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:50.226696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c11440-3a29-4a24-b99d-52acf6c4c1ed None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:50.227165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c11440-3a29-4a24-b99d-52acf6c4c1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:50.246321 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-64c11440-3a29-4a24-b99d-52acf6c4c1ed None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:50.248061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-64c11440-3a29-4a24-b99d-52acf6c4c1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:50.327563 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 457/939] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:50.351396 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec0303-828b-480e-96e6-97b23a15eecf None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:50.459427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:50.464726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec0303-828b-480e-96e6-97b23a15eecf None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:50.502421 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e4158-63bf-4551-8e4e-8b1517570238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:50.503362 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e4158-63bf-4551-8e4e-8b1517570238 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:50.503856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e4158-63bf-4551-8e4e-8b1517570238 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:50.504329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e4158-63bf-4551-8e4e-8b1517570238 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:50.505176 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e4158-63bf-4551-8e4e-8b1517570238 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:50.507368 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e4158-63bf-4551-8e4e-8b1517570238 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:50.513233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: WARNING keystone.server.flask.common [None req-f33e4158-63bf-4551-8e4e-8b1517570238 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 09 19:00:50.568954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.sql.core [None req-f33e4158-63bf-4551-8e4e-8b1517570238 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 19:00:50.568954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 09 19:00:50.568954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [parameters: {'id': '12d7b10fa91a4e84aa83d2fd6122a89d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 09 19:00:50.568954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80524) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 19:00:50.588250 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-f33e4158-63bf-4551-8e4e-8b1517570238 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 12d7b10fa91a4e84aa83d2fd6122a89d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 12d7b10fa91a4e84aa83d2fd6122a89d. Aug 09 19:00:50.588250 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:50.588250 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 19:00:50.588250 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 19:00:50.588250 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 19:00:50.588250 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 19:00:50.588250 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 19:00:50.588250 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 19:00:50.588250 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 19:00:50.588250 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application conn.query(q) Aug 09 19:00:50.588250 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 19:00:50.588250 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 19:00:50.588250 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 19:00:50.589150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application result.read() Aug 09 19:00:50.589150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 19:00:50.589150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 19:00:50.589150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 19:00:50.589150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 19:00:50.589150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 19:00:50.589150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 19:00:50.589150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 19:00:50.589150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 19:00:50.589150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 19:00:50.589150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:50.589150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 19:00:50.589150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:50.589150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:50.589150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 19:00:50.589150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 19:00:50.589150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 09 19:00:50.589150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 09 19:00:50.590583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 19:00:50.590583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application next(self.gen) Aug 09 19:00:50.590583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 19:00:50.590583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application yield resource Aug 09 19:00:50.590583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 19:00:50.590583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application next(self.gen) Aug 09 19:00:50.590583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 19:00:50.590583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 19:00:50.590583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 19:00:50.590583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 19:00:50.590583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 19:00:50.590583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise self.value Aug 09 19:00:50.590583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 19:00:50.590583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 19:00:50.590583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 19:00:50.590583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application session.commit() Aug 09 19:00:50.590583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 19:00:50.592326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 19:00:50.592326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 19:00:50.592326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 19:00:50.592326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 19:00:50.592326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.session.flush() Aug 09 19:00:50.592326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 19:00:50.592326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 19:00:50.592326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 19:00:50.592326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 19:00:50.592326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 19:00:50.592326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application compat.raise_( Aug 09 19:00:50.592326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 19:00:50.592326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception Aug 09 19:00:50.592326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 19:00:50.592326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 19:00:50.592326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 19:00:50.592326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 19:00:50.593242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 19:00:50.593242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 19:00:50.593242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 19:00:50.593242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 19:00:50.593242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 09 19:00:50.593242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 09 19:00:50.593242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 19:00:50.593242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 19:00:50.593242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 19:00:50.593242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 19:00:50.593242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 19:00:50.593242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 19:00:50.593242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 19:00:50.593242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 19:00:50.593242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 19:00:50.595167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 19:00:50.595167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 19:00:50.595167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception Aug 09 19:00:50.595167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 19:00:50.595167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 19:00:50.595167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 19:00:50.595167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 19:00:50.595167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 19:00:50.595167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 19:00:50.595167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 19:00:50.595167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application conn.query(q) Aug 09 19:00:50.595167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 19:00:50.595167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 19:00:50.595167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 19:00:50.595167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application result.read() Aug 09 19:00:50.595167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 19:00:50.595167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 19:00:50.601156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 19:00:50.601156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 19:00:50.601156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 19:00:50.601156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 19:00:50.601156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 19:00:50.601156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 19:00:50.601156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 19:00:50.601156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 09 19:00:50.601156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [parameters: {'id': '12d7b10fa91a4e84aa83d2fd6122a89d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 09 19:00:50.601156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 19:00:50.601156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:50.601156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:50.601156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:50.601156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:50.601156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 09 19:00:50.603981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 09 19:00:50.603981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 19:00:50.603981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 19:00:50.603981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 09 19:00:50.603981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:50.603981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:50.603981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:50.603981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:50.603981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:50.603981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:50.603981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:50.603981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:50.603981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:50.603981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:50.603981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:50.603981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:50.603981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:50.606129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:50.606129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 09 19:00:50.606129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 09 19:00:50.606129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:50.606129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:50.606129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 09 19:00:50.606129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 09 19:00:50.606129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 12d7b10fa91a4e84aa83d2fd6122a89d. Aug 09 19:00:50.606129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:50.606129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 483/940] 10.222.0.65 () {60 vars in 1140 bytes} [Tue Aug 9 19:00:50 2022] POST /identity/v3/projects => generated 262 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:50.607461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c11440-3a29-4a24-b99d-52acf6c4c1ed None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:50.610923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:50.615861 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb851a78-aac9-4d2e-b64c-a0f87cf138b8 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:50.616356 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb851a78-aac9-4d2e-b64c-a0f87cf138b8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:50.616869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb851a78-aac9-4d2e-b64c-a0f87cf138b8 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:50.625875 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 484/941] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:50.628180 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e28fbd-b91d-421d-a063-26d588894905 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:50.628488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e28fbd-b91d-421d-a063-26d588894905 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:50.628741 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e28fbd-b91d-421d-a063-26d588894905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:50.657638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c0e28fbd-b91d-421d-a063-26d588894905 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:50.660391 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c0e28fbd-b91d-421d-a063-26d588894905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:50.729397 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c11440-3a29-4a24-b99d-52acf6c4c1ed None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:50.760380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 485/942] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 19:00:50.770977 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656abca0-8f8d-414e-a38a-a909c27632a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:50.771812 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656abca0-8f8d-414e-a38a-a909c27632a5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:50.772295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656abca0-8f8d-414e-a38a-a909c27632a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:50.772708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656abca0-8f8d-414e-a38a-a909c27632a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:50.780174 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656abca0-8f8d-414e-a38a-a909c27632a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:50.781930 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656abca0-8f8d-414e-a38a-a909c27632a5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:50.783264 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e28fbd-b91d-421d-a063-26d588894905 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:50.796728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-656abca0-8f8d-414e-a38a-a909c27632a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:50.796728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:50.796728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:50.796728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:50.796728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:50.796728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:50.796728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:50.796728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:50.796728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:50.796728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:50.796728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:50.796728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:50.796728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:50.796728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:50.796728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:50.797869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:50.797869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:50.797869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:50.797869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:50.797869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:50.797869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:50.797869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:50.797869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:50.797869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:50.797869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:50.797869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:50.797869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:50.797869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:50.797869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:50.797869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:50.797869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:50.797869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:50.798979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:50.798979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:50.798979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:50.798979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:50.798979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:50.798979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:50.798979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:50.798979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:50.806087 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 458/943] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:50.807100 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656abca0-8f8d-414e-a38a-a909c27632a5 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:50.894059 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:50.898497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:50.918134 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e28fbd-b91d-421d-a063-26d588894905 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:50.940549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656abca0-8f8d-414e-a38a-a909c27632a5 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:50.966180 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20193b-fac9-4208-be6b-f330ee8a231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:50.967220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20193b-fac9-4208-be6b-f330ee8a231a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:50.967695 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20193b-fac9-4208-be6b-f330ee8a231a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:50.968281 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20193b-fac9-4208-be6b-f330ee8a231a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:50.969126 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20193b-fac9-4208-be6b-f330ee8a231a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:50.970940 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20193b-fac9-4208-be6b-f330ee8a231a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:50.982189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-7b20193b-fac9-4208-be6b-f330ee8a231a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 19:00:50.982189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:50.982189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:00:50.982189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:00:50.982189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:00:50.982189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:00:50.982189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:00:50.982189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:50.982189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 19:00:50.982189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:50.982189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:50.982189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:50.982189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:50.982189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:50.982189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:50.982189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:50.982189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:50.983519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:50.983519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:50.983519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:50.983519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:50.983519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:50.983519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:50.983519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:00:50.983519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:00:50.983519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:00:50.983519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:00:50.983519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:50.983519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:50.983519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:50.983519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:50.983519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:50.983519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:50.985243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:50.985243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:50.985243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:50.985243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:50.985243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:50.985243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:50.985243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:50.985243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:50.985243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:50.985243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:50.985243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:00:50.985243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:50.985243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 19:00:50.985243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:50.986053 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fd62b-ef68-459c-a21e-d9f4645b3efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:50.986053 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fd62b-ef68-459c-a21e-d9f4645b3efb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:50.986053 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fd62b-ef68-459c-a21e-d9f4645b3efb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:50.986053 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fd62b-ef68-459c-a21e-d9f4645b3efb None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:50.986320 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fd62b-ef68-459c-a21e-d9f4645b3efb None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:50.986320 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fd62b-ef68-459c-a21e-d9f4645b3efb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:50.987707 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fd62b-ef68-459c-a21e-d9f4645b3efb None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:50.994132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 486/944] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Aug 9 19:00:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:50.995667 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20193b-fac9-4208-be6b-f330ee8a231a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:51.009584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 459/945] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Aug 9 19:00:50 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:51.132669 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20193b-fac9-4208-be6b-f330ee8a231a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:51.179586 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24cf98-a364-4a86-86a7-e3fe0b9e68f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:51.180610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24cf98-a364-4a86-86a7-e3fe0b9e68f1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:51.181139 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24cf98-a364-4a86-86a7-e3fe0b9e68f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:51.181649 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24cf98-a364-4a86-86a7-e3fe0b9e68f1 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:51.182503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24cf98-a364-4a86-86a7-e3fe0b9e68f1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:51.183016 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24cf98-a364-4a86-86a7-e3fe0b9e68f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:51.184625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24cf98-a364-4a86-86a7-e3fe0b9e68f1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:51.191780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 487/946] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Aug 9 19:00:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:51.198493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fd62b-ef68-459c-a21e-d9f4645b3efb None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:51.331817 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fd62b-ef68-459c-a21e-d9f4645b3efb None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:51.369916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:51.382475 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b06b2-caa6-42cf-b974-dee6e58322f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:51.383151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b06b2-caa6-42cf-b974-dee6e58322f4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:51.383388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b06b2-caa6-42cf-b974-dee6e58322f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:51.383661 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b06b2-caa6-42cf-b974-dee6e58322f4 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:51.384303 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b06b2-caa6-42cf-b974-dee6e58322f4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:51.384612 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b06b2-caa6-42cf-b974-dee6e58322f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:51.386015 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b06b2-caa6-42cf-b974-dee6e58322f4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:51.391511 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 460/947] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Aug 9 19:00:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:51.397359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24cf98-a364-4a86-86a7-e3fe0b9e68f1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:51.418295 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:51.527681 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24cf98-a364-4a86-86a7-e3fe0b9e68f1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:51.566952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ea6cb-7f31-42a6-ae22-7b4d226ea409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:51.567571 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ea6cb-7f31-42a6-ae22-7b4d226ea409 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:51.568042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ea6cb-7f31-42a6-ae22-7b4d226ea409 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:51.568545 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ea6cb-7f31-42a6-ae22-7b4d226ea409 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:51.569886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ea6cb-7f31-42a6-ae22-7b4d226ea409 None admin] RBAC: Adding query filter params (interface=public, service_id=d72b7d570d51436c839ca555b3cec81b, region_id=RegionOne) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:51.570456 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ea6cb-7f31-42a6-ae22-7b4d226ea409 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:51.573108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ea6cb-7f31-42a6-ae22-7b4d226ea409 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:51.583875 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 488/948] 10.222.0.65 () {56 vars in 1251 bytes} [Tue Aug 9 19:00:51 2022] GET /identity/v3/endpoints?service_id=d72b7d570d51436c839ca555b3cec81b&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:51.592570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b06b2-caa6-42cf-b974-dee6e58322f4 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:51.708319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b06b2-caa6-42cf-b974-dee6e58322f4 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:51.744155 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ac832-57b0-44ce-ba03-9633542b81a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:51.744764 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ac832-57b0-44ce-ba03-9633542b81a0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:51.745046 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ac832-57b0-44ce-ba03-9633542b81a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:51.745369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ac832-57b0-44ce-ba03-9633542b81a0 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:51.746082 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ac832-57b0-44ce-ba03-9633542b81a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:51.748074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ac832-57b0-44ce-ba03-9633542b81a0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:51.754680 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 461/949] 10.222.0.65 () {56 vars in 1087 bytes} [Tue Aug 9 19:00:51 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:00:51.849660 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7e404-719f-47e3-9ee8-26ebdf4d8d9c None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:51.850301 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7e404-719f-47e3-9ee8-26ebdf4d8d9c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:51.850793 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7e404-719f-47e3-9ee8-26ebdf4d8d9c None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:51.852724 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 489/950] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:51.858702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250642a-5bd4-4528-96f9-340e80be8ea6 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:51.859298 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250642a-5bd4-4528-96f9-340e80be8ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:51.859772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250642a-5bd4-4528-96f9-340e80be8ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:51.877141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b59e3-f279-4894-9cbc-43266072f2b4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:51.877837 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b59e3-f279-4894-9cbc-43266072f2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:51.878378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b59e3-f279-4894-9cbc-43266072f2b4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:51.879805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4250642a-5bd4-4528-96f9-340e80be8ea6 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:51.880469 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 490/951] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:00:51.881288 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4250642a-5bd4-4528-96f9-340e80be8ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:51.892804 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d35e6e-9b87-46a2-9360-c5bf71ad7c1a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:51.892804 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d35e6e-9b87-46a2-9360-c5bf71ad7c1a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:51.892804 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d35e6e-9b87-46a2-9360-c5bf71ad7c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:51.915552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-31d35e6e-9b87-46a2-9360-c5bf71ad7c1a None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:51.916756 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-31d35e6e-9b87-46a2-9360-c5bf71ad7c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:51.945241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:51.974465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 462/952] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:51.988482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250642a-5bd4-4528-96f9-340e80be8ea6 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:51.992854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 491/953] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:52.018225 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d35e6e-9b87-46a2-9360-c5bf71ad7c1a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:52.029445 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:52.097436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250642a-5bd4-4528-96f9-340e80be8ea6 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:52.134038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d35e6e-9b87-46a2-9360-c5bf71ad7c1a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:52.136854 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52bfaf-9723-4bf5-a2bc-9c5e5618f9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:52.138240 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52bfaf-9723-4bf5-a2bc-9c5e5618f9fa None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:52.138674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52bfaf-9723-4bf5-a2bc-9c5e5618f9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:52.139120 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52bfaf-9723-4bf5-a2bc-9c5e5618f9fa None admin] PATH_INFO: `/v3/services/compute` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:52.139858 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52bfaf-9723-4bf5-a2bc-9c5e5618f9fa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:52.141388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52bfaf-9723-4bf5-a2bc-9c5e5618f9fa None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:52.151300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-7f52bfaf-9723-4bf5-a2bc-9c5e5618f9fa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 19:00:52.151300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:52.151300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:00:52.151300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:00:52.151300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:00:52.151300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:00:52.151300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:00:52.151300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:52.151300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 19:00:52.151300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:52.151300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:52.151300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:52.151300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:52.151300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:52.151300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:52.151300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:52.151300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:52.152685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:52.152685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:52.152685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:52.152685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:52.152685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:52.152685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:52.152685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:00:52.152685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:00:52.152685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:00:52.152685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:00:52.152685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:52.152685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:52.152685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:52.152685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:52.152685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:52.152685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:52.153947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:52.153947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:52.153947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:52.153947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:52.153947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:52.153947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:52.153947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:52.153947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:52.153947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:52.153947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:52.153947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:00:52.153947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:52.153947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 19:00:52.153947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:52.156506 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 463/954] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:52.163669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52bfaf-9723-4bf5-a2bc-9c5e5618f9fa None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:52.176356 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5edfe-91a8-4b02-8f80-b886abf9c52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:52.177237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5edfe-91a8-4b02-8f80-b886abf9c52c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:52.177359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5edfe-91a8-4b02-8f80-b886abf9c52c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:52.177672 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f5edfe-91a8-4b02-8f80-b886abf9c52c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:52.189304 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f5edfe-91a8-4b02-8f80-b886abf9c52c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:00:52.194381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-61f5edfe-91a8-4b02-8f80-b886abf9c52c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 19:00:52.194381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:52.194381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:52.194381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:52.194381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:52.194381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:52.194381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:52.194381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:52.194381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:52.194381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:52.194381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:52.194381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:52.194381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:00:52.194381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:00:52.194381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:00:52.194381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:00:52.195652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:00:52.195652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:00:52.195652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:00:52.195652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:00:52.195652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:52.195652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:52.195652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:52.195652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:52.195652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:52.195652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:52.195652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:52.195652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:52.195652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:52.195652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:52.195652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:52.195652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:52.196727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:52.196727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:52.196727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:52.196727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:52.196727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:00:52.196727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:00:52.196727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:00:52.196727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:00:52.196727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:00:52.196727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:00:52.196727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 19:00:52.196727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:52.196727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 492/955] 10.222.0.65 () {56 vars in 1120 bytes} [Tue Aug 9 19:00:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:52.202571 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5edfe-91a8-4b02-8f80-b886abf9c52c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:52.237622 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:52.293329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:52.309359 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52bfaf-9723-4bf5-a2bc-9c5e5618f9fa None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:52.345230 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f5edfe-91a8-4b02-8f80-b886abf9c52c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:52.348205 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad6a38-a894-4031-84d8-10386bb0e5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:52.349006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad6a38-a894-4031-84d8-10386bb0e5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:52.349361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad6a38-a894-4031-84d8-10386bb0e5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:52.349818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad6a38-a894-4031-84d8-10386bb0e5d6 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:52.350536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad6a38-a894-4031-84d8-10386bb0e5d6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:52.350908 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad6a38-a894-4031-84d8-10386bb0e5d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:52.352363 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad6a38-a894-4031-84d8-10386bb0e5d6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:52.362320 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 464/956] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Aug 9 19:00:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:52.364130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad6a38-a894-4031-84d8-10386bb0e5d6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:52.401062 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32c883-65fe-45d3-a04c-57f33c488995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:52.402205 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32c883-65fe-45d3-a04c-57f33c488995 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:52.402637 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32c883-65fe-45d3-a04c-57f33c488995 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:52.403973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32c883-65fe-45d3-a04c-57f33c488995 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:52.405068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32c883-65fe-45d3-a04c-57f33c488995 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:52.405651 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32c883-65fe-45d3-a04c-57f33c488995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:52.407438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32c883-65fe-45d3-a04c-57f33c488995 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:52.419755 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 493/957] 10.222.0.65 () {56 vars in 1115 bytes} [Tue Aug 9 19:00:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:52.425218 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32c883-65fe-45d3-a04c-57f33c488995 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:52.492391 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad6a38-a894-4031-84d8-10386bb0e5d6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:52.514809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:52.537188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a1337-a6c5-467d-92d0-5c40594fcd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:52.537841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a1337-a6c5-467d-92d0-5c40594fcd70 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:52.538128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a1337-a6c5-467d-92d0-5c40594fcd70 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:52.538402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a1337-a6c5-467d-92d0-5c40594fcd70 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:52.539039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a1337-a6c5-467d-92d0-5c40594fcd70 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:52.539346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a1337-a6c5-467d-92d0-5c40594fcd70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:52.540824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a1337-a6c5-467d-92d0-5c40594fcd70 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:52.552796 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 465/958] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Aug 9 19:00:52 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:52.579549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32c883-65fe-45d3-a04c-57f33c488995 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:52.614906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:52.621255 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485cec9-302d-4ef8-b4e5-48fc1ca0700e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:52.622060 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485cec9-302d-4ef8-b4e5-48fc1ca0700e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:52.622478 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485cec9-302d-4ef8-b4e5-48fc1ca0700e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:52.622970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485cec9-302d-4ef8-b4e5-48fc1ca0700e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:52.635598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485cec9-302d-4ef8-b4e5-48fc1ca0700e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:52.637090 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485cec9-302d-4ef8-b4e5-48fc1ca0700e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:52.654574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-c485cec9-302d-4ef8-b4e5-48fc1ca0700e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:52.654574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:52.654574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:52.654574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:52.654574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:52.654574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:52.654574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:52.654574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:52.654574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:52.654574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:52.654574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:52.654574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:52.654574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:52.654574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:52.654574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:52.654574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:52.655871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:52.655871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:52.655871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:52.655871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:52.655871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:52.655871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:52.655871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:52.655871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:52.655871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:52.655871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:52.655871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:52.655871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:52.655871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:52.655871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:52.655871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:52.655871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:52.655871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:52.657056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:52.657056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:52.657056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:52.663228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 494/959] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:52.669446 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a1337-a6c5-467d-92d0-5c40594fcd70 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:52.785051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a1337-a6c5-467d-92d0-5c40594fcd70 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:52.820607 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97c02f-9b0a-40c6-af49-cdf7543309be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:52.821540 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97c02f-9b0a-40c6-af49-cdf7543309be None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:52.821983 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97c02f-9b0a-40c6-af49-cdf7543309be None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:52.822413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97c02f-9b0a-40c6-af49-cdf7543309be None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:52.823206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97c02f-9b0a-40c6-af49-cdf7543309be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:52.823665 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97c02f-9b0a-40c6-af49-cdf7543309be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:52.825769 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97c02f-9b0a-40c6-af49-cdf7543309be None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:52.838440 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 466/960] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:52.844392 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485cec9-302d-4ef8-b4e5-48fc1ca0700e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:52.952310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485cec9-302d-4ef8-b4e5-48fc1ca0700e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:52.988052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049e0e9-4972-4cac-825f-575265772ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:52.988709 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049e0e9-4972-4cac-825f-575265772ced None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:52.988992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049e0e9-4972-4cac-825f-575265772ced None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:52.989270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049e0e9-4972-4cac-825f-575265772ced None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:52.999194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049e0e9-4972-4cac-825f-575265772ced None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:53.000679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049e0e9-4972-4cac-825f-575265772ced None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:53.012427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-d049e0e9-4972-4cac-825f-575265772ced None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 19:00:53.012427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:53.012427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:53.012427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:53.012427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:53.012427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:53.012427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:53.012427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:53.012427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:53.012427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:53.012427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:53.012427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:53.012427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:53.012427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:53.012427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:53.012427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:53.013985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:53.013985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:53.013985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:53.013985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:53.013985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:53.013985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:53.013985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:53.013985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:53.013985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:53.013985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:53.013985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:53.013985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:53.013985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:53.013985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:53.013985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:53.013985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:53.013985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:53.013985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:53.014959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:53.014959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:53.014959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:53.014959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:53.014959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:53.014959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:53.014959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:53.014959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:53.014959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 19:00:53.014959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:53.014959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 495/961] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Aug 9 19:00:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:53.021986 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97c02f-9b0a-40c6-af49-cdf7543309be None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:53.067200 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:53.134065 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97c02f-9b0a-40c6-af49-cdf7543309be None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:53.169978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d43cbc-7179-45ed-bc49-110ddf85b3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:53.170589 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d43cbc-7179-45ed-bc49-110ddf85b3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:53.170871 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d43cbc-7179-45ed-bc49-110ddf85b3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:53.171146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d43cbc-7179-45ed-bc49-110ddf85b3d8 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:53.171872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d43cbc-7179-45ed-bc49-110ddf85b3d8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:53.172183 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d43cbc-7179-45ed-bc49-110ddf85b3d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:53.173641 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d43cbc-7179-45ed-bc49-110ddf85b3d8 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:53.192518 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 467/962] 10.222.0.65 () {56 vars in 1149 bytes} [Tue Aug 9 19:00:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:53.198144 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049e0e9-4972-4cac-825f-575265772ced None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:53.244897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:53.308515 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a1cd3-20fd-48ea-8c59-53ff1b8820ee None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:53.308893 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a1cd3-20fd-48ea-8c59-53ff1b8820ee None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:53.309243 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a1cd3-20fd-48ea-8c59-53ff1b8820ee None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:53.311366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 468/963] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:00:53.314471 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049e0e9-4972-4cac-825f-575265772ced None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:53.319244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5e9f5-fcb1-4a2c-8f8d-cc68e923ad42 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:53.319584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5e9f5-fcb1-4a2c-8f8d-cc68e923ad42 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:53.319979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5e9f5-fcb1-4a2c-8f8d-cc68e923ad42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:53.342708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-cbb5e9f5-fcb1-4a2c-8f8d-cc68e923ad42 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:53.344229 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cbb5e9f5-fcb1-4a2c-8f8d-cc68e923ad42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:53.352175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5784113-e28c-4f80-8e61-f7803337e621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:53.353009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5784113-e28c-4f80-8e61-f7803337e621 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:53.353532 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5784113-e28c-4f80-8e61-f7803337e621 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:53.354004 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5784113-e28c-4f80-8e61-f7803337e621 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:53.427687 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5784113-e28c-4f80-8e61-f7803337e621 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:53.429510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5784113-e28c-4f80-8e61-f7803337e621 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:53.433533 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 469/964] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 19:00:53.461801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5e9f5-fcb1-4a2c-8f8d-cc68e923ad42 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:53.488216 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:53.492113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:53.559201 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 496/965] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:00:53 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:00:53.565235 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5784113-e28c-4f80-8e61-f7803337e621 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:53.583447 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5e9f5-fcb1-4a2c-8f8d-cc68e923ad42 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:53.619895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbceda-51df-4566-96c9-5a6ec2295251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:53.620513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbceda-51df-4566-96c9-5a6ec2295251 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:53.620792 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbceda-51df-4566-96c9-5a6ec2295251 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:53.621063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbceda-51df-4566-96c9-5a6ec2295251 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:53.621748 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbceda-51df-4566-96c9-5a6ec2295251 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:53.623394 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbceda-51df-4566-96c9-5a6ec2295251 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:53.626014 dv-cinder-852654-1-smb devstack@keystone.service[80523]: WARNING keystone.server.flask.common [None req-fedbceda-51df-4566-96c9-5a6ec2295251 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 09 19:00:53.670946 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.sql.core [None req-fedbceda-51df-4566-96c9-5a6ec2295251 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 19:00:53.670946 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 09 19:00:53.670946 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [parameters: {'user_id': '2456581173704c5b97ed0ec33f05f870', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 09 19:00:53.670946 dv-cinder-852654-1-smb devstack@keystone.service[80523]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80523) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 19:00:53.679789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-fedbceda-51df-4566-96c9-5a6ec2295251 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 09 19:00:53.679789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:53.679789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 19:00:53.679789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 19:00:53.679789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 19:00:53.679789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 19:00:53.679789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 19:00:53.679789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 19:00:53.679789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 19:00:53.679789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application conn.query(q) Aug 09 19:00:53.679789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 19:00:53.679789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 19:00:53.679789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 19:00:53.679789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application result.read() Aug 09 19:00:53.679789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 19:00:53.680719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 19:00:53.680719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 19:00:53.680719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 19:00:53.680719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 19:00:53.680719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 19:00:53.680719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 19:00:53.680719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 19:00:53.680719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 19:00:53.680719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:53.680719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 19:00:53.680719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:53.680719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:53.680719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 19:00:53.680719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 19:00:53.680719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 09 19:00:53.680719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 09 19:00:53.680719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 19:00:53.680719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application next(self.gen) Aug 09 19:00:53.681730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 19:00:53.681730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application yield resource Aug 09 19:00:53.681730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 19:00:53.681730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application next(self.gen) Aug 09 19:00:53.681730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 19:00:53.681730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 19:00:53.681730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 19:00:53.681730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 19:00:53.681730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 19:00:53.681730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise self.value Aug 09 19:00:53.681730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 19:00:53.681730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 19:00:53.681730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 19:00:53.681730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application session.commit() Aug 09 19:00:53.681730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 19:00:53.681730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 19:00:53.681730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 19:00:53.682632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 19:00:53.682632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 19:00:53.682632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.session.flush() Aug 09 19:00:53.682632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 19:00:53.682632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 19:00:53.682632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 19:00:53.682632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 19:00:53.682632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 19:00:53.682632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application compat.raise_( Aug 09 19:00:53.682632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 19:00:53.682632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception Aug 09 19:00:53.682632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 19:00:53.682632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 19:00:53.682632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 19:00:53.682632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 19:00:53.682632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 19:00:53.682632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 19:00:53.683630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 19:00:53.683630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 19:00:53.683630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 09 19:00:53.683630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 09 19:00:53.683630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 19:00:53.683630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 19:00:53.683630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 19:00:53.683630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 19:00:53.683630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 19:00:53.683630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 19:00:53.683630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 19:00:53.683630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 19:00:53.683630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 19:00:53.683630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 19:00:53.683630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 19:00:53.683630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception Aug 09 19:00:53.684716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 19:00:53.684716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 19:00:53.684716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 19:00:53.684716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 19:00:53.684716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 19:00:53.684716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 19:00:53.684716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 19:00:53.684716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application conn.query(q) Aug 09 19:00:53.684716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 19:00:53.684716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 19:00:53.684716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 19:00:53.684716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application result.read() Aug 09 19:00:53.684716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 19:00:53.684716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 19:00:53.684716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 19:00:53.684716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 19:00:53.686859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 19:00:53.686859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 19:00:53.686859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 19:00:53.686859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 19:00:53.686859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 19:00:53.686859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 09 19:00:53.686859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [parameters: {'user_id': '2456581173704c5b97ed0ec33f05f870', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 09 19:00:53.686859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 19:00:53.686859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:53.686859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:53.686859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:53.686859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:53.686859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:53.686859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:53.686859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:53.688717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:53.688717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:53.688717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:53.688717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:53.688717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:53.688717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:53.688717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:53.688717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 09 19:00:53.688717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 09 19:00:53.688717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:53.688717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:53.688717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:53.688717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:53.688717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:53.688717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:53.688717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 09 19:00:53.688717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 09 19:00:53.690866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 09 19:00:53.690866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 09 19:00:53.690866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 19:00:53.690866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 19:00:53.690866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 09 19:00:53.690866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:53.690866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 470/966] 10.222.0.65 () {60 vars in 1131 bytes} [Tue Aug 9 19:00:53 2022] POST /identity/v3/users => generated 160 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:53.690866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbceda-51df-4566-96c9-5a6ec2295251 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:53.702130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5784113-e28c-4f80-8e61-f7803337e621 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:53.749795 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395ef09-de8d-40ed-8b08-e2af6b5d1b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:53.751004 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395ef09-de8d-40ed-8b08-e2af6b5d1b02 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:53.751296 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395ef09-de8d-40ed-8b08-e2af6b5d1b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:53.751575 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395ef09-de8d-40ed-8b08-e2af6b5d1b02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:53.767040 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395ef09-de8d-40ed-8b08-e2af6b5d1b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:53.769164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395ef09-de8d-40ed-8b08-e2af6b5d1b02 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:53.771510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:53.801501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-a395ef09-de8d-40ed-8b08-e2af6b5d1b02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:53.801501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:53.801501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:53.801501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:53.801501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:53.801501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:53.801501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:53.801501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:53.801501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:53.801501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:53.801501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:53.801501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:53.801501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:00:53.801501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:00:53.801501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:00:53.801501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:00:53.802503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:53.802503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:53.802503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:53.802503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:53.802503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:53.802503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:53.802503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:53.802503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:53.802503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:53.802503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:53.802503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:53.802503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:53.802503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:53.802503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:53.802503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:53.802503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:53.802503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:00:53.803399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:00:53.803399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:00:53.803399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:53.803399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 497/967] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:53.803629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:53.803708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395ef09-de8d-40ed-8b08-e2af6b5d1b02 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:53.814953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbceda-51df-4566-96c9-5a6ec2295251 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:53.852991 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8c913-a2a4-4ed2-95db-f7fd4c5fc287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:53.853581 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8c913-a2a4-4ed2-95db-f7fd4c5fc287 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:53.853872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8c913-a2a4-4ed2-95db-f7fd4c5fc287 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:53.854152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8c913-a2a4-4ed2-95db-f7fd4c5fc287 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:53.863004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8c913-a2a4-4ed2-95db-f7fd4c5fc287 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:53.864674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8c913-a2a4-4ed2-95db-f7fd4c5fc287 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:53.877640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-8ff8c913-a2a4-4ed2-95db-f7fd4c5fc287 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 19:00:53.877640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:53.877640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:53.877640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:53.877640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:53.877640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:53.877640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:53.877640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:53.877640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:53.877640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:53.877640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:53.877640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:53.877640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:00:53.877640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:00:53.877640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:00:53.877640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:00:53.878847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:53.878847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:53.878847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:00:53.878847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:53.878847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:00:53.878847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:00:53.878847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:53.878847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:53.878847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:53.878847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:53.878847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:53.878847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:53.878847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:53.878847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:53.878847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:53.878847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:53.878847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:53.878847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:53.880115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:53.880115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:53.880115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:00:53.880115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:00:53.880115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:00:53.880115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:00:53.880115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:00:53.880115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:00:53.880115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 19:00:53.880115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:53.880115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 471/968] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:00:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:53.885772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8c913-a2a4-4ed2-95db-f7fd4c5fc287 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:53.934377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395ef09-de8d-40ed-8b08-e2af6b5d1b02 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:53.970688 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98e0b4-4664-4bce-a076-c3b5f452b149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:53.971298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98e0b4-4664-4bce-a076-c3b5f452b149 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:53.971588 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98e0b4-4664-4bce-a076-c3b5f452b149 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:53.971866 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98e0b4-4664-4bce-a076-c3b5f452b149 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:53.972506 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98e0b4-4664-4bce-a076-c3b5f452b149 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:53.972814 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98e0b4-4664-4bce-a076-c3b5f452b149 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:53.974354 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98e0b4-4664-4bce-a076-c3b5f452b149 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:53.987538 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 498/969] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:53.993089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f1d33-65e1-412a-a54b-3e9ae56629f4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:53.993387 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f1d33-65e1-412a-a54b-3e9ae56629f4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:53.993699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f1d33-65e1-412a-a54b-3e9ae56629f4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:53.994943 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 499/970] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:53.995641 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f1d33-65e1-412a-a54b-3e9ae56629f4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:54.007929 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8c913-a2a4-4ed2-95db-f7fd4c5fc287 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:54.045353 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53185712-0f75-493c-bf90-da436d0675c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:54.046318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53185712-0f75-493c-bf90-da436d0675c6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:54.046875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53185712-0f75-493c-bf90-da436d0675c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:54.047153 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53185712-0f75-493c-bf90-da436d0675c6 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:54.047864 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53185712-0f75-493c-bf90-da436d0675c6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:54.048160 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53185712-0f75-493c-bf90-da436d0675c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:54.049957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53185712-0f75-493c-bf90-da436d0675c6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:54.054986 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:54.101488 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 472/971] 10.222.0.65 () {56 vars in 1101 bytes} [Tue Aug 9 19:00:53 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:54.101488 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f6ad7-2ef8-4ac4-87c1-012d2b6f909d None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:54.101488 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f6ad7-2ef8-4ac4-87c1-012d2b6f909d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:54.101488 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f6ad7-2ef8-4ac4-87c1-012d2b6f909d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:54.112646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:54.114855 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f1d33-65e1-412a-a54b-3e9ae56629f4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:54.120555 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-415f6ad7-2ef8-4ac4-87c1-012d2b6f909d None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:54.122601 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-415f6ad7-2ef8-4ac4-87c1-012d2b6f909d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:54.157150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc4e52-7168-46c1-9df5-2743affd7b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:54.157973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc4e52-7168-46c1-9df5-2743affd7b3b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:54.158323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc4e52-7168-46c1-9df5-2743affd7b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:54.158676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc4e52-7168-46c1-9df5-2743affd7b3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:54.172946 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc4e52-7168-46c1-9df5-2743affd7b3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:54.174631 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc4e52-7168-46c1-9df5-2743affd7b3b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:54.187810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-19bc4e52-7168-46c1-9df5-2743affd7b3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:54.187810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:54.187810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:54.187810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:54.187810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:54.187810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:54.187810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:54.187810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:54.187810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:54.187810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:54.187810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:54.187810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:54.187810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:00:54.187810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:00:54.187810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:00:54.188880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:00:54.188880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:54.188880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:54.188880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:54.188880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:54.188880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:54.188880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:54.188880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:54.188880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:54.188880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:54.188880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:54.188880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:54.188880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:54.188880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:54.188880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:54.188880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:54.188880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:54.189858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:00:54.189858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:00:54.189858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:00:54.189858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:00:54.189858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:00:54.189858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:00:54.189858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:00:54.189858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:54.194129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 500/972] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:54.195156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc4e52-7168-46c1-9df5-2743affd7b3b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:54.212841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 473/973] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:54.241238 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f6ad7-2ef8-4ac4-87c1-012d2b6f909d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:54.324382 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc4e52-7168-46c1-9df5-2743affd7b3b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:54.339460 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:54.377963 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f6ad7-2ef8-4ac4-87c1-012d2b6f909d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:54.379815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9f5e3-712c-4466-b693-f285b0d19ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:54.382468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9f5e3-712c-4466-b693-f285b0d19ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:54.382468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9f5e3-712c-4466-b693-f285b0d19ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:54.382468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9f5e3-712c-4466-b693-f285b0d19ba0 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:54.382853 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9f5e3-712c-4466-b693-f285b0d19ba0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:54.383164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9f5e3-712c-4466-b693-f285b0d19ba0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:54.384629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9f5e3-712c-4466-b693-f285b0d19ba0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:54.400602 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 501/974] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:00:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:54.407756 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9f5e3-712c-4466-b693-f285b0d19ba0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:54.421594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adde1e-4dfa-4ee3-bd07-94de627a62d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:54.421594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adde1e-4dfa-4ee3-bd07-94de627a62d8 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:54.421594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adde1e-4dfa-4ee3-bd07-94de627a62d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:54.421985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adde1e-4dfa-4ee3-bd07-94de627a62d8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:54.422621 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adde1e-4dfa-4ee3-bd07-94de627a62d8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:54.423999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adde1e-4dfa-4ee3-bd07-94de627a62d8 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:54.428866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:54.437219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-c0adde1e-4dfa-4ee3-bd07-94de627a62d8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 19:00:54.437219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:54.437219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:00:54.437219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:00:54.437219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:00:54.437219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:00:54.437219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:00:54.437219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:54.437219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 19:00:54.437219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:54.437219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:54.437219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:54.437219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:54.437219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:54.437219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:54.437219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:54.437219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:54.438741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:54.438741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:54.438741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:54.438741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:54.438741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:54.438741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:54.438741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:00:54.438741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:00:54.438741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:00:54.438741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:00:54.438741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:54.438741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:54.438741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:54.438741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:54.438741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:54.438741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:54.439605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:54.439605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:54.439605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:54.439605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:54.439605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:54.439605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:54.439605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:54.439605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:54.439605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:54.439605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:54.439605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:00:54.439605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:54.439605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 19:00:54.439605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:54.439605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 474/975] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Aug 9 19:00:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:54.445446 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adde1e-4dfa-4ee3-bd07-94de627a62d8 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:54.536705 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9f5e3-712c-4466-b693-f285b0d19ba0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:54.567273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adde1e-4dfa-4ee3-bd07-94de627a62d8 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:54.573609 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b48e72-79fb-4334-83cd-db626c241720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:54.574351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b48e72-79fb-4334-83cd-db626c241720 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:54.574480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b48e72-79fb-4334-83cd-db626c241720 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:54.574753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b48e72-79fb-4334-83cd-db626c241720 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:54.575550 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b48e72-79fb-4334-83cd-db626c241720 None admin] RBAC: Adding query filter params (role.id=8ea36b65594142ceb8ea960aa371c2e3, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=5c29eab582a64a8991b171766d321e39) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:54.575860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b48e72-79fb-4334-83cd-db626c241720 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:54.577277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b48e72-79fb-4334-83cd-db626c241720 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:54.583246 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 502/976] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:00:54 2022] GET /identity/v3/role_assignments?user.id=5c29eab582a64a8991b171766d321e39&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=8ea36b65594142ceb8ea960aa371c2e3 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:54.609184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc4c55-e0a9-4099-9795-78fe3bf240fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:54.609851 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc4c55-e0a9-4099-9795-78fe3bf240fd None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:54.610131 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc4c55-e0a9-4099-9795-78fe3bf240fd None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:54.610403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc4c55-e0a9-4099-9795-78fe3bf240fd None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:54.611055 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc4c55-e0a9-4099-9795-78fe3bf240fd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:54.611361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc4c55-e0a9-4099-9795-78fe3bf240fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:54.612772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc4c55-e0a9-4099-9795-78fe3bf240fd None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:54.618701 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 475/977] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Aug 9 19:00:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:54.624709 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b48e72-79fb-4334-83cd-db626c241720 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:54.669523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:54.737501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b48e72-79fb-4334-83cd-db626c241720 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:54.772309 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87712a05-7b0c-4028-89f6-d4ba34271fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:54.773245 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87712a05-7b0c-4028-89f6-d4ba34271fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:54.773553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87712a05-7b0c-4028-89f6-d4ba34271fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:54.774049 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87712a05-7b0c-4028-89f6-d4ba34271fe2 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:54.774450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87712a05-7b0c-4028-89f6-d4ba34271fe2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:54.774751 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87712a05-7b0c-4028-89f6-d4ba34271fe2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:54.775493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab18ee-d5a2-4097-bb79-2254691ebea1 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:54.775781 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab18ee-d5a2-4097-bb79-2254691ebea1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:54.776052 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab18ee-d5a2-4097-bb79-2254691ebea1 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:54.776143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87712a05-7b0c-4028-89f6-d4ba34271fe2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:54.777386 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 476/978] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:54.781973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 503/979] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Aug 9 19:00:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:54.783204 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fb1df-1baf-4397-b2d8-004eda368429 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:54.783666 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fb1df-1baf-4397-b2d8-004eda368429 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:54.783946 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7fb1df-1baf-4397-b2d8-004eda368429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:54.787230 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87712a05-7b0c-4028-89f6-d4ba34271fe2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:54.802728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-6b7fb1df-1baf-4397-b2d8-004eda368429 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:54.803953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6b7fb1df-1baf-4397-b2d8-004eda368429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:54.866544 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:54.876185 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 477/980] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 19:00:54.895066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87712a05-7b0c-4028-89f6-d4ba34271fe2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:54.896891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:54.899641 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fb1df-1baf-4397-b2d8-004eda368429 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:54.933421 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf0db9-696f-4632-84aa-04c9bf4171ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:54.933972 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf0db9-696f-4632-84aa-04c9bf4171ff None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:54.934285 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf0db9-696f-4632-84aa-04c9bf4171ff None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:54.935127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf0db9-696f-4632-84aa-04c9bf4171ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:54.935862 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf0db9-696f-4632-84aa-04c9bf4171ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:54.937888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf0db9-696f-4632-84aa-04c9bf4171ff None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:55.003103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7fb1df-1baf-4397-b2d8-004eda368429 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:55.037640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8cb2f-f7a5-45d0-8e68-da039728e8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:55.038317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8cb2f-f7a5-45d0-8e68-da039728e8f9 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:55.038599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8cb2f-f7a5-45d0-8e68-da039728e8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:55.038873 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8cb2f-f7a5-45d0-8e68-da039728e8f9 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:55.039571 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8cb2f-f7a5-45d0-8e68-da039728e8f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:55.041104 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8cb2f-f7a5-45d0-8e68-da039728e8f9 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:55.041545 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 504/981] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:00:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:00:55.115894 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 478/982] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Aug 9 19:00:54 2022] POST /identity/v3/services => generated 242 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:00:56.665710 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de280d1-f840-4ee7-8f4b-f998d5944d37 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:56.666228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de280d1-f840-4ee7-8f4b-f998d5944d37 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:56.666330 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de280d1-f840-4ee7-8f4b-f998d5944d37 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:56.667775 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 505/983] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:56.673350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e49f7-7515-41d5-96eb-845caa00d73b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:56.673798 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e49f7-7515-41d5-96eb-845caa00d73b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:56.673968 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e49f7-7515-41d5-96eb-845caa00d73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:56.692915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-b41e49f7-7515-41d5-96eb-845caa00d73b None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:56.694150 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b41e49f7-7515-41d5-96eb-845caa00d73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:56.745378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:56.773573 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 479/984] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:56.794530 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de280d1-f840-4ee7-8f4b-f998d5944d37 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:56.897775 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de280d1-f840-4ee7-8f4b-f998d5944d37 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:56.930923 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff62dd-3945-4776-b51c-547a2d042717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:56.931552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff62dd-3945-4776-b51c-547a2d042717 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:56.931829 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff62dd-3945-4776-b51c-547a2d042717 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:56.932100 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff62dd-3945-4776-b51c-547a2d042717 None admin] PATH_INFO: `/v3/services/image` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:56.932674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff62dd-3945-4776-b51c-547a2d042717 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:56.934563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff62dd-3945-4776-b51c-547a2d042717 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:56.943156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ceff62dd-3945-4776-b51c-547a2d042717 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 19:00:56.943156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:56.943156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:00:56.943156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:00:56.943156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:00:56.943156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:00:56.943156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:00:56.943156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:56.943156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 19:00:56.943156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:56.943156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:56.943156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:56.943156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:56.943156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:56.943156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:56.943156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:56.943156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:56.944124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:56.944124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:56.944124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:56.944124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:56.944124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:56.944124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:56.944124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:00:56.944124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:00:56.944124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:00:56.944124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:00:56.944124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:56.944124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:56.944124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:56.944124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:56.944124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:56.944124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:56.944969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:56.944969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:56.944969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:56.944969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:56.944969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:56.944969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:56.944969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:56.944969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:56.944969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:56.944969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:56.944969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:00:56.944969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:56.944969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 19:00:56.944969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:56.944969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 506/985] 10.222.0.65 () {56 vars in 1105 bytes} [Tue Aug 9 19:00:56 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:56.952411 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e49f7-7515-41d5-96eb-845caa00d73b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:57.054158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e49f7-7515-41d5-96eb-845caa00d73b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:57.086890 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d45a2-1742-4018-ac61-a7411d5ab92a None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:57.087206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d45a2-1742-4018-ac61-a7411d5ab92a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:57.087450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d45a2-1742-4018-ac61-a7411d5ab92a None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:57.088435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610d3e4-cce2-48dd-a011-398a2001bddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:57.088908 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 507/986] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:00:57.089053 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610d3e4-cce2-48dd-a011-398a2001bddd None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:57.089334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610d3e4-cce2-48dd-a011-398a2001bddd None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:57.089645 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610d3e4-cce2-48dd-a011-398a2001bddd None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:57.090290 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610d3e4-cce2-48dd-a011-398a2001bddd None admin] RBAC: Adding query filter params (name=image) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:57.091143 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610d3e4-cce2-48dd-a011-398a2001bddd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:57.092514 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610d3e4-cce2-48dd-a011-398a2001bddd None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:57.095088 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c0d0a-74a0-4907-a867-9cfce27a9c36 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:57.095374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c0d0a-74a0-4907-a867-9cfce27a9c36 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:57.095648 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c0d0a-74a0-4907-a867-9cfce27a9c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:57.102280 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 480/987] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:57.103131 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610d3e4-cce2-48dd-a011-398a2001bddd None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:57.115012 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-166c0d0a-74a0-4907-a867-9cfce27a9c36 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:57.116194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-166c0d0a-74a0-4907-a867-9cfce27a9c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:57.133409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:57.153716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:57.183338 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 508/988] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 19:00:57.184644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a1c40-f4ce-4d12-8e4b-b9cbe1c1a5d8 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:57.184925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a1c40-f4ce-4d12-8e4b-b9cbe1c1a5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:57.185195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a1c40-f4ce-4d12-8e4b-b9cbe1c1a5d8 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:57.186591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 509/989] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:57.194859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbbd94-a2e4-4472-9f44-8097189da5e4 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:57.195146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbbd94-a2e4-4472-9f44-8097189da5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:57.195425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbbd94-a2e4-4472-9f44-8097189da5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:57.206817 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610d3e4-cce2-48dd-a011-398a2001bddd None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:57.214144 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-42fbbd94-a2e4-4472-9f44-8097189da5e4 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:57.215336 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-42fbbd94-a2e4-4472-9f44-8097189da5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:57.242864 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42229ac1-02d9-4b80-a8f9-23ecf952f5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:57.243476 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42229ac1-02d9-4b80-a8f9-23ecf952f5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:57.243756 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42229ac1-02d9-4b80-a8f9-23ecf952f5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:57.244026 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42229ac1-02d9-4b80-a8f9-23ecf952f5c6 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:57.244651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42229ac1-02d9-4b80-a8f9-23ecf952f5c6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:57.244954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42229ac1-02d9-4b80-a8f9-23ecf952f5c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:57.246354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42229ac1-02d9-4b80-a8f9-23ecf952f5c6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:57.251705 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 481/990] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:00:57 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:57.252844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42229ac1-02d9-4b80-a8f9-23ecf952f5c6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:57.290748 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 510/991] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:57.315936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbbd94-a2e4-4472-9f44-8097189da5e4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:57.377186 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42229ac1-02d9-4b80-a8f9-23ecf952f5c6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:57.389168 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:57.415683 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6795e-d2af-4034-ba2b-300a53f0cbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:57.416327 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6795e-d2af-4034-ba2b-300a53f0cbfa None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:57.416603 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6795e-d2af-4034-ba2b-300a53f0cbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:57.416872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6795e-d2af-4034-ba2b-300a53f0cbfa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:57.416972 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:57.417446 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6795e-d2af-4034-ba2b-300a53f0cbfa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:57.419637 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6795e-d2af-4034-ba2b-300a53f0cbfa None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:57.430640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-e3d6795e-d2af-4034-ba2b-300a53f0cbfa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 19:00:57.430640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:57.430640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:00:57.430640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:00:57.430640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:00:57.430640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:00:57.430640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:00:57.430640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:57.430640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 19:00:57.430640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:57.430640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:57.430640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:57.430640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:57.430640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:57.430640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:57.430640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:57.430640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:57.433002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:57.433002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:57.433002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:57.433002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:57.433002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:57.433002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:57.433002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:00:57.433002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:00:57.433002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:00:57.433002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:00:57.433002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:57.433002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:57.433002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:57.433002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:57.433002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:57.433002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:57.435215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:57.435215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:57.435215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:57.435215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:57.435215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:57.435215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:57.435215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:57.435215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:57.435215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:57.435215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:57.435215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:00:57.435215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:57.435215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 19:00:57.435215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:00:57.435215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 482/992] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Aug 9 19:00:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:00:57.436373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbbd94-a2e4-4472-9f44-8097189da5e4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:57.441729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6795e-d2af-4034-ba2b-300a53f0cbfa None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:57.472947 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e4265-9235-4d74-abf6-8b44b1fd6e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:57.473719 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e4265-9235-4d74-abf6-8b44b1fd6e19 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:57.474004 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e4265-9235-4d74-abf6-8b44b1fd6e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:57.474286 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e4265-9235-4d74-abf6-8b44b1fd6e19 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:57.474877 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e4265-9235-4d74-abf6-8b44b1fd6e19 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:57.476243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e4265-9235-4d74-abf6-8b44b1fd6e19 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:57.485019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-272e4265-9235-4d74-abf6-8b44b1fd6e19 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 19:00:57.485019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:57.485019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:00:57.485019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:00:57.485019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:00:57.485019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:00:57.485019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:00:57.485019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:57.485019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 19:00:57.485019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:57.485019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:00:57.485019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:57.485019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:00:57.485019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:00:57.485019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:00:57.485019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:00:57.485019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:00:57.487845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:00:57.487845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:00:57.487845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:00:57.487845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:00:57.487845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:00:57.487845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:00:57.487845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:00:57.487845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:00:57.487845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:00:57.487845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:00:57.487845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:00:57.487845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:00:57.487845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:00:57.487845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:00:57.487845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:00:57.487845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:00:57.488700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:00:57.488700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:00:57.488700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:00:57.488700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:00:57.488700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:00:57.488700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:00:57.488700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:00:57.488700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:00:57.488700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:00:57.488700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:00:57.488700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:00:57.488700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:00:57.488700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 19:00:57.488700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:00:57.488700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 511/993] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:00:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:00:57.492136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e4265-9235-4d74-abf6-8b44b1fd6e19 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:57.565493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6795e-d2af-4034-ba2b-300a53f0cbfa None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:57.602887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e4265-9235-4d74-abf6-8b44b1fd6e19 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:57.605910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831854d-91d6-4939-8013-8c1b59b04188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:57.606295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831854d-91d6-4939-8013-8c1b59b04188 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:57.606576 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831854d-91d6-4939-8013-8c1b59b04188 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:57.606847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831854d-91d6-4939-8013-8c1b59b04188 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:57.607507 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831854d-91d6-4939-8013-8c1b59b04188 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:57.607825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831854d-91d6-4939-8013-8c1b59b04188 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:57.609195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831854d-91d6-4939-8013-8c1b59b04188 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:57.614324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 483/994] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Aug 9 19:00:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:57.619819 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831854d-91d6-4939-8013-8c1b59b04188 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:57.641855 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca8780-f4a9-4eee-a9e2-6eca3fb7a863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:57.642464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca8780-f4a9-4eee-a9e2-6eca3fb7a863 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:57.642746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca8780-f4a9-4eee-a9e2-6eca3fb7a863 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:57.643017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca8780-f4a9-4eee-a9e2-6eca3fb7a863 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:57.643712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca8780-f4a9-4eee-a9e2-6eca3fb7a863 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:57.644017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca8780-f4a9-4eee-a9e2-6eca3fb7a863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:57.645407 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca8780-f4a9-4eee-a9e2-6eca3fb7a863 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:57.653492 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 512/995] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Aug 9 19:00:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:57.656897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca8780-f4a9-4eee-a9e2-6eca3fb7a863 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:57.662113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:57.669354 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:57.732780 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831854d-91d6-4939-8013-8c1b59b04188 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:57.764066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca8780-f4a9-4eee-a9e2-6eca3fb7a863 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:57.770899 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0698f-4871-4e42-8169-27a9d938d173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:57.771555 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0698f-4871-4e42-8169-27a9d938d173 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:57.771838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0698f-4871-4e42-8169-27a9d938d173 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:57.772113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0698f-4871-4e42-8169-27a9d938d173 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:57.772728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0698f-4871-4e42-8169-27a9d938d173 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:57.773028 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0698f-4871-4e42-8169-27a9d938d173 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:57.774418 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0698f-4871-4e42-8169-27a9d938d173 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:57.784953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 484/996] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Aug 9 19:00:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:00:57.785969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0698f-4871-4e42-8169-27a9d938d173 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:57.806629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b19179-a20f-4a8a-a9c6-8826bab4701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:57.807501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b19179-a20f-4a8a-a9c6-8826bab4701a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:57.808021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b19179-a20f-4a8a-a9c6-8826bab4701a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:57.808483 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b19179-a20f-4a8a-a9c6-8826bab4701a None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:57.809296 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b19179-a20f-4a8a-a9c6-8826bab4701a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:57.809780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b19179-a20f-4a8a-a9c6-8826bab4701a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:57.811289 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b19179-a20f-4a8a-a9c6-8826bab4701a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:57.820860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 513/997] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Aug 9 19:00:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:57.821767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b19179-a20f-4a8a-a9c6-8826bab4701a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:57.888249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:57.891747 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0698f-4871-4e42-8169-27a9d938d173 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:57.907329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:57.928010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f876e5-4422-433f-bb0d-ca54c472e735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:57.928879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f876e5-4422-433f-bb0d-ca54c472e735 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:57.929197 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f876e5-4422-433f-bb0d-ca54c472e735 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:57.929504 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f876e5-4422-433f-bb0d-ca54c472e735 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:57.930214 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f876e5-4422-433f-bb0d-ca54c472e735 None admin] RBAC: Adding query filter params (interface=admin, service_id=d72b7d570d51436c839ca555b3cec81b, region_id=RegionOne) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:57.930592 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f876e5-4422-433f-bb0d-ca54c472e735 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:57.931991 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f876e5-4422-433f-bb0d-ca54c472e735 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:57.932736 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b19179-a20f-4a8a-a9c6-8826bab4701a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:57.938293 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 485/998] 10.222.0.65 () {56 vars in 1249 bytes} [Tue Aug 9 19:00:57 2022] GET /identity/v3/endpoints?service_id=d72b7d570d51436c839ca555b3cec81b&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:57.944123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f876e5-4422-433f-bb0d-ca54c472e735 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:57.969854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62509edd-864a-446c-9c53-e1721625ff13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:57.970466 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62509edd-864a-446c-9c53-e1721625ff13 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:57.970743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62509edd-864a-446c-9c53-e1721625ff13 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:57.971015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62509edd-864a-446c-9c53-e1721625ff13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:57.971721 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62509edd-864a-446c-9c53-e1721625ff13 None admin] RBAC: Adding query filter params (interface=public, service_id=7fa9cc16984c47459843c83766b24146, region_id=RegionOne) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:00:57.972015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62509edd-864a-446c-9c53-e1721625ff13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:57.973384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62509edd-864a-446c-9c53-e1721625ff13 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:57.978684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 514/999] 10.222.0.65 () {56 vars in 1251 bytes} [Tue Aug 9 19:00:57 2022] GET /identity/v3/endpoints?service_id=7fa9cc16984c47459843c83766b24146&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:00:57.984569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62509edd-864a-446c-9c53-e1721625ff13 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:58.062667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f876e5-4422-433f-bb0d-ca54c472e735 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:58.089586 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62509edd-864a-446c-9c53-e1721625ff13 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:58.097309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cdc20b-c0f9-4997-a570-de7a230428b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:58.097940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdc20b-c0f9-4997-a570-de7a230428b4 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:58.098216 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdc20b-c0f9-4997-a570-de7a230428b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:58.098476 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cdc20b-c0f9-4997-a570-de7a230428b4 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:58.099070 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cdc20b-c0f9-4997-a570-de7a230428b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:58.100429 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cdc20b-c0f9-4997-a570-de7a230428b4 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:58.107580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 486/1000] 10.222.0.65 () {56 vars in 1087 bytes} [Tue Aug 9 19:00:57 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:00:58.126620 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8d5aa-1a32-477b-89d5-942e3437fdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:58.127261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8d5aa-1a32-477b-89d5-942e3437fdc8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:58.127556 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8d5aa-1a32-477b-89d5-942e3437fdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:58.127820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8d5aa-1a32-477b-89d5-942e3437fdc8 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:58.128441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8d5aa-1a32-477b-89d5-942e3437fdc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:58.129896 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8d5aa-1a32-477b-89d5-942e3437fdc8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:58.138229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 515/1001] 10.222.0.65 () {56 vars in 1087 bytes} [Tue Aug 9 19:00:57 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:00:59.279535 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed2e42-d11d-44db-ade1-6e29c39130dd None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:59.280061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed2e42-d11d-44db-ade1-6e29c39130dd None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:59.280061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed2e42-d11d-44db-ade1-6e29c39130dd None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:59.281479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 487/1002] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:00:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:00:59.286650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62a0e4-e344-4b7b-91bd-d53879ce3365 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:59.287029 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62a0e4-e344-4b7b-91bd-d53879ce3365 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:59.287207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62a0e4-e344-4b7b-91bd-d53879ce3365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:59.293735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:59.306059 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3c62a0e4-e344-4b7b-91bd-d53879ce3365 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:00:59.307244 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3c62a0e4-e344-4b7b-91bd-d53879ce3365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:00:59.374325 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 516/1003] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:00:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:00:59.397045 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed2e42-d11d-44db-ade1-6e29c39130dd None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:00:59.425910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:00:59.497552 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed2e42-d11d-44db-ade1-6e29c39130dd None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:00:59.537003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c543dd4-4ace-4b77-8b0f-b49eab9a039e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:00:59.537566 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c543dd4-4ace-4b77-8b0f-b49eab9a039e None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:00:59.537848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c543dd4-4ace-4b77-8b0f-b49eab9a039e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:00:59.538118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c543dd4-4ace-4b77-8b0f-b49eab9a039e None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:00:59.538770 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c543dd4-4ace-4b77-8b0f-b49eab9a039e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:00:59.540142 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c543dd4-4ace-4b77-8b0f-b49eab9a039e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:00:59.640832 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 488/1004] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Aug 9 19:00:59 2022] POST /identity/v3/services => generated 242 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:01:00.139643 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344cf2b-bafb-4803-84c8-03862ed047d3 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:00.140045 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344cf2b-bafb-4803-84c8-03862ed047d3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:00.140221 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344cf2b-bafb-4803-84c8-03862ed047d3 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:00.141606 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 517/1005] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:00.146666 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02714e-912a-4b05-88a4-6777ac3af58a None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:00.146953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02714e-912a-4b05-88a4-6777ac3af58a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:00.147225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02714e-912a-4b05-88a4-6777ac3af58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:00.166007 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ff02714e-912a-4b05-88a4-6777ac3af58a None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:00.167185 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ff02714e-912a-4b05-88a4-6777ac3af58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:00.176700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b669688-4579-47b2-bae5-53e0009efe59 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:00.176990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b669688-4579-47b2-bae5-53e0009efe59 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:00.177260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b669688-4579-47b2-bae5-53e0009efe59 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:00.178658 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 518/1006] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:01:00.183426 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee1636-36d7-44dd-bcda-4f85813cdb58 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:00.183716 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee1636-36d7-44dd-bcda-4f85813cdb58 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:00.184622 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee1636-36d7-44dd-bcda-4f85813cdb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:00.202261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-fbee1636-36d7-44dd-bcda-4f85813cdb58 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:00.203451 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fbee1636-36d7-44dd-bcda-4f85813cdb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:00.244400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 489/1007] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:00 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:00.268233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02714e-912a-4b05-88a4-6777ac3af58a None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:00.276881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 519/1008] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:00 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 19:01:00.284886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:00.300040 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee1636-36d7-44dd-bcda-4f85813cdb58 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:00.364735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:00.372848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02714e-912a-4b05-88a4-6777ac3af58a None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:00.404633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee1636-36d7-44dd-bcda-4f85813cdb58 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:00.409610 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d29462-bad9-4a3f-80b2-5e0ee1a4d29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:00.410300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d29462-bad9-4a3f-80b2-5e0ee1a4d29d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:00.410607 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d29462-bad9-4a3f-80b2-5e0ee1a4d29d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:00.410926 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d29462-bad9-4a3f-80b2-5e0ee1a4d29d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:00.411517 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d29462-bad9-4a3f-80b2-5e0ee1a4d29d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:00.412887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d29462-bad9-4a3f-80b2-5e0ee1a4d29d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:00.423158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-57d29462-bad9-4a3f-80b2-5e0ee1a4d29d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 19:01:00.423158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:00.423158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:01:00.423158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:01:00.423158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:01:00.423158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:01:00.423158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:01:00.423158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:01:00.423158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 19:01:00.423158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:01:00.423158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:01:00.423158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:01:00.423158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:00.423158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:00.423158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:00.423158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:00.423158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:00.424218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:00.424218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:00.424218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:00.424218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:00.424218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:00.424218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:00.424218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:01:00.424218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:01:00.424218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:01:00.424218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:01:00.424218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:00.424218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:00.424218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:00.424218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:00.424218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:00.424218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:00.425074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:00.425074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:00.425074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:00.425074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:00.425074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:00.425074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:00.425074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:00.425074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:00.425074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:00.425074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:00.425074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:01:00.425074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:01:00.425074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 19:01:00.425074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:01:00.425074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 490/1009] 10.222.0.65 () {56 vars in 1126 bytes} [Tue Aug 9 19:01:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:01:00.430163 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d29462-bad9-4a3f-80b2-5e0ee1a4d29d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:00.445902 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419022e-84b4-45d2-a3ce-f599a563fb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:00.446531 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419022e-84b4-45d2-a3ce-f599a563fb3a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:00.446818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419022e-84b4-45d2-a3ce-f599a563fb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:00.447092 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419022e-84b4-45d2-a3ce-f599a563fb3a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:00.447697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419022e-84b4-45d2-a3ce-f599a563fb3a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:00.449060 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419022e-84b4-45d2-a3ce-f599a563fb3a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:00.461679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1419022e-84b4-45d2-a3ce-f599a563fb3a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 19:01:00.461679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:00.461679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:01:00.461679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:01:00.461679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:01:00.461679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:01:00.461679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:01:00.461679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:01:00.461679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 19:01:00.461679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:00.461679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:01:00.461679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:00.461679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:00.461679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:00.461679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:00.461679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:00.461679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:00.462657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:00.462657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:00.462657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:00.462657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:00.462657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:00.462657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:00.462657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:01:00.462657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:01:00.462657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:01:00.462657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:01:00.462657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:00.462657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:00.462657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:00.462657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:00.462657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:00.462657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:00.463485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:00.463485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:00.463485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:00.463485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:00.463485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:00.463485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:00.463485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:00.463485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:00.463485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:00.463485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:00.463485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:01:00.463485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:01:00.463485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 19:01:00.463485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:00.463485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 520/1010] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:01:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:01:00.469219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419022e-84b4-45d2-a3ce-f599a563fb3a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:00.530113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:00.552990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d29462-bad9-4a3f-80b2-5e0ee1a4d29d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:00.576984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419022e-84b4-45d2-a3ce-f599a563fb3a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:00.587421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96a782-4351-4418-985b-fefc83f51333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:00.588024 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96a782-4351-4418-985b-fefc83f51333 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:00.588306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96a782-4351-4418-985b-fefc83f51333 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:00.588576 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96a782-4351-4418-985b-fefc83f51333 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:00.589195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96a782-4351-4418-985b-fefc83f51333 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:00.589519 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96a782-4351-4418-985b-fefc83f51333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:00.591125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96a782-4351-4418-985b-fefc83f51333 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:00.595923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 491/1011] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Aug 9 19:01:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:00.601814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96a782-4351-4418-985b-fefc83f51333 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:00.604845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:00.613782 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a6243-5ec8-4995-8eed-1689acfeac02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:00.614468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a6243-5ec8-4995-8eed-1689acfeac02 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:00.614758 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a6243-5ec8-4995-8eed-1689acfeac02 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:00.615169 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a6243-5ec8-4995-8eed-1689acfeac02 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:00.615825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a6243-5ec8-4995-8eed-1689acfeac02 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:00.616133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a6243-5ec8-4995-8eed-1689acfeac02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:00.617533 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a6243-5ec8-4995-8eed-1689acfeac02 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:00.628176 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 521/1012] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Aug 9 19:01:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:00.629152 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a6243-5ec8-4995-8eed-1689acfeac02 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:00.720196 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96a782-4351-4418-985b-fefc83f51333 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:00.740432 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a6243-5ec8-4995-8eed-1689acfeac02 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:00.758293 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9c3c4-0b63-404d-b005-26c92facdba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:00.758901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9c3c4-0b63-404d-b005-26c92facdba8 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:00.759181 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9c3c4-0b63-404d-b005-26c92facdba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:00.759472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9c3c4-0b63-404d-b005-26c92facdba8 None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:00.760097 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9c3c4-0b63-404d-b005-26c92facdba8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:00.760398 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9c3c4-0b63-404d-b005-26c92facdba8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:00.761791 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9c3c4-0b63-404d-b005-26c92facdba8 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:00.768526 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 492/1013] 10.222.0.65 () {56 vars in 1122 bytes} [Tue Aug 9 19:01:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:00.773760 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9c3c4-0b63-404d-b005-26c92facdba8 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:00.780614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a62c4-24af-463d-bcc9-39d2d20f0bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:00.781539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a62c4-24af-463d-bcc9-39d2d20f0bcd None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:00.781969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a62c4-24af-463d-bcc9-39d2d20f0bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:00.782389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a62c4-24af-463d-bcc9-39d2d20f0bcd None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:00.783277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a62c4-24af-463d-bcc9-39d2d20f0bcd None admin] RBAC: Adding query filter params (type=compute) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:00.784033 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:00.784452 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a62c4-24af-463d-bcc9-39d2d20f0bcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:00.785951 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a62c4-24af-463d-bcc9-39d2d20f0bcd None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:00.798874 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 522/1014] 10.222.0.65 () {56 vars in 1112 bytes} [Tue Aug 9 19:01:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:00.800693 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a62c4-24af-463d-bcc9-39d2d20f0bcd None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:00.867351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:00.883820 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9c3c4-0b63-404d-b005-26c92facdba8 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:00.916944 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a62c4-24af-463d-bcc9-39d2d20f0bcd None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:00.923099 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a245df4-3e8c-4322-9670-f9bb2f635751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:00.923887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a245df4-3e8c-4322-9670-f9bb2f635751 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:00.924351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a245df4-3e8c-4322-9670-f9bb2f635751 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:00.924779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a245df4-3e8c-4322-9670-f9bb2f635751 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:00.925437 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a245df4-3e8c-4322-9670-f9bb2f635751 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:00.927030 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a245df4-3e8c-4322-9670-f9bb2f635751 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:00.952688 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc12f73-c4f5-4055-8b18-2b052db1d6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:00.953314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc12f73-c4f5-4055-8b18-2b052db1d6e8 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:00.953622 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc12f73-c4f5-4055-8b18-2b052db1d6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:00.953898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc12f73-c4f5-4055-8b18-2b052db1d6e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:00.954547 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc12f73-c4f5-4055-8b18-2b052db1d6e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:00.955922 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc12f73-c4f5-4055-8b18-2b052db1d6e8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:01.032070 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 493/1015] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:01:00 2022] POST /identity/v3/endpoints => generated 325 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:01:01.048471 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 523/1016] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:01:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:01:01.692188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacc194-5e93-49f3-b5a1-56d70b45b2cc None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:01.692703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacc194-5e93-49f3-b5a1-56d70b45b2cc None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:01.692803 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacc194-5e93-49f3-b5a1-56d70b45b2cc None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:01.694117 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 494/1017] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:01.699862 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99297c08-3e80-47b5-91bb-39ca0c1bc4da None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:01.700384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99297c08-3e80-47b5-91bb-39ca0c1bc4da None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:01.700490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99297c08-3e80-47b5-91bb-39ca0c1bc4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:01.718404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-99297c08-3e80-47b5-91bb-39ca0c1bc4da None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:01.719583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-99297c08-3e80-47b5-91bb-39ca0c1bc4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:01.803394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 524/1018] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:01.826282 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacc194-5e93-49f3-b5a1-56d70b45b2cc None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:01.895456 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:01.930874 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacc194-5e93-49f3-b5a1-56d70b45b2cc None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:01.965697 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed296de-b3bd-4212-89a4-28567358b013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:01.966316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed296de-b3bd-4212-89a4-28567358b013 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:01.966590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed296de-b3bd-4212-89a4-28567358b013 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:01.966856 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed296de-b3bd-4212-89a4-28567358b013 None admin] PATH_INFO: `/v3/services/image` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:01.967425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed296de-b3bd-4212-89a4-28567358b013 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:01.968777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed296de-b3bd-4212-89a4-28567358b013 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:01.977233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-3ed296de-b3bd-4212-89a4-28567358b013 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 19:01:01.977233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:01.977233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:01:01.977233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:01:01.977233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:01:01.977233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:01:01.977233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:01:01.977233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:01:01.977233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 19:01:01.977233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:01:01.977233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:01:01.977233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:01:01.977233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:01.977233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:01.977233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:01.977233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:01.977233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:01.978244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:01.978244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:01.978244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:01.978244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:01.978244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:01.978244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:01.978244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:01:01.978244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:01:01.978244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:01:01.978244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:01:01.978244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:01.978244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:01.978244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:01.978244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:01.978244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:01.978244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:01.985001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:01.985001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:01.985001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:01.985001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:01.985001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:01.985001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:01.985001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:01.985001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:01.985001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:01.985001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:01.985001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:01:01.985001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:01:01.985001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 19:01:01.985001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:01:01.985001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 495/1019] 10.222.0.65 () {56 vars in 1105 bytes} [Tue Aug 9 19:01:01 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:01:01.987297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99297c08-3e80-47b5-91bb-39ca0c1bc4da None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:02.023300 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:02.089400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99297c08-3e80-47b5-91bb-39ca0c1bc4da None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:02.123927 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c882f-70dc-48ab-9c83-c25ae1528640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:02.124545 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c882f-70dc-48ab-9c83-c25ae1528640 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:02.124828 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c882f-70dc-48ab-9c83-c25ae1528640 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:02.125103 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c882f-70dc-48ab-9c83-c25ae1528640 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:02.125760 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c882f-70dc-48ab-9c83-c25ae1528640 None admin] RBAC: Adding query filter params (name=image) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:02.126075 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c882f-70dc-48ab-9c83-c25ae1528640 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:02.127448 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c882f-70dc-48ab-9c83-c25ae1528640 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:02.132994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 525/1020] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:01:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:02.138840 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed296de-b3bd-4212-89a4-28567358b013 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:02.242835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed296de-b3bd-4212-89a4-28567358b013 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:02.272617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:02.280127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e4d68-af3d-4dcc-bb63-bb789024679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:02.280755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e4d68-af3d-4dcc-bb63-bb789024679c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:02.281033 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e4d68-af3d-4dcc-bb63-bb789024679c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:02.281303 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e4d68-af3d-4dcc-bb63-bb789024679c None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:02.281985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e4d68-af3d-4dcc-bb63-bb789024679c None admin] RBAC: Adding query filter params (type=image) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:02.282280 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e4d68-af3d-4dcc-bb63-bb789024679c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:02.283659 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e4d68-af3d-4dcc-bb63-bb789024679c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:02.294623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 496/1021] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:01:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:02.295888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c882f-70dc-48ab-9c83-c25ae1528640 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:02.402515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:02.406410 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c882f-70dc-48ab-9c83-c25ae1528640 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:02.440713 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c130d-3591-46b7-aaff-a35654a556ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:02.441468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c130d-3591-46b7-aaff-a35654a556ea None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:02.441850 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c130d-3591-46b7-aaff-a35654a556ea None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:02.442235 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c130d-3591-46b7-aaff-a35654a556ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:02.443075 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c130d-3591-46b7-aaff-a35654a556ea None admin] RBAC: Adding query filter params (interface=public, service_id=c23a3fdfc6c04656b958b032b2964238, region_id=RegionOne) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:02.443477 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c130d-3591-46b7-aaff-a35654a556ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:02.445029 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c130d-3591-46b7-aaff-a35654a556ea None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:02.453499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 526/1022] 10.222.0.65 () {56 vars in 1251 bytes} [Tue Aug 9 19:01:02 2022] GET /identity/v3/endpoints?service_id=c23a3fdfc6c04656b958b032b2964238&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:02.458499 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e4d68-af3d-4dcc-bb63-bb789024679c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:02.571843 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e4d68-af3d-4dcc-bb63-bb789024679c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:02.611762 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd1a2e-ef1d-4852-bf32-588e74fb986c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:02.612379 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd1a2e-ef1d-4852-bf32-588e74fb986c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:02.612658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd1a2e-ef1d-4852-bf32-588e74fb986c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:02.612927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd1a2e-ef1d-4852-bf32-588e74fb986c None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:02.613549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd1a2e-ef1d-4852-bf32-588e74fb986c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:02.614917 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd1a2e-ef1d-4852-bf32-588e74fb986c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:02.625489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 497/1023] 10.222.0.65 () {56 vars in 1087 bytes} [Tue Aug 9 19:01:02 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:01:03.113383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc608ed-f9c5-4def-894e-da4dc6a5427d None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:03.113973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc608ed-f9c5-4def-894e-da4dc6a5427d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:03.113973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc608ed-f9c5-4def-894e-da4dc6a5427d None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:03.115353 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 527/1024] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:03.120435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783a88b-aa6f-40cd-be08-35563b648932 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:03.120824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783a88b-aa6f-40cd-be08-35563b648932 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:03.120984 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783a88b-aa6f-40cd-be08-35563b648932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:03.140129 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1783a88b-aa6f-40cd-be08-35563b648932 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:03.141323 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1783a88b-aa6f-40cd-be08-35563b648932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:03.183601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62851fb5-712d-430a-a67d-695e2f502906 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:03.184011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62851fb5-712d-430a-a67d-695e2f502906 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:03.184192 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62851fb5-712d-430a-a67d-695e2f502906 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:03.185509 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 528/1025] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:01:03.190566 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d71863-65c9-422b-9b74-0a5db46ddb3a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:03.190938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d71863-65c9-422b-9b74-0a5db46ddb3a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:03.191282 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d71863-65c9-422b-9b74-0a5db46ddb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:03.196233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:03.209255 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-95d71863-65c9-422b-9b74-0a5db46ddb3a None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:03.213082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-95d71863-65c9-422b-9b74-0a5db46ddb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:03.213207 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 498/1026] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:03.236654 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783a88b-aa6f-40cd-be08-35563b648932 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:03.279170 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 529/1027] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 19:01:03.302249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d71863-65c9-422b-9b74-0a5db46ddb3a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:03.341417 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783a88b-aa6f-40cd-be08-35563b648932 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:03.380708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6cbdb-b030-4db5-814d-ba0fef431071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:03.381337 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6cbdb-b030-4db5-814d-ba0fef431071 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:03.381650 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6cbdb-b030-4db5-814d-ba0fef431071 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:03.381920 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6cbdb-b030-4db5-814d-ba0fef431071 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:03.383023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6cbdb-b030-4db5-814d-ba0fef431071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:03.384468 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6cbdb-b030-4db5-814d-ba0fef431071 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:03.386211 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 499/1028] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:01:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:03.392470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6cbdb-b030-4db5-814d-ba0fef431071 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:03.398245 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:03.406463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d71863-65c9-422b-9b74-0a5db46ddb3a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:03.441473 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b90c6-eabc-4b7c-a56a-acfe58a5655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:03.442106 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b90c6-eabc-4b7c-a56a-acfe58a5655a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:03.442381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b90c6-eabc-4b7c-a56a-acfe58a5655a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:03.442644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b90c6-eabc-4b7c-a56a-acfe58a5655a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:03.450303 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:03.453639 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b90c6-eabc-4b7c-a56a-acfe58a5655a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:01:03.458270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-061b90c6-eabc-4b7c-a56a-acfe58a5655a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 19:01:03.458270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:03.458270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:03.458270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:03.458270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:03.458270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:03.458270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:03.458270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:03.458270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:03.458270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:03.458270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:03.458270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:03.458270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:01:03.458270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:01:03.458270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:01:03.458270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:01:03.459593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:01:03.459593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:01:03.459593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:01:03.459593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:01:03.459593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:03.459593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:03.459593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:03.459593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:03.459593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:03.459593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:03.459593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:03.459593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:03.459593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:03.459593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:03.459593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:03.459593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:03.460488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:03.460488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:03.460488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:03.460488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:03.460488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:01:03.460488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:01:03.460488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:01:03.460488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:01:03.460488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:01:03.460488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:01:03.460488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 19:01:03.460488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:03.460488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 530/1029] 10.222.0.65 () {56 vars in 1120 bytes} [Tue Aug 9 19:01:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:01:03.466071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b90c6-eabc-4b7c-a56a-acfe58a5655a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:03.501832 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6cbdb-b030-4db5-814d-ba0fef431071 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:03.538217 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d26118-94f4-4bf8-a6fb-f636ba650782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:03.538822 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d26118-94f4-4bf8-a6fb-f636ba650782 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:03.539099 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d26118-94f4-4bf8-a6fb-f636ba650782 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:03.539366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d26118-94f4-4bf8-a6fb-f636ba650782 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:03.540000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d26118-94f4-4bf8-a6fb-f636ba650782 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:03.541419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d26118-94f4-4bf8-a6fb-f636ba650782 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:03.579797 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b90c6-eabc-4b7c-a56a-acfe58a5655a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:03.613149 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad3fd0-c15d-4de8-b4be-9b8f0b95dbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:03.613776 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad3fd0-c15d-4de8-b4be-9b8f0b95dbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:03.614054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad3fd0-c15d-4de8-b4be-9b8f0b95dbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:03.614324 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad3fd0-c15d-4de8-b4be-9b8f0b95dbe9 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:03.614977 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad3fd0-c15d-4de8-b4be-9b8f0b95dbe9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:03.615276 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad3fd0-c15d-4de8-b4be-9b8f0b95dbe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:03.625783 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 500/1030] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Aug 9 19:01:03 2022] POST /identity/v3/projects => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:01:03.626016 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad3fd0-c15d-4de8-b4be-9b8f0b95dbe9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:03.634757 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 531/1031] 10.222.0.65 () {56 vars in 1115 bytes} [Tue Aug 9 19:01:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:03.641091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d26118-94f4-4bf8-a6fb-f636ba650782 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:03.760232 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d26118-94f4-4bf8-a6fb-f636ba650782 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:03.769998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:03.799661 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac98840-b0ef-4f71-a118-1c49c88506fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:03.800302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac98840-b0ef-4f71-a118-1c49c88506fb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:03.800581 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac98840-b0ef-4f71-a118-1c49c88506fb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:03.800853 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac98840-b0ef-4f71-a118-1c49c88506fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:03.812385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac98840-b0ef-4f71-a118-1c49c88506fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:03.813945 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac98840-b0ef-4f71-a118-1c49c88506fb None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:03.833591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-1ac98840-b0ef-4f71-a118-1c49c88506fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:01:03.833591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:03.833591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:03.833591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:03.833591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:03.833591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:03.833591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:03.833591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:03.833591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:03.833591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:03.833591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:03.833591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:03.833591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:01:03.833591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:01:03.833591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:01:03.833591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:01:03.834634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:03.834634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:03.834634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:03.834634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:03.834634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:03.834634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:03.834634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:03.834634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:03.834634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:03.834634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:03.834634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:03.834634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:03.834634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:03.834634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:03.834634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:03.834634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:03.834634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:01:03.835732 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:01:03.835732 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:01:03.835732 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:01:03.835732 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 501/1032] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:01:03.841579 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad3fd0-c15d-4de8-b4be-9b8f0b95dbe9 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:03.861883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:03.943547 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad3fd0-c15d-4de8-b4be-9b8f0b95dbe9 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:03.977170 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c8395-e3a1-4bae-a19b-6464a86414ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:03.977983 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c8395-e3a1-4bae-a19b-6464a86414ee None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:03.978363 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c8395-e3a1-4bae-a19b-6464a86414ee None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:03.978732 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c8395-e3a1-4bae-a19b-6464a86414ee None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:03.979495 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c8395-e3a1-4bae-a19b-6464a86414ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:03.979800 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c8395-e3a1-4bae-a19b-6464a86414ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:03.981685 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c8395-e3a1-4bae-a19b-6464a86414ee None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:03.998534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 532/1033] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:03.999751 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac98840-b0ef-4f71-a118-1c49c88506fb None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:04.101465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac98840-b0ef-4f71-a118-1c49c88506fb None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:04.136498 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420f9c5-d7bf-4d67-afa1-f6bc40b90252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:04.137853 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420f9c5-d7bf-4d67-afa1-f6bc40b90252 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:04.137933 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420f9c5-d7bf-4d67-afa1-f6bc40b90252 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:04.138204 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420f9c5-d7bf-4d67-afa1-f6bc40b90252 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:04.146037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420f9c5-d7bf-4d67-afa1-f6bc40b90252 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:04.147478 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420f9c5-d7bf-4d67-afa1-f6bc40b90252 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:04.158982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-f420f9c5-d7bf-4d67-afa1-f6bc40b90252 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 19:01:04.158982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:04.158982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:04.158982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:04.158982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:04.158982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:04.158982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:04.158982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:04.158982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:04.158982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:04.158982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:04.158982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:04.158982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:01:04.158982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:01:04.158982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:01:04.158982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:01:04.159954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:04.159954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:04.159954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:01:04.159954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:01:04.159954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:01:04.159954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:01:04.159954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:04.159954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:04.159954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:04.159954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:04.159954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:04.159954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:04.159954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:04.159954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:04.159954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:04.159954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:04.159954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:04.159954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:04.161658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:04.161658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:04.161658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:01:04.161658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:01:04.161658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:01:04.161658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:01:04.161658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:01:04.161658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:01:04.161658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 19:01:04.161658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:01:04.161658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 502/1034] 10.222.0.65 () {56 vars in 1093 bytes} [Tue Aug 9 19:01:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:01:04.169484 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c8395-e3a1-4bae-a19b-6464a86414ee None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:04.245186 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:04.269821 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c8395-e3a1-4bae-a19b-6464a86414ee None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:04.304829 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dd9f6-2ab6-44ee-a155-f728a013770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:04.305706 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dd9f6-2ab6-44ee-a155-f728a013770c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:04.306158 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dd9f6-2ab6-44ee-a155-f728a013770c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:04.306586 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dd9f6-2ab6-44ee-a155-f728a013770c None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:04.307459 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dd9f6-2ab6-44ee-a155-f728a013770c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:04.307911 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dd9f6-2ab6-44ee-a155-f728a013770c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:04.309676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dd9f6-2ab6-44ee-a155-f728a013770c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:04.332267 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 533/1035] 10.222.0.65 () {56 vars in 1133 bytes} [Tue Aug 9 19:01:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:04.333562 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420f9c5-d7bf-4d67-afa1-f6bc40b90252 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:04.356666 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:04.436413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420f9c5-d7bf-4d67-afa1-f6bc40b90252 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:04.470189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121ad7d-557b-4ca4-88a2-9b303b2c00d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:04.470800 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121ad7d-557b-4ca4-88a2-9b303b2c00d1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:04.471084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121ad7d-557b-4ca4-88a2-9b303b2c00d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:04.471362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121ad7d-557b-4ca4-88a2-9b303b2c00d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:04.547624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121ad7d-557b-4ca4-88a2-9b303b2c00d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:04.549067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121ad7d-557b-4ca4-88a2-9b303b2c00d1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:04.571660 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:04.651976 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 503/1036] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:01:04 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:01:04.657045 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dd9f6-2ab6-44ee-a155-f728a013770c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:04.673476 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d536b-a0d9-4156-93f1-3935e1983900 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:04.673792 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d536b-a0d9-4156-93f1-3935e1983900 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:04.674042 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d536b-a0d9-4156-93f1-3935e1983900 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:04.675394 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 504/1037] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:01:04.681106 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb07a4-e1c3-4f99-a0d0-b07c2b4894fc None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:04.681391 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb07a4-e1c3-4f99-a0d0-b07c2b4894fc None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:04.681818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb07a4-e1c3-4f99-a0d0-b07c2b4894fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:04.700147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-41eb07a4-e1c3-4f99-a0d0-b07c2b4894fc None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:04.701533 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-41eb07a4-e1c3-4f99-a0d0-b07c2b4894fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:04.767204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dd9f6-2ab6-44ee-a155-f728a013770c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:04.771817 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 505/1038] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 19:01:04.795696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb07a4-e1c3-4f99-a0d0-b07c2b4894fc None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:04.807721 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f1267-e70a-4309-a829-72a10c6990ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:04.808355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f1267-e70a-4309-a829-72a10c6990ee None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:04.808715 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f1267-e70a-4309-a829-72a10c6990ee None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:04.808971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f1267-e70a-4309-a829-72a10c6990ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:04.811031 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:04.820047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f1267-e70a-4309-a829-72a10c6990ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:04.824809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f1267-e70a-4309-a829-72a10c6990ee None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:04.836655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-8f6f1267-e70a-4309-a829-72a10c6990ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:01:04.836655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:04.836655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:04.836655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:04.836655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:04.836655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:04.836655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:04.836655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:04.836655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:04.836655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:04.836655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:04.836655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:04.836655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:01:04.836655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:01:04.836655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:01:04.836655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:01:04.837898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:04.837898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:04.837898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:04.837898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:04.837898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:04.837898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:04.837898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:04.837898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:04.837898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:04.837898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:04.837898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:04.837898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:04.837898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:04.837898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:04.837898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:04.837898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:04.837898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:01:04.839045 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:01:04.839045 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:01:04.839045 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:04.846720 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 534/1039] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:01:04.847570 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f1267-e70a-4309-a829-72a10c6990ee None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:04.857277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:04.916667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb07a4-e1c3-4f99-a0d0-b07c2b4894fc None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:04.950644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f1267-e70a-4309-a829-72a10c6990ee None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:04.952765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca419f2-cc32-46a1-a96c-87255c9d0d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:04.954172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca419f2-cc32-46a1-a96c-87255c9d0d66 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:04.954453 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca419f2-cc32-46a1-a96c-87255c9d0d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:04.954724 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca419f2-cc32-46a1-a96c-87255c9d0d66 None admin] PATH_INFO: `/v3/services/image` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:04.955307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca419f2-cc32-46a1-a96c-87255c9d0d66 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:04.956684 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca419f2-cc32-46a1-a96c-87255c9d0d66 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:04.966010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-9ca419f2-cc32-46a1-a96c-87255c9d0d66 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 19:01:04.966010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:04.966010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:01:04.966010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:01:04.966010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:01:04.966010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:01:04.966010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:01:04.966010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:01:04.966010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 19:01:04.966010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:01:04.966010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:01:04.966010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:01:04.966010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:04.966010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:04.966010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:04.966010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:04.966010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:04.966980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:04.966980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:04.966980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:04.966980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:04.966980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:04.966980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:04.966980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:01:04.966980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:01:04.966980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:01:04.966980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:01:04.966980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:04.966980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:04.966980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:04.966980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:04.966980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:04.966980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:04.967826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:04.967826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:04.967826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:04.967826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:04.967826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:04.967826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:04.967826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:04.967826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:04.967826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:04.967826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:04.967826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:01:04.967826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:01:04.967826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 19:01:04.967826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:01:04.967826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 506/1040] 10.222.0.65 () {56 vars in 1105 bytes} [Tue Aug 9 19:01:04 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:01:04.972984 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca419f2-cc32-46a1-a96c-87255c9d0d66 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:04.992616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652c1d0-8128-4e0f-aa02-332a2614acb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:04.993220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652c1d0-8128-4e0f-aa02-332a2614acb2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:04.993524 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652c1d0-8128-4e0f-aa02-332a2614acb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:04.993801 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652c1d0-8128-4e0f-aa02-332a2614acb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:04.994437 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652c1d0-8128-4e0f-aa02-332a2614acb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:04.994741 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652c1d0-8128-4e0f-aa02-332a2614acb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:04.997431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652c1d0-8128-4e0f-aa02-332a2614acb2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:05.015443 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 535/1041] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:05.016474 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652c1d0-8128-4e0f-aa02-332a2614acb2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:05.066907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:05.082562 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca419f2-cc32-46a1-a96c-87255c9d0d66 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:05.097275 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:05.118332 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6a90e-cd26-4926-9bdd-94da0ef03c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:05.118938 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6a90e-cd26-4926-9bdd-94da0ef03c1b None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:05.119260 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6a90e-cd26-4926-9bdd-94da0ef03c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:05.119543 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6a90e-cd26-4926-9bdd-94da0ef03c1b None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:05.120166 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6a90e-cd26-4926-9bdd-94da0ef03c1b None admin] RBAC: Adding query filter params (name=image) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:05.120470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6a90e-cd26-4926-9bdd-94da0ef03c1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:05.122459 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6a90e-cd26-4926-9bdd-94da0ef03c1b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:05.123744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652c1d0-8128-4e0f-aa02-332a2614acb2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:05.132176 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 507/1042] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:01:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:05.133176 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6a90e-cd26-4926-9bdd-94da0ef03c1b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:05.162135 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a46ad-4323-4e4b-bc35-7d0fa229cd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:05.162745 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a46ad-4323-4e4b-bc35-7d0fa229cd92 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:05.163026 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a46ad-4323-4e4b-bc35-7d0fa229cd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:05.163457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a46ad-4323-4e4b-bc35-7d0fa229cd92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:05.170723 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a46ad-4323-4e4b-bc35-7d0fa229cd92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:05.171957 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a46ad-4323-4e4b-bc35-7d0fa229cd92 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:05.183400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-e24a46ad-4323-4e4b-bc35-7d0fa229cd92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:01:05.183400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:05.183400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:05.183400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:05.183400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:05.183400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:05.183400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:05.183400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:05.183400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:05.183400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:05.183400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:05.183400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:05.183400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:01:05.183400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:01:05.183400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:01:05.185132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:01:05.185132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:05.185132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:05.185132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:05.185132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:05.185132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:05.185132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:05.185132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:05.185132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:05.185132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:05.185132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:05.185132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:05.185132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:05.185132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:05.185132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:05.185132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:05.185132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:05.186087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:01:05.186087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:01:05.186087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:01:05.186087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:01:05.186087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:01:05.186087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:01:05.186087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:01:05.186087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:05.186087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 536/1043] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:01:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:01:05.192870 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a46ad-4323-4e4b-bc35-7d0fa229cd92 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:05.241728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6a90e-cd26-4926-9bdd-94da0ef03c1b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:05.278634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865bae7-92e8-42b6-894a-89e924a2363e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:05.279248 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865bae7-92e8-42b6-894a-89e924a2363e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:05.279526 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865bae7-92e8-42b6-894a-89e924a2363e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:05.279797 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865bae7-92e8-42b6-894a-89e924a2363e None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:05.280428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865bae7-92e8-42b6-894a-89e924a2363e None admin] RBAC: Adding query filter params (type=image) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:05.280740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865bae7-92e8-42b6-894a-89e924a2363e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:05.282128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865bae7-92e8-42b6-894a-89e924a2363e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:05.291777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 508/1044] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:01:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:05.292740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865bae7-92e8-42b6-894a-89e924a2363e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:05.311425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a46ad-4323-4e4b-bc35-7d0fa229cd92 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:05.318774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:05.337334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:05.348788 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84047e6e-ad09-41ba-b301-184a3ee70b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:05.349398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84047e6e-ad09-41ba-b301-184a3ee70b13 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:05.349811 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84047e6e-ad09-41ba-b301-184a3ee70b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:05.350094 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84047e6e-ad09-41ba-b301-184a3ee70b13 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:05.350787 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84047e6e-ad09-41ba-b301-184a3ee70b13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:05.351103 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84047e6e-ad09-41ba-b301-184a3ee70b13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:05.352567 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84047e6e-ad09-41ba-b301-184a3ee70b13 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:05.364683 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 537/1045] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:01:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:05.370565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84047e6e-ad09-41ba-b301-184a3ee70b13 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:05.411636 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865bae7-92e8-42b6-894a-89e924a2363e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:05.449622 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a8554-5956-4391-8c71-020f66d3772a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:05.450439 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a8554-5956-4391-8c71-020f66d3772a None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:05.450793 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a8554-5956-4391-8c71-020f66d3772a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:05.451129 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a8554-5956-4391-8c71-020f66d3772a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:05.451858 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a8554-5956-4391-8c71-020f66d3772a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:05.453294 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a8554-5956-4391-8c71-020f66d3772a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:05.475950 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84047e6e-ad09-41ba-b301-184a3ee70b13 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:05.513708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccaab7-14a2-4474-98b2-aa1f8ea077eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:05.514306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccaab7-14a2-4474-98b2-aa1f8ea077eb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:05.514585 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccaab7-14a2-4474-98b2-aa1f8ea077eb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:05.514856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccaab7-14a2-4474-98b2-aa1f8ea077eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:05.515585 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccaab7-14a2-4474-98b2-aa1f8ea077eb None admin] RBAC: Adding query filter params (role.id=8ea36b65594142ceb8ea960aa371c2e3, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=2cfda1bec35145f3bbcc13fae0b7af2e) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:05.515894 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccaab7-14a2-4474-98b2-aa1f8ea077eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:05.517404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccaab7-14a2-4474-98b2-aa1f8ea077eb None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:05.523092 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 538/1046] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:01:05 2022] GET /identity/v3/role_assignments?user.id=2cfda1bec35145f3bbcc13fae0b7af2e&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=8ea36b65594142ceb8ea960aa371c2e3 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:05.525118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 509/1047] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:01:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:01:05.701729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8b678-4f27-4803-8570-8e7044b971b4 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:05.702032 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8b678-4f27-4803-8570-8e7044b971b4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:05.702311 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8b678-4f27-4803-8570-8e7044b971b4 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:05.703668 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 510/1048] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:05.709169 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804adbda-3f68-4b3d-9db9-11e081b5c2fa None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:05.709563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804adbda-3f68-4b3d-9db9-11e081b5c2fa None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:05.709768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804adbda-3f68-4b3d-9db9-11e081b5c2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:05.728951 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-804adbda-3f68-4b3d-9db9-11e081b5c2fa None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:05.730189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-804adbda-3f68-4b3d-9db9-11e081b5c2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:05.757126 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:05.807160 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 539/1049] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:05.831497 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8b678-4f27-4803-8570-8e7044b971b4 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:05.932676 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:05.937973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8b678-4f27-4803-8570-8e7044b971b4 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:05.972539 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413b3db-53cc-4c31-b539-45f7d0bbfb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:05.973096 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413b3db-53cc-4c31-b539-45f7d0bbfb93 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:05.973374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413b3db-53cc-4c31-b539-45f7d0bbfb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:05.973674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413b3db-53cc-4c31-b539-45f7d0bbfb93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:05.974780 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413b3db-53cc-4c31-b539-45f7d0bbfb93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:05.976313 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413b3db-53cc-4c31-b539-45f7d0bbfb93 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:05.983432 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 511/1050] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:01:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:05.984653 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804adbda-3f68-4b3d-9db9-11e081b5c2fa None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:06.087912 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804adbda-3f68-4b3d-9db9-11e081b5c2fa None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:06.122708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0090e88f-08a5-4bde-b9f3-a2976f0ef609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:06.123307 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090e88f-08a5-4bde-b9f3-a2976f0ef609 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:06.123583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090e88f-08a5-4bde-b9f3-a2976f0ef609 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:06.123848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0090e88f-08a5-4bde-b9f3-a2976f0ef609 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:06.124499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090e88f-08a5-4bde-b9f3-a2976f0ef609 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:06.125956 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0090e88f-08a5-4bde-b9f3-a2976f0ef609 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:06.226178 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 540/1051] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Aug 9 19:01:05 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:01:07.550377 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada895c-74a7-4b6c-af0f-8e43c2675d0e None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:07.550925 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada895c-74a7-4b6c-af0f-8e43c2675d0e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:07.550925 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada895c-74a7-4b6c-af0f-8e43c2675d0e None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:07.552409 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 512/1052] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:07.557266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272bf53-87dc-4835-aeb2-4be55abf3175 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:07.557668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272bf53-87dc-4835-aeb2-4be55abf3175 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:07.557852 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272bf53-87dc-4835-aeb2-4be55abf3175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:07.571148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ab3e1-735d-49ec-b733-ed922783cf0e None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:07.571430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ab3e1-735d-49ec-b733-ed922783cf0e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:07.571699 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ab3e1-735d-49ec-b733-ed922783cf0e None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:07.573111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 513/1053] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:01:07.576676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9272bf53-87dc-4835-aeb2-4be55abf3175 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:07.577899 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9272bf53-87dc-4835-aeb2-4be55abf3175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:07.578450 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb5ae0-5be0-4740-bea6-806d84f61a35 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:07.578734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb5ae0-5be0-4740-bea6-806d84f61a35 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:07.579040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb5ae0-5be0-4740-bea6-806d84f61a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:07.586155 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:07.596233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-8cdb5ae0-5be0-4740-bea6-806d84f61a35 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:07.597400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8cdb5ae0-5be0-4740-bea6-806d84f61a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:07.648968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 541/1054] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:07.669860 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 514/1055] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 19:01:07.671543 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272bf53-87dc-4835-aeb2-4be55abf3175 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:07.691615 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb5ae0-5be0-4740-bea6-806d84f61a35 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:07.773568 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272bf53-87dc-4835-aeb2-4be55abf3175 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:07.789578 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:07.795887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb5ae0-5be0-4740-bea6-806d84f61a35 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:07.808464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577aeec3-42a1-4143-a11f-9d8b90b280e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:07.809102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577aeec3-42a1-4143-a11f-9d8b90b280e4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:07.809378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577aeec3-42a1-4143-a11f-9d8b90b280e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:07.809676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577aeec3-42a1-4143-a11f-9d8b90b280e4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:07.824510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577aeec3-42a1-4143-a11f-9d8b90b280e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:01:07.829175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-577aeec3-42a1-4143-a11f-9d8b90b280e4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 19:01:07.829175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:07.829175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:07.829175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:07.829175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:07.829175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:07.829175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:07.829175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:07.829175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:07.829175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:07.829175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:07.829175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:07.829175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:01:07.829175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:01:07.829175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:01:07.829175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:01:07.830153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:01:07.830153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:01:07.830153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:01:07.830153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:01:07.830153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:07.830153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:07.830153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:07.830153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:07.830153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:07.830153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:07.830153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:07.830153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:07.830153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:07.830153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:07.830153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:07.830153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:07.831101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:07.831101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:07.831101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:07.831101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:07.831101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:01:07.831101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:01:07.831101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:01:07.831101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:01:07.831101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:01:07.831101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:01:07.831101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 19:01:07.831101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:07.831101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 542/1056] 10.222.0.65 () {56 vars in 1120 bytes} [Tue Aug 9 19:01:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:01:07.834807 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28221f5f-bee8-42cb-b7a0-c775a1a05f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:07.835554 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28221f5f-bee8-42cb-b7a0-c775a1a05f14 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:07.835841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28221f5f-bee8-42cb-b7a0-c775a1a05f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:07.836080 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577aeec3-42a1-4143-a11f-9d8b90b280e4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:07.836175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28221f5f-bee8-42cb-b7a0-c775a1a05f14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:07.839400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:07.910497 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28221f5f-bee8-42cb-b7a0-c775a1a05f14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:07.912290 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28221f5f-bee8-42cb-b7a0-c775a1a05f14 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:07.940108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577aeec3-42a1-4143-a11f-9d8b90b280e4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:07.975748 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f7829-2929-4e5f-9136-c297129195f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:07.976352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f7829-2929-4e5f-9136-c297129195f4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:07.976628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f7829-2929-4e5f-9136-c297129195f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:07.976902 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f7829-2929-4e5f-9136-c297129195f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:07.977593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f7829-2929-4e5f-9136-c297129195f4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:07.977904 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f7829-2929-4e5f-9136-c297129195f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:07.979257 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f7829-2929-4e5f-9136-c297129195f4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:07.988718 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 543/1057] 10.222.0.65 () {56 vars in 1115 bytes} [Tue Aug 9 19:01:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:07.994518 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f7829-2929-4e5f-9136-c297129195f4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:08.015509 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:08.022845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 515/1058] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:01:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 19:01:08.028852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28221f5f-bee8-42cb-b7a0-c775a1a05f14 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:08.072102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:08.112178 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f7829-2929-4e5f-9136-c297129195f4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:08.138052 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28221f5f-bee8-42cb-b7a0-c775a1a05f14 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:08.146542 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c3db5-5c67-4e1c-b253-9ee50828c3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:08.147431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c3db5-5c67-4e1c-b253-9ee50828c3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:08.147706 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c3db5-5c67-4e1c-b253-9ee50828c3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:08.147976 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c3db5-5c67-4e1c-b253-9ee50828c3e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:08.159418 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c3db5-5c67-4e1c-b253-9ee50828c3e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:08.160564 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c3db5-5c67-4e1c-b253-9ee50828c3e1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:08.173594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c32031-3904-4296-8c79-a0b258e6ccdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:08.174228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c32031-3904-4296-8c79-a0b258e6ccdc None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:08.174506 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c32031-3904-4296-8c79-a0b258e6ccdc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:08.174775 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c32031-3904-4296-8c79-a0b258e6ccdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:08.178184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-d85c3db5-5c67-4e1c-b253-9ee50828c3e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:01:08.178184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:08.178184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:08.178184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:08.178184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:08.178184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:08.178184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:08.178184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:08.178184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:08.178184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:08.178184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:08.178184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:08.178184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:01:08.178184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:01:08.178184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:01:08.178184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:01:08.179125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:08.179125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:08.179125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:08.179125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:08.179125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:08.179125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:08.179125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:08.179125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:08.179125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:08.179125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:08.179125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:08.179125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:08.179125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:08.179125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:08.179125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:08.179125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:08.179125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:01:08.180038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:01:08.180038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:01:08.180038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:08.180038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 544/1059] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:01:08.185612 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c3db5-5c67-4e1c-b253-9ee50828c3e1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:08.190370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c32031-3904-4296-8c79-a0b258e6ccdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:08.191855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c32031-3904-4296-8c79-a0b258e6ccdc None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:08.207283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-17c32031-3904-4296-8c79-a0b258e6ccdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:01:08.207283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:08.207283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:08.207283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:08.207283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:08.207283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:08.207283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:08.207283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:08.207283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:08.207283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:08.207283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:08.207283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:08.207283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:01:08.207283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:01:08.207283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:01:08.207283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:01:08.208261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:08.208261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:08.208261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:08.208261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:08.208261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:08.208261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:08.208261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:08.208261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:08.208261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:08.208261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:08.208261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:08.208261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:08.208261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:08.208261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:08.208261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:08.208261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:08.208261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:01:08.209150 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:01:08.209150 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:01:08.209150 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:01:08.209150 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 516/1060] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:01:08.214128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c32031-3904-4296-8c79-a0b258e6ccdc None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:08.269447 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:08.298396 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c3db5-5c67-4e1c-b253-9ee50828c3e1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:08.315203 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:08.326177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c32031-3904-4296-8c79-a0b258e6ccdc None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:08.332630 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d07a73-12d1-4856-adeb-f45d7db7444b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:08.333229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d07a73-12d1-4856-adeb-f45d7db7444b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:08.333528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d07a73-12d1-4856-adeb-f45d7db7444b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:08.333798 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d07a73-12d1-4856-adeb-f45d7db7444b None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:08.334427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d07a73-12d1-4856-adeb-f45d7db7444b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:08.334723 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d07a73-12d1-4856-adeb-f45d7db7444b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:08.336082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d07a73-12d1-4856-adeb-f45d7db7444b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:08.348439 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 545/1061] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:08.349641 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d8161-a882-4b60-92aa-03a2730feaf7 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:08.349924 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d8161-a882-4b60-92aa-03a2730feaf7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:08.350198 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d8161-a882-4b60-92aa-03a2730feaf7 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:08.351654 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 546/1062] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:08.354009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d8161-a882-4b60-92aa-03a2730feaf7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:08.363560 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d4c08-4ae2-4a58-9fcd-4d20581baece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:08.364173 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d4c08-4ae2-4a58-9fcd-4d20581baece None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:08.364454 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d4c08-4ae2-4a58-9fcd-4d20581baece None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:08.364728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d4c08-4ae2-4a58-9fcd-4d20581baece None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:08.365371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d4c08-4ae2-4a58-9fcd-4d20581baece None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:08.365712 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d4c08-4ae2-4a58-9fcd-4d20581baece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:08.367087 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d4c08-4ae2-4a58-9fcd-4d20581baece None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:08.379357 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 517/1063] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:08.380837 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75cc13-f4b6-4389-b2f9-76a443ba7cf1 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:08.381122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75cc13-f4b6-4389-b2f9-76a443ba7cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:08.381397 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75cc13-f4b6-4389-b2f9-76a443ba7cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:08.403954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-8d75cc13-f4b6-4389-b2f9-76a443ba7cf1 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:08.405190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8d75cc13-f4b6-4389-b2f9-76a443ba7cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:08.548761 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 518/1064] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:08.560039 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d8161-a882-4b60-92aa-03a2730feaf7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:08.573148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75cc13-f4b6-4389-b2f9-76a443ba7cf1 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:08.604940 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c7450-e3c8-43ae-bf9e-ec4f12d38ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:08.606207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c7450-e3c8-43ae-bf9e-ec4f12d38ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:08.606958 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c7450-e3c8-43ae-bf9e-ec4f12d38ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:08.606958 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c7450-e3c8-43ae-bf9e-ec4f12d38ba2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:08.614319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c7450-e3c8-43ae-bf9e-ec4f12d38ba2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:08.616245 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c7450-e3c8-43ae-bf9e-ec4f12d38ba2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:08.620339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:08.628457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-cc8c7450-e3c8-43ae-bf9e-ec4f12d38ba2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 19:01:08.628457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:08.628457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:08.628457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:08.628457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:08.628457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:08.628457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:08.628457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:08.628457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:08.628457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:08.628457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:08.628457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:08.628457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:01:08.628457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:01:08.628457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:01:08.628457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:01:08.635308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:08.635308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:08.635308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:01:08.635308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:01:08.635308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:01:08.635308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:01:08.635308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:08.635308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:08.635308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:08.635308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:08.635308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:08.635308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:08.635308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:08.635308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:08.635308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:08.635308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:08.635308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:08.635308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:08.636812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:08.636812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:08.636812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:01:08.636812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:01:08.636812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:01:08.636812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:01:08.636812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:01:08.636812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:01:08.636812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 19:01:08.636812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:08.636812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 547/1065] 10.222.0.65 () {56 vars in 1093 bytes} [Tue Aug 9 19:01:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:01:08.638495 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c7450-e3c8-43ae-bf9e-ec4f12d38ba2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:08.680611 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:08.687321 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75cc13-f4b6-4389-b2f9-76a443ba7cf1 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:08.723211 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca389112-9537-475e-88be-5d513a9dc09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:08.723832 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca389112-9537-475e-88be-5d513a9dc09d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:08.724111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca389112-9537-475e-88be-5d513a9dc09d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:08.724380 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca389112-9537-475e-88be-5d513a9dc09d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:08.734236 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca389112-9537-475e-88be-5d513a9dc09d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:01:08.738845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-ca389112-9537-475e-88be-5d513a9dc09d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:01:08.738845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:08.738845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:08.738845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:08.738845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:08.738845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:08.738845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:08.738845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:08.738845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:08.738845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:08.738845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:08.738845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:08.738845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:01:08.738845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:01:08.738845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:01:08.738845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:01:08.739907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:01:08.739907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:01:08.739907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:01:08.739907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:01:08.739907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:08.739907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:08.739907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:08.739907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:08.739907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:08.739907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:08.739907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:08.739907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:08.739907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:08.739907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:08.739907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:08.739907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:08.740755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:08.740755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:08.740755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:08.740755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:08.740755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:01:08.740755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:01:08.740755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:01:08.740755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:01:08.740755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:01:08.740755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:01:08.740755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:01:08.740755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:01:08.740755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 519/1066] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:01:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:01:08.746458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca389112-9537-475e-88be-5d513a9dc09d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:08.748079 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c7450-e3c8-43ae-bf9e-ec4f12d38ba2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:08.782438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e801c85-892f-4c41-8213-444e0947ce3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:08.783042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e801c85-892f-4c41-8213-444e0947ce3d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:08.783321 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e801c85-892f-4c41-8213-444e0947ce3d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:08.783592 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e801c85-892f-4c41-8213-444e0947ce3d None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:08.784317 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e801c85-892f-4c41-8213-444e0947ce3d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:08.784626 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e801c85-892f-4c41-8213-444e0947ce3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:08.786104 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e801c85-892f-4c41-8213-444e0947ce3d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:08.802872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 548/1067] 10.222.0.65 () {56 vars in 1133 bytes} [Tue Aug 9 19:01:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:08.808695 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e801c85-892f-4c41-8213-444e0947ce3d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:08.845341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:08.849113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca389112-9537-475e-88be-5d513a9dc09d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:08.882966 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd8661-7533-4c48-a776-806023367f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:08.883565 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd8661-7533-4c48-a776-806023367f84 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:08.883843 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd8661-7533-4c48-a776-806023367f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:08.884110 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd8661-7533-4c48-a776-806023367f84 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:08.884763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd8661-7533-4c48-a776-806023367f84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:08.885061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd8661-7533-4c48-a776-806023367f84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:08.887009 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd8661-7533-4c48-a776-806023367f84 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:08.894901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 520/1068] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:01:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:08.900536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd8661-7533-4c48-a776-806023367f84 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:08.903327 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:08.909957 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e801c85-892f-4c41-8213-444e0947ce3d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:08.944264 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13a6c5-b349-491b-9bac-446a0cdb5c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:08.944878 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a6c5-b349-491b-9bac-446a0cdb5c5b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:08.945152 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a6c5-b349-491b-9bac-446a0cdb5c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:08.945420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a6c5-b349-491b-9bac-446a0cdb5c5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:08.955383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13a6c5-b349-491b-9bac-446a0cdb5c5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:08.956830 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13a6c5-b349-491b-9bac-446a0cdb5c5b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:08.971563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ca13a6c5-b349-491b-9bac-446a0cdb5c5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:01:08.971563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:08.971563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:08.971563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:08.971563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:08.971563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:08.971563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:08.971563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:08.971563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:08.971563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:08.971563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:08.971563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:08.971563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:01:08.971563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:01:08.971563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:01:08.971563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:01:08.972764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:08.972764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:08.972764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:08.972764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:08.972764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:08.972764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:08.972764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:08.972764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:08.972764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:08.972764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:08.972764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:08.972764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:08.972764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:08.972764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:08.972764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:08.972764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:08.972764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:01:08.973729 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:01:08.973729 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:01:08.973729 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:08.973729 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 549/1069] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:01:08.978213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13a6c5-b349-491b-9bac-446a0cdb5c5b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:09.003047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd8661-7533-4c48-a776-806023367f84 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:09.037712 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71288fc-aacd-4035-bcd4-a5d5fcfb1c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:09.038634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71288fc-aacd-4035-bcd4-a5d5fcfb1c77 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:09.039080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71288fc-aacd-4035-bcd4-a5d5fcfb1c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:09.039474 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71288fc-aacd-4035-bcd4-a5d5fcfb1c77 None admin] PATH_INFO: `/v3/users/a7a1fdc3b3694d63aa0aeb39b48a59d3` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:09.059492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71288fc-aacd-4035-bcd4-a5d5fcfb1c77 None admin] RBAC: Authorizing `identity:get_user(user_id=a7a1fdc3b3694d63aa0aeb39b48a59d3)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:09.061040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71288fc-aacd-4035-bcd4-a5d5fcfb1c77 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:09.062826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 521/1070] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 19:01:08 2022] GET /identity/v3/users/a7a1fdc3b3694d63aa0aeb39b48a59d3 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:09.068591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71288fc-aacd-4035-bcd4-a5d5fcfb1c77 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:09.082922 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13a6c5-b349-491b-9bac-446a0cdb5c5b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:09.086984 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:09.117025 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3cf05-54df-47a5-954f-89577d2135a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:09.117707 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3cf05-54df-47a5-954f-89577d2135a8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:09.117979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3cf05-54df-47a5-954f-89577d2135a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:09.118247 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3cf05-54df-47a5-954f-89577d2135a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:09.118882 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3cf05-54df-47a5-954f-89577d2135a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:09.119183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3cf05-54df-47a5-954f-89577d2135a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:09.120535 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3cf05-54df-47a5-954f-89577d2135a8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:09.132899 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 550/1071] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:09.138667 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3cf05-54df-47a5-954f-89577d2135a8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:09.146739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:09.172632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71288fc-aacd-4035-bcd4-a5d5fcfb1c77 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:09.207118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a43bd-53a9-4aba-aa24-8b8b21c986d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:09.207955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a43bd-53a9-4aba-aa24-8b8b21c986d6 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:09.208238 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a43bd-53a9-4aba-aa24-8b8b21c986d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:09.208517 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a43bd-53a9-4aba-aa24-8b8b21c986d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:09.237649 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3cf05-54df-47a5-954f-89577d2135a8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:09.272757 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4403709-bd9a-43a3-bca6-3988d608c1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:09.273383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4403709-bd9a-43a3-bca6-3988d608c1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:09.273703 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4403709-bd9a-43a3-bca6-3988d608c1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:09.273981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4403709-bd9a-43a3-bca6-3988d608c1f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:09.276284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a43bd-53a9-4aba-aa24-8b8b21c986d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:09.278900 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a43bd-53a9-4aba-aa24-8b8b21c986d6 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:09.282032 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4403709-bd9a-43a3-bca6-3988d608c1f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:09.282804 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4403709-bd9a-43a3-bca6-3988d608c1f4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:09.294143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-e4403709-bd9a-43a3-bca6-3988d608c1f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:01:09.294143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:09.294143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:09.294143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:09.294143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:09.294143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:09.294143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:09.294143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:09.294143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:09.294143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:09.294143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:09.294143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:09.294143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:01:09.294143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:01:09.294143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:01:09.295209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:01:09.295209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:09.295209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:09.295209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:09.295209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:09.295209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:09.295209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:09.295209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:09.295209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:09.295209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:09.295209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:09.295209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:09.295209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:09.295209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:09.295209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:09.295209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:09.295209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:09.296461 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:01:09.296461 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:01:09.296461 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:01:09.296461 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:01:09.296461 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:01:09.296461 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:01:09.296461 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:01:09.296461 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:09.296461 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 551/1072] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:01:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:01:09.299336 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:09.300964 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4403709-bd9a-43a3-bca6-3988d608c1f4 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:09.364809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:09.379416 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 522/1073] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:01:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:01:09.385609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a43bd-53a9-4aba-aa24-8b8b21c986d6 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:09.400823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4403709-bd9a-43a3-bca6-3988d608c1f4 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:09.434670 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88de1f-55fb-44a3-9290-d447665553a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:09.435278 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88de1f-55fb-44a3-9290-d447665553a1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:09.435558 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88de1f-55fb-44a3-9290-d447665553a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:09.435832 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88de1f-55fb-44a3-9290-d447665553a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:09.436529 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88de1f-55fb-44a3-9290-d447665553a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:09.436832 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88de1f-55fb-44a3-9290-d447665553a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:09.438295 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88de1f-55fb-44a3-9290-d447665553a1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:09.450246 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 552/1074] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:01:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:09.456082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88de1f-55fb-44a3-9290-d447665553a1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:09.482141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a43bd-53a9-4aba-aa24-8b8b21c986d6 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:09.498879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:09.521952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2a5b7-f541-4b11-a847-2c03795d91f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:09.522595 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2a5b7-f541-4b11-a847-2c03795d91f0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:09.522874 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2a5b7-f541-4b11-a847-2c03795d91f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:09.523148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2a5b7-f541-4b11-a847-2c03795d91f0 None admin] PATH_INFO: `/v3/projects/57154af475b94a4e9002dd9f0d01559b` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:09.524266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2a5b7-f541-4b11-a847-2c03795d91f0 None admin] RBAC: Authorizing `identity:get_project(project_id=57154af475b94a4e9002dd9f0d01559b)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:09.525821 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2a5b7-f541-4b11-a847-2c03795d91f0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:09.528058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 523/1075] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 19:01:09 2022] GET /identity/v3/projects/57154af475b94a4e9002dd9f0d01559b => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:09.534136 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2a5b7-f541-4b11-a847-2c03795d91f0 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:09.556005 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88de1f-55fb-44a3-9290-d447665553a1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:09.580802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:09.589170 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27789ce-3ab7-42d9-99f7-c8198d84dbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:09.590382 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27789ce-3ab7-42d9-99f7-c8198d84dbe7 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:09.590658 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27789ce-3ab7-42d9-99f7-c8198d84dbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:09.590930 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27789ce-3ab7-42d9-99f7-c8198d84dbe7 None admin] PATH_INFO: `/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/2cfda1bec35145f3bbcc13fae0b7af2e/roles/8ea36b65594142ceb8ea960aa371c2e3` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:09.593153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27789ce-3ab7-42d9-99f7-c8198d84dbe7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user_id=2cfda1bec35145f3bbcc13fae0b7af2e, role_id=8ea36b65594142ceb8ea960aa371c2e3)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:09.594634 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27789ce-3ab7-42d9-99f7-c8198d84dbe7 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:09.631768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2a5b7-f541-4b11-a847-2c03795d91f0 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:09.665394 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae0312-9b9b-44a3-8992-8f53a06ae303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:09.666026 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae0312-9b9b-44a3-8992-8f53a06ae303 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:09.666302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae0312-9b9b-44a3-8992-8f53a06ae303 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:09.666571 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae0312-9b9b-44a3-8992-8f53a06ae303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:09.667280 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae0312-9b9b-44a3-8992-8f53a06ae303 None admin] RBAC: Adding query filter params (role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.project.id=57154af475b94a4e9002dd9f0d01559b, user.id=a7a1fdc3b3694d63aa0aeb39b48a59d3) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:09.667477 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 553/1076] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 19:01:09 2022] PUT /identity/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/2cfda1bec35145f3bbcc13fae0b7af2e/roles/8ea36b65594142ceb8ea960aa371c2e3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:01:09.668170 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae0312-9b9b-44a3-8992-8f53a06ae303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:09.669771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae0312-9b9b-44a3-8992-8f53a06ae303 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:09.675566 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 524/1077] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:01:09 2022] GET /identity/v3/role_assignments?user.id=a7a1fdc3b3694d63aa0aeb39b48a59d3&scope.project.id=57154af475b94a4e9002dd9f0d01559b&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:11.661895 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be7b2a-8d69-4948-839b-2197914f44d4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:11.662419 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be7b2a-8d69-4948-839b-2197914f44d4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:11.662419 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be7b2a-8d69-4948-839b-2197914f44d4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:11.663898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 554/1078] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:11.669421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13a178-d2b4-4739-b15e-9c9e53c8904b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:11.669825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13a178-d2b4-4739-b15e-9c9e53c8904b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:11.669993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13a178-d2b4-4739-b15e-9c9e53c8904b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:11.683256 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a0904-71c8-480f-b729-1d456e5264e0 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:11.683536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a0904-71c8-480f-b729-1d456e5264e0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:11.683812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a0904-71c8-480f-b729-1d456e5264e0 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:11.685104 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 555/1079] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:01:11.687855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3b13a178-d2b4-4739-b15e-9c9e53c8904b None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:11.689110 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3b13a178-d2b4-4739-b15e-9c9e53c8904b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:11.690054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b7aa4-1fb0-4037-b6a5-d8d1414a8fab None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:11.690346 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b7aa4-1fb0-4037-b6a5-d8d1414a8fab None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:11.690612 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b7aa4-1fb0-4037-b6a5-d8d1414a8fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:11.708440 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-212b7aa4-1fb0-4037-b6a5-d8d1414a8fab None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:11.709661 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-212b7aa4-1fb0-4037-b6a5-d8d1414a8fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:11.736212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:11.756875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 525/1080] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:11.775284 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 556/1081] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 19:01:11.779775 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13a178-d2b4-4739-b15e-9c9e53c8904b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:11.798124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b7aa4-1fb0-4037-b6a5-d8d1414a8fab None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:11.876885 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13a178-d2b4-4739-b15e-9c9e53c8904b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:11.893353 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b7aa4-1fb0-4037-b6a5-d8d1414a8fab None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:11.909281 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:11.911017 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc541c-7c05-47c2-a82b-f1c2452f1f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:11.911669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc541c-7c05-47c2-a82b-f1c2452f1f32 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:11.911948 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc541c-7c05-47c2-a82b-f1c2452f1f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:11.912221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc541c-7c05-47c2-a82b-f1c2452f1f32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:11.922126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc541c-7c05-47c2-a82b-f1c2452f1f32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:01:11.926389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace8e81-fbb1-4a74-a420-173c066a2c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:11.926859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-64cc541c-7c05-47c2-a82b-f1c2452f1f32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:01:11.926859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:11.926859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:11.926859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:11.926859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:11.926859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:11.926859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:11.926859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:11.926859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:11.926859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:11.926859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:11.926859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:11.926859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:01:11.926859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:01:11.926859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:01:11.926859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:01:11.928003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:01:11.928003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:01:11.928003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:01:11.928003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:01:11.928003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:11.928003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:11.928003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:11.928003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:11.928003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:11.928003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:11.928003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:11.928003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:11.928003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:11.928003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:11.928003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:11.928003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:11.928869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:11.928869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:11.928869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:11.928869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:11.928869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:01:11.928869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:01:11.928869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:01:11.928869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:01:11.928869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:01:11.928869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:01:11.928869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:01:11.928869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:01:11.929571 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace8e81-fbb1-4a74-a420-173c066a2c7c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:11.929571 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace8e81-fbb1-4a74-a420-173c066a2c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:11.929571 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace8e81-fbb1-4a74-a420-173c066a2c7c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:11.929752 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 526/1082] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:01:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:01:11.934627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc541c-7c05-47c2-a82b-f1c2452f1f32 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:11.944457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace8e81-fbb1-4a74-a420-173c066a2c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:01:11.950021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-7ace8e81-fbb1-4a74-a420-173c066a2c7c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 19:01:11.950021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:11.950021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:11.950021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:11.950021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:11.950021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:11.950021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:11.950021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:11.950021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:11.950021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:11.950021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:11.950021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:11.950021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:01:11.950021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:01:11.950021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:01:11.950021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:01:11.953202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:01:11.953202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:01:11.953202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:01:11.953202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:01:11.953202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:11.953202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:11.953202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:11.953202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:11.953202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:11.953202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:11.953202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:11.953202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:11.953202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:11.953202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:11.953202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:11.953202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:11.954093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:11.954093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:11.954093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:11.954093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:11.954093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:01:11.954093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:01:11.954093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:01:11.954093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:01:11.954093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:01:11.954093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:01:11.954093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 19:01:11.954093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:11.954093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 557/1083] 10.222.0.65 () {56 vars in 1120 bytes} [Tue Aug 9 19:01:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:01:11.956975 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace8e81-fbb1-4a74-a420-173c066a2c7c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:11.976187 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:12.034150 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc541c-7c05-47c2-a82b-f1c2452f1f32 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:12.056951 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace8e81-fbb1-4a74-a420-173c066a2c7c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:12.069040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a3d9f-50ad-4c3c-91ff-4b290c4ecf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:12.069678 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a3d9f-50ad-4c3c-91ff-4b290c4ecf72 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:12.069958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a3d9f-50ad-4c3c-91ff-4b290c4ecf72 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:12.070228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a3d9f-50ad-4c3c-91ff-4b290c4ecf72 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:12.070891 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a3d9f-50ad-4c3c-91ff-4b290c4ecf72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:12.071193 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a3d9f-50ad-4c3c-91ff-4b290c4ecf72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:12.072550 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a3d9f-50ad-4c3c-91ff-4b290c4ecf72 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:12.080966 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 527/1084] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:01:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:12.086644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a3d9f-50ad-4c3c-91ff-4b290c4ecf72 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:12.090296 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a9dda-5978-47c4-9e3a-ca191f8e7b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:12.090892 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a9dda-5978-47c4-9e3a-ca191f8e7b1c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:12.091163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a9dda-5978-47c4-9e3a-ca191f8e7b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:12.091431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a9dda-5978-47c4-9e3a-ca191f8e7b1c None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:12.092082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a9dda-5978-47c4-9e3a-ca191f8e7b1c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:12.092382 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a9dda-5978-47c4-9e3a-ca191f8e7b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:12.093755 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a9dda-5978-47c4-9e3a-ca191f8e7b1c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:12.105809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 558/1085] 10.222.0.65 () {56 vars in 1115 bytes} [Tue Aug 9 19:01:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:12.108098 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a9dda-5978-47c4-9e3a-ca191f8e7b1c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:12.145799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:12.188780 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a3d9f-50ad-4c3c-91ff-4b290c4ecf72 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:12.190366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:12.207759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a9dda-5978-47c4-9e3a-ca191f8e7b1c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:12.221730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdd8ad-082e-4563-b72e-66fefe0efd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:12.222707 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdd8ad-082e-4563-b72e-66fefe0efd4e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:12.223428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdd8ad-082e-4563-b72e-66fefe0efd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:12.223700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdd8ad-082e-4563-b72e-66fefe0efd4e None admin] PATH_INFO: `/v3/users/a7a1fdc3b3694d63aa0aeb39b48a59d3` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:12.224834 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdd8ad-082e-4563-b72e-66fefe0efd4e None admin] RBAC: Authorizing `identity:get_user(user_id=a7a1fdc3b3694d63aa0aeb39b48a59d3)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:12.226305 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdd8ad-082e-4563-b72e-66fefe0efd4e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:12.228038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 528/1086] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 19:01:12 2022] GET /identity/v3/users/a7a1fdc3b3694d63aa0aeb39b48a59d3 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:12.234070 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdd8ad-082e-4563-b72e-66fefe0efd4e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:12.242405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc71b1-c0fe-40cf-8d11-720dc2b17f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:12.243026 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc71b1-c0fe-40cf-8d11-720dc2b17f08 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:12.243302 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc71b1-c0fe-40cf-8d11-720dc2b17f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:12.243587 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc71b1-c0fe-40cf-8d11-720dc2b17f08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:12.254444 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc71b1-c0fe-40cf-8d11-720dc2b17f08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:12.256162 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc71b1-c0fe-40cf-8d11-720dc2b17f08 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:12.270369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-63fc71b1-c0fe-40cf-8d11-720dc2b17f08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:01:12.270369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:12.270369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:12.270369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:12.270369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:12.270369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:12.270369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:12.270369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:12.270369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:12.270369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:12.270369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:12.270369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:12.270369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:01:12.270369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:01:12.270369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:01:12.270369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:01:12.273973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:12.273973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:12.273973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:12.273973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:12.273973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:12.273973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:12.273973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:12.273973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:12.273973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:12.273973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:12.273973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:12.273973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:12.273973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:12.273973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:12.273973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:12.273973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:12.273973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:01:12.274882 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:01:12.274882 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:01:12.274882 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:12.274882 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 559/1087] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:01:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:01:12.277783 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc71b1-c0fe-40cf-8d11-720dc2b17f08 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:12.331886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdd8ad-082e-4563-b72e-66fefe0efd4e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:12.364707 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33162c49-1dfd-43fd-ad40-b8e406f69b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:12.365325 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33162c49-1dfd-43fd-ad40-b8e406f69b69 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:12.365633 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33162c49-1dfd-43fd-ad40-b8e406f69b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:12.365904 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33162c49-1dfd-43fd-ad40-b8e406f69b69 None admin] PATH_INFO: `/v3/projects/57154af475b94a4e9002dd9f0d01559b` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:12.366411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:12.367000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33162c49-1dfd-43fd-ad40-b8e406f69b69 None admin] RBAC: Authorizing `identity:get_project(project_id=57154af475b94a4e9002dd9f0d01559b)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:12.368425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33162c49-1dfd-43fd-ad40-b8e406f69b69 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:12.370076 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 529/1088] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 19:01:12 2022] GET /identity/v3/projects/57154af475b94a4e9002dd9f0d01559b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:12.376378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc71b1-c0fe-40cf-8d11-720dc2b17f08 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:12.380956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33162c49-1dfd-43fd-ad40-b8e406f69b69 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:12.410633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34618c3-f886-4549-8d89-6269c27dd196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:12.411237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34618c3-f886-4549-8d89-6269c27dd196 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:12.411514 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34618c3-f886-4549-8d89-6269c27dd196 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:12.411790 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34618c3-f886-4549-8d89-6269c27dd196 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:12.412428 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34618c3-f886-4549-8d89-6269c27dd196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:12.412728 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34618c3-f886-4549-8d89-6269c27dd196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:12.414121 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34618c3-f886-4549-8d89-6269c27dd196 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:12.416786 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:12.429944 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 560/1089] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:12.430914 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34618c3-f886-4549-8d89-6269c27dd196 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:12.476503 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33162c49-1dfd-43fd-ad40-b8e406f69b69 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:12.510965 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832a380-0b4b-437f-bf63-fe6628eb381b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:12.511705 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832a380-0b4b-437f-bf63-fe6628eb381b None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:12.511982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832a380-0b4b-437f-bf63-fe6628eb381b None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:12.512239 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832a380-0b4b-437f-bf63-fe6628eb381b None admin] PATH_INFO: `/v3/projects/57154af475b94a4e9002dd9f0d01559b/users/a7a1fdc3b3694d63aa0aeb39b48a59d3/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:12.514183 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832a380-0b4b-437f-bf63-fe6628eb381b None admin] RBAC: Authorizing `identity:create_grant(project_id=57154af475b94a4e9002dd9f0d01559b, user_id=a7a1fdc3b3694d63aa0aeb39b48a59d3, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:12.515599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832a380-0b4b-437f-bf63-fe6628eb381b None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:12.533751 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34618c3-f886-4549-8d89-6269c27dd196 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:12.567372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3ffe7-08b6-4c4a-8ea5-fd99bd97b9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:12.567993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3ffe7-08b6-4c4a-8ea5-fd99bd97b9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:12.568274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3ffe7-08b6-4c4a-8ea5-fd99bd97b9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:12.568549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3ffe7-08b6-4c4a-8ea5-fd99bd97b9b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:12.575574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3ffe7-08b6-4c4a-8ea5-fd99bd97b9b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:12.577071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3ffe7-08b6-4c4a-8ea5-fd99bd97b9b1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:12.581680 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 530/1090] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 19:01:12 2022] PUT /identity/v3/projects/57154af475b94a4e9002dd9f0d01559b/users/a7a1fdc3b3694d63aa0aeb39b48a59d3/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:01:12.588815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-c6f3ffe7-08b6-4c4a-8ea5-fd99bd97b9b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 19:01:12.588815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:12.588815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:12.588815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:12.588815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:12.588815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:12.588815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:12.588815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:12.588815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:12.588815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:12.588815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:12.588815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:12.588815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:01:12.588815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:01:12.588815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:01:12.588815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:01:12.590676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:12.590676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:12.590676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:01:12.590676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:01:12.590676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:01:12.590676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:01:12.590676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:12.590676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:12.590676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:12.590676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:12.590676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:12.590676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:12.590676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:12.590676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:12.590676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:12.590676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:12.590676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:12.590676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:12.591792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:12.591792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:12.591792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:01:12.591792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:01:12.591792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:01:12.591792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:01:12.591792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:01:12.591792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:01:12.591792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 19:01:12.591792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:12.591792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 561/1091] 10.222.0.65 () {56 vars in 1093 bytes} [Tue Aug 9 19:01:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:01:12.598087 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832a380-0b4b-437f-bf63-fe6628eb381b None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:12.702031 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:12.705978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832a380-0b4b-437f-bf63-fe6628eb381b None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:12.741943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde877c0-69b5-4b06-9b8b-3c9bb823214a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:12.743481 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde877c0-69b5-4b06-9b8b-3c9bb823214a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:12.743481 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde877c0-69b5-4b06-9b8b-3c9bb823214a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:12.743481 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde877c0-69b5-4b06-9b8b-3c9bb823214a None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:12.743749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde877c0-69b5-4b06-9b8b-3c9bb823214a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:12.743980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde877c0-69b5-4b06-9b8b-3c9bb823214a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:12.745399 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde877c0-69b5-4b06-9b8b-3c9bb823214a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:12.762797 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 531/1092] 10.222.0.65 () {56 vars in 1133 bytes} [Tue Aug 9 19:01:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:12.768754 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3ffe7-08b6-4c4a-8ea5-fd99bd97b9b1 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:12.781844 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:12.867625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3ffe7-08b6-4c4a-8ea5-fd99bd97b9b1 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:12.900916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb28850-0179-435a-928e-9051d88203ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:12.901553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb28850-0179-435a-928e-9051d88203ca None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:12.902400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb28850-0179-435a-928e-9051d88203ca None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:12.902669 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb28850-0179-435a-928e-9051d88203ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:12.968187 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb28850-0179-435a-928e-9051d88203ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:12.969656 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb28850-0179-435a-928e-9051d88203ca None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:12.981129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:13.068531 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 562/1093] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:01:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:01:13.074419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde877c0-69b5-4b06-9b8b-3c9bb823214a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:13.170803 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde877c0-69b5-4b06-9b8b-3c9bb823214a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:13.203862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11874d-13a4-4a0f-85d8-0fbbc246df7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:13.204493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11874d-13a4-4a0f-85d8-0fbbc246df7c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:13.204771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11874d-13a4-4a0f-85d8-0fbbc246df7c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:13.205041 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11874d-13a4-4a0f-85d8-0fbbc246df7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:13.215466 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11874d-13a4-4a0f-85d8-0fbbc246df7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:13.216908 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11874d-13a4-4a0f-85d8-0fbbc246df7c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:13.231741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-2c11874d-13a4-4a0f-85d8-0fbbc246df7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:01:13.231741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:13.231741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:13.231741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:13.231741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:13.231741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:13.231741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:13.231741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:13.231741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:13.231741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:13.231741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:13.231741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:13.231741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:01:13.231741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:01:13.231741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:01:13.231741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:01:13.240271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:13.240271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:13.240271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:13.240271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:13.240271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:13.240271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:13.240271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:13.240271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:13.240271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:13.240271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:13.240271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:13.240271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:13.240271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:13.240271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:13.240271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:13.240271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:13.240271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:01:13.241154 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:01:13.241154 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:01:13.241154 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:01:13.241154 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 532/1094] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:01:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:01:13.241396 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb28850-0179-435a-928e-9051d88203ca None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:13.336009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb28850-0179-435a-928e-9051d88203ca None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:13.347682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:13.371306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b51a8-88bc-4f9b-adce-db0fbe711380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:13.371950 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b51a8-88bc-4f9b-adce-db0fbe711380 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:13.372232 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b51a8-88bc-4f9b-adce-db0fbe711380 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:13.372505 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b51a8-88bc-4f9b-adce-db0fbe711380 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:13.373142 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b51a8-88bc-4f9b-adce-db0fbe711380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:13.373445 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b51a8-88bc-4f9b-adce-db0fbe711380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:13.374897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b51a8-88bc-4f9b-adce-db0fbe711380 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:13.386740 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 563/1095] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:13.392437 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11874d-13a4-4a0f-85d8-0fbbc246df7c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:13.404017 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:13.490483 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11874d-13a4-4a0f-85d8-0fbbc246df7c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:13.523946 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f49ca-a6f4-498a-a242-ab3ff876e87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:13.524576 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f49ca-a6f4-498a-a242-ab3ff876e87e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:13.524852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f49ca-a6f4-498a-a242-ab3ff876e87e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:13.525121 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f49ca-a6f4-498a-a242-ab3ff876e87e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:13.532137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f49ca-a6f4-498a-a242-ab3ff876e87e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:13.533617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f49ca-a6f4-498a-a242-ab3ff876e87e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:13.545023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-138f49ca-a6f4-498a-a242-ab3ff876e87e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:01:13.545023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:13.545023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:13.545023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:13.545023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:13.545023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:13.545023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:13.545023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:13.545023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:13.545023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:13.545023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:13.545023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:13.545023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:01:13.545023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:01:13.545023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:01:13.546123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:01:13.546123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:13.546123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:13.546123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:13.546123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:13.546123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:13.546123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:13.546123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:13.546123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:13.546123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:13.546123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:13.546123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:13.546123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:13.546123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:13.546123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:13.546123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:13.546123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:13.547039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:01:13.547039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:01:13.547039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:01:13.547039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:01:13.547039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:01:13.547039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:01:13.547039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:01:13.547039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:01:13.547039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 533/1096] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:01:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:01:13.551895 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b51a8-88bc-4f9b-adce-db0fbe711380 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:13.648505 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b51a8-88bc-4f9b-adce-db0fbe711380 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:13.682394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bd2f4-0d85-4c25-8ba8-322435ea9fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:13.683090 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bd2f4-0d85-4c25-8ba8-322435ea9fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:13.683366 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bd2f4-0d85-4c25-8ba8-322435ea9fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:13.683631 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bd2f4-0d85-4c25-8ba8-322435ea9fe3 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:13.684322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bd2f4-0d85-4c25-8ba8-322435ea9fe3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:13.684628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bd2f4-0d85-4c25-8ba8-322435ea9fe3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:13.686112 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bd2f4-0d85-4c25-8ba8-322435ea9fe3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:13.698229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 564/1097] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:01:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:13.704907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f49ca-a6f4-498a-a242-ab3ff876e87e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:13.769581 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:13.801392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f49ca-a6f4-498a-a242-ab3ff876e87e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:13.834293 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d1408-4391-4a7e-9980-7cf3f916b8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:13.834888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d1408-4391-4a7e-9980-7cf3f916b8fb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:13.835164 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d1408-4391-4a7e-9980-7cf3f916b8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:13.835428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d1408-4391-4a7e-9980-7cf3f916b8fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:13.836132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d1408-4391-4a7e-9980-7cf3f916b8fb None admin] RBAC: Adding query filter params (role.id=8ea36b65594142ceb8ea960aa371c2e3, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=2cfda1bec35145f3bbcc13fae0b7af2e) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:13.836434 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d1408-4391-4a7e-9980-7cf3f916b8fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:13.837912 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d1408-4391-4a7e-9980-7cf3f916b8fb None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:13.843833 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 534/1098] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:01:13 2022] GET /identity/v3/role_assignments?user.id=2cfda1bec35145f3bbcc13fae0b7af2e&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=8ea36b65594142ceb8ea960aa371c2e3 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:14.577735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c47a8-2cc5-4cd7-9883-1b9296619660 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:14.578286 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c47a8-2cc5-4cd7-9883-1b9296619660 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:14.578286 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c47a8-2cc5-4cd7-9883-1b9296619660 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:14.579634 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 565/1099] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:14.584933 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959aa8b6-03b2-431b-880b-79f30c8299bc None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:14.585226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959aa8b6-03b2-431b-880b-79f30c8299bc None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:14.585532 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959aa8b6-03b2-431b-880b-79f30c8299bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:14.604395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-959aa8b6-03b2-431b-880b-79f30c8299bc None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:14.605766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-959aa8b6-03b2-431b-880b-79f30c8299bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:14.673364 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 535/1100] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:14.696508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c47a8-2cc5-4cd7-9883-1b9296619660 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:14.726548 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:14.797203 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c47a8-2cc5-4cd7-9883-1b9296619660 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:14.830282 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a522e4-b0ff-445b-8ef0-50e86899c54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:14.830894 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a522e4-b0ff-445b-8ef0-50e86899c54c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:14.831172 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a522e4-b0ff-445b-8ef0-50e86899c54c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:14.831443 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a522e4-b0ff-445b-8ef0-50e86899c54c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:14.841534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a522e4-b0ff-445b-8ef0-50e86899c54c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:01:14.846136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-01a522e4-b0ff-445b-8ef0-50e86899c54c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:01:14.846136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:14.846136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:14.846136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:14.846136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:14.846136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:14.846136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:14.846136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:14.846136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:14.846136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:14.846136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:14.846136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:14.846136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:01:14.846136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:01:14.846136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:01:14.846136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:01:14.847207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:01:14.847207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:01:14.847207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:01:14.847207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:01:14.847207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:14.847207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:14.847207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:14.847207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:14.847207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:14.847207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:14.847207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:14.847207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:14.847207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:14.847207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:14.847207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:14.847207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:14.848389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:14.848389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:14.848389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:14.848389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:14.848389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:01:14.848389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:01:14.848389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:01:14.848389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:01:14.848389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:01:14.848389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:01:14.848389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:01:14.848389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:14.848389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 566/1101] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:01:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:01:14.853157 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959aa8b6-03b2-431b-880b-79f30c8299bc None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:14.912377 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:14.949631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959aa8b6-03b2-431b-880b-79f30c8299bc None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:14.981397 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9387fba-f289-44c2-81ac-0a7e56366e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:14.982021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9387fba-f289-44c2-81ac-0a7e56366e09 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:14.982300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9387fba-f289-44c2-81ac-0a7e56366e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:14.982570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9387fba-f289-44c2-81ac-0a7e56366e09 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:14.983226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9387fba-f289-44c2-81ac-0a7e56366e09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:14.983527 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9387fba-f289-44c2-81ac-0a7e56366e09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:14.984884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9387fba-f289-44c2-81ac-0a7e56366e09 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:14.992532 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 536/1102] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:01:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:14.999322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a522e4-b0ff-445b-8ef0-50e86899c54c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:15.086099 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:15.095168 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a522e4-b0ff-445b-8ef0-50e86899c54c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:15.128475 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97766141-4643-4cc3-b5d2-bf8af6780dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:15.129089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97766141-4643-4cc3-b5d2-bf8af6780dff None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:15.129370 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97766141-4643-4cc3-b5d2-bf8af6780dff None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:15.129674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97766141-4643-4cc3-b5d2-bf8af6780dff None admin] PATH_INFO: `/v3/users/a7a1fdc3b3694d63aa0aeb39b48a59d3` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:15.131053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97766141-4643-4cc3-b5d2-bf8af6780dff None admin] RBAC: Authorizing `identity:get_user(user_id=a7a1fdc3b3694d63aa0aeb39b48a59d3)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:15.132474 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97766141-4643-4cc3-b5d2-bf8af6780dff None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:15.134060 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 567/1103] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 19:01:14 2022] GET /identity/v3/users/a7a1fdc3b3694d63aa0aeb39b48a59d3 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:15.139743 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9387fba-f289-44c2-81ac-0a7e56366e09 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:15.236157 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9387fba-f289-44c2-81ac-0a7e56366e09 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:15.258943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:15.269200 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed2208-d33a-4a36-8294-95b9e13edf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:15.271076 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed2208-d33a-4a36-8294-95b9e13edf99 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:15.271076 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed2208-d33a-4a36-8294-95b9e13edf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:15.271076 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed2208-d33a-4a36-8294-95b9e13edf99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:15.335787 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed2208-d33a-4a36-8294-95b9e13edf99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:15.337275 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed2208-d33a-4a36-8294-95b9e13edf99 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:15.431054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 537/1104] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:01:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:01:15.437748 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97766141-4643-4cc3-b5d2-bf8af6780dff None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:15.536279 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97766141-4643-4cc3-b5d2-bf8af6780dff None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:15.569386 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed6083-d398-41f4-b31b-3e3b4d1e2dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:15.570029 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed6083-d398-41f4-b31b-3e3b4d1e2dad None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:15.570314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed6083-d398-41f4-b31b-3e3b4d1e2dad None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:15.570592 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed6083-d398-41f4-b31b-3e3b4d1e2dad None admin] PATH_INFO: `/v3/projects/57154af475b94a4e9002dd9f0d01559b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:15.571711 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed6083-d398-41f4-b31b-3e3b4d1e2dad None admin] RBAC: Authorizing `identity:get_project(project_id=57154af475b94a4e9002dd9f0d01559b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:15.573143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed6083-d398-41f4-b31b-3e3b4d1e2dad None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:15.575146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 568/1105] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 19:01:15 2022] GET /identity/v3/projects/57154af475b94a4e9002dd9f0d01559b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:15.581217 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed2208-d33a-4a36-8294-95b9e13edf99 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:15.606155 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:15.677321 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed2208-d33a-4a36-8294-95b9e13edf99 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:15.709228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a0f8a-f5ea-451c-aff4-4dc48b0af0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:15.709845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a0f8a-f5ea-451c-aff4-4dc48b0af0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:15.710126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a0f8a-f5ea-451c-aff4-4dc48b0af0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:15.710395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a0f8a-f5ea-451c-aff4-4dc48b0af0d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:15.711104 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a0f8a-f5ea-451c-aff4-4dc48b0af0d0 None admin] RBAC: Adding query filter params (role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.project.id=57154af475b94a4e9002dd9f0d01559b, user.id=a7a1fdc3b3694d63aa0aeb39b48a59d3) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:15.711409 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a0f8a-f5ea-451c-aff4-4dc48b0af0d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:15.712819 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a0f8a-f5ea-451c-aff4-4dc48b0af0d0 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:15.719084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 538/1106] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:01:15 2022] GET /identity/v3/role_assignments?user.id=a7a1fdc3b3694d63aa0aeb39b48a59d3&scope.project.id=57154af475b94a4e9002dd9f0d01559b&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:17.768757 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5454f2-22bb-4bdf-afa3-8f7a01f72341 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:17.769285 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5454f2-22bb-4bdf-afa3-8f7a01f72341 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:17.769285 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5454f2-22bb-4bdf-afa3-8f7a01f72341 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:17.770586 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 569/1107] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:17.775848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7056c-f640-4f9a-a852-e6fa62a57278 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:17.776796 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7056c-f640-4f9a-a852-e6fa62a57278 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:17.776887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7056c-f640-4f9a-a852-e6fa62a57278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:17.794983 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f1b7056c-f640-4f9a-a852-e6fa62a57278 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:17.796160 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f1b7056c-f640-4f9a-a852-e6fa62a57278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:17.860989 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 539/1108] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:17.885009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5454f2-22bb-4bdf-afa3-8f7a01f72341 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:17.911481 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:17.982009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5454f2-22bb-4bdf-afa3-8f7a01f72341 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:18.014787 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d774ea-5eb4-40af-b929-bffcc499f3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:18.015399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d774ea-5eb4-40af-b929-bffcc499f3ab None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:18.015672 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d774ea-5eb4-40af-b929-bffcc499f3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:18.015939 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d774ea-5eb4-40af-b929-bffcc499f3ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:18.017029 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d774ea-5eb4-40af-b929-bffcc499f3ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:18.018499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d774ea-5eb4-40af-b929-bffcc499f3ab None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:18.020102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 570/1109] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:01:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:18.025857 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7056c-f640-4f9a-a852-e6fa62a57278 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:18.045036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:18.122072 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7056c-f640-4f9a-a852-e6fa62a57278 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:18.154486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39ef06-0b10-431c-a76d-537adc6c02bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:18.155073 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39ef06-0b10-431c-a76d-537adc6c02bb None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:18.155348 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39ef06-0b10-431c-a76d-537adc6c02bb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:18.155613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39ef06-0b10-431c-a76d-537adc6c02bb None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:18.156251 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39ef06-0b10-431c-a76d-537adc6c02bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:18.157682 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39ef06-0b10-431c-a76d-537adc6c02bb None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:18.238491 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 540/1110] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Aug 9 19:01:18 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:01:20.263650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b6759-2557-4cf2-9bfd-d4917420b88d None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:20.264190 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b6759-2557-4cf2-9bfd-d4917420b88d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:20.264190 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b6759-2557-4cf2-9bfd-d4917420b88d None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:20.265536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 571/1111] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:20.270576 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e529e-24da-40fb-9345-6f57ff0fe6d8 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:20.270992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e529e-24da-40fb-9345-6f57ff0fe6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:20.271138 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e529e-24da-40fb-9345-6f57ff0fe6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:20.289629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4d7e529e-24da-40fb-9345-6f57ff0fe6d8 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:20.290861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4d7e529e-24da-40fb-9345-6f57ff0fe6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:20.356035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 541/1112] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:20.379003 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b6759-2557-4cf2-9bfd-d4917420b88d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:20.468955 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:20.476104 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b6759-2557-4cf2-9bfd-d4917420b88d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:20.508600 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4d216-05af-402e-8eb4-5585687bc996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:20.509233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4d216-05af-402e-8eb4-5585687bc996 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:20.509541 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4d216-05af-402e-8eb4-5585687bc996 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:20.509816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4d216-05af-402e-8eb4-5585687bc996 None admin] PATH_INFO: `/v3/roles/e4ff1977289a44cea73b844f8ad102a1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:20.511735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4d216-05af-402e-8eb4-5585687bc996 None admin] RBAC: Authorizing `identity:get_role(role_id=e4ff1977289a44cea73b844f8ad102a1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:20.513104 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4d216-05af-402e-8eb4-5585687bc996 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:20.514510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 572/1113] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 19:01:20 2022] GET /identity/v3/roles/e4ff1977289a44cea73b844f8ad102a1 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:20.520175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e529e-24da-40fb-9345-6f57ff0fe6d8 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:20.523434 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:20.617421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e529e-24da-40fb-9345-6f57ff0fe6d8 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:20.650145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be0987-dd70-49a6-bbba-ab59b08f1006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:20.650770 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be0987-dd70-49a6-bbba-ab59b08f1006 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:20.651599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be0987-dd70-49a6-bbba-ab59b08f1006 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:20.651872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be0987-dd70-49a6-bbba-ab59b08f1006 None admin] PATH_INFO: `/v3/users/7a2db0a8792c4bbebe1cc157beff1bce` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:20.664302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be0987-dd70-49a6-bbba-ab59b08f1006 None admin] RBAC: Authorizing `identity:get_user(user_id=7a2db0a8792c4bbebe1cc157beff1bce)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:20.665767 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be0987-dd70-49a6-bbba-ab59b08f1006 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:20.667469 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 542/1114] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 19:01:20 2022] GET /identity/v3/users/7a2db0a8792c4bbebe1cc157beff1bce => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:20.673356 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4d216-05af-402e-8eb4-5585687bc996 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:20.769285 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4d216-05af-402e-8eb4-5585687bc996 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:20.802695 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef9a79-6348-42ff-9c97-e126633530a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:20.803289 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef9a79-6348-42ff-9c97-e126633530a3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:20.803566 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef9a79-6348-42ff-9c97-e126633530a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:20.803837 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef9a79-6348-42ff-9c97-e126633530a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:20.833563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:20.870777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef9a79-6348-42ff-9c97-e126633530a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:20.872223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef9a79-6348-42ff-9c97-e126633530a3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:20.966402 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 573/1115] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:01:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:01:20.972346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be0987-dd70-49a6-bbba-ab59b08f1006 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:21.031768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:21.069122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be0987-dd70-49a6-bbba-ab59b08f1006 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:21.101460 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371bc53-5d0d-417a-8186-1e7a7819def5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:21.102097 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371bc53-5d0d-417a-8186-1e7a7819def5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:21.102377 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371bc53-5d0d-417a-8186-1e7a7819def5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:21.102648 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371bc53-5d0d-417a-8186-1e7a7819def5 None admin] PATH_INFO: `/v3/projects/57154af475b94a4e9002dd9f0d01559b` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:21.103752 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371bc53-5d0d-417a-8186-1e7a7819def5 None admin] RBAC: Authorizing `identity:get_project(project_id=57154af475b94a4e9002dd9f0d01559b)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:21.105885 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371bc53-5d0d-417a-8186-1e7a7819def5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:21.107501 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 543/1116] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 19:01:20 2022] GET /identity/v3/projects/57154af475b94a4e9002dd9f0d01559b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:21.113561 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef9a79-6348-42ff-9c97-e126633530a3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:21.171270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:21.207540 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef9a79-6348-42ff-9c97-e126633530a3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:21.239866 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ca40f-eab5-4055-9dcc-e87c834f065f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:21.240445 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ca40f-eab5-4055-9dcc-e87c834f065f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:21.240722 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ca40f-eab5-4055-9dcc-e87c834f065f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:21.240991 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ca40f-eab5-4055-9dcc-e87c834f065f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:21.241724 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ca40f-eab5-4055-9dcc-e87c834f065f None admin] RBAC: Adding query filter params (role.id=e4ff1977289a44cea73b844f8ad102a1, scope.project.id=57154af475b94a4e9002dd9f0d01559b, user.id=7a2db0a8792c4bbebe1cc157beff1bce) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:21.242033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ca40f-eab5-4055-9dcc-e87c834f065f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:21.243439 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ca40f-eab5-4055-9dcc-e87c834f065f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:21.248588 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 574/1117] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:01:21 2022] GET /identity/v3/role_assignments?user.id=7a2db0a8792c4bbebe1cc157beff1bce&scope.project.id=57154af475b94a4e9002dd9f0d01559b&role.id=e4ff1977289a44cea73b844f8ad102a1 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:23.225312 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed53a1-dbd6-4802-bf62-54e995839292 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:23.225899 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed53a1-dbd6-4802-bf62-54e995839292 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:23.225899 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed53a1-dbd6-4802-bf62-54e995839292 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:23.227208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 544/1118] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:23.232497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d4137-f30d-44cf-b407-255206261df6 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:23.232876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d4137-f30d-44cf-b407-255206261df6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:23.233029 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d4137-f30d-44cf-b407-255206261df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:23.251193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-850d4137-f30d-44cf-b407-255206261df6 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:23.252369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-850d4137-f30d-44cf-b407-255206261df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:23.318460 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 575/1119] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:23.341961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed53a1-dbd6-4802-bf62-54e995839292 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:23.440665 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed53a1-dbd6-4802-bf62-54e995839292 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:23.467954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:23.473193 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70c97c-2335-440e-bf33-948b96f616a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:23.473839 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70c97c-2335-440e-bf33-948b96f616a1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:23.474123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70c97c-2335-440e-bf33-948b96f616a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:23.474394 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70c97c-2335-440e-bf33-948b96f616a1 None admin] PATH_INFO: `/v3/roles/e4ff1977289a44cea73b844f8ad102a1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:23.475816 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70c97c-2335-440e-bf33-948b96f616a1 None admin] RBAC: Authorizing `identity:get_role(role_id=e4ff1977289a44cea73b844f8ad102a1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:23.477145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70c97c-2335-440e-bf33-948b96f616a1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:23.478464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 545/1120] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 19:01:23 2022] GET /identity/v3/roles/e4ff1977289a44cea73b844f8ad102a1 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:23.484751 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d4137-f30d-44cf-b407-255206261df6 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:23.539443 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:23.581314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d4137-f30d-44cf-b407-255206261df6 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:23.613652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b2285-860b-4deb-a7fd-044fc5b03086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:23.614274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b2285-860b-4deb-a7fd-044fc5b03086 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:23.614553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b2285-860b-4deb-a7fd-044fc5b03086 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:23.614823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b2285-860b-4deb-a7fd-044fc5b03086 None admin] PATH_INFO: `/v3/users/7a2db0a8792c4bbebe1cc157beff1bce` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:23.615931 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b2285-860b-4deb-a7fd-044fc5b03086 None admin] RBAC: Authorizing `identity:get_user(user_id=7a2db0a8792c4bbebe1cc157beff1bce)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:23.617362 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b2285-860b-4deb-a7fd-044fc5b03086 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:23.618962 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 576/1121] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 19:01:23 2022] GET /identity/v3/users/7a2db0a8792c4bbebe1cc157beff1bce => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:23.625489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70c97c-2335-440e-bf33-948b96f616a1 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:23.722267 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70c97c-2335-440e-bf33-948b96f616a1 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:23.755762 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbcaec-4387-4736-8e9d-1e75d6d3d7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:23.756318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbcaec-4387-4736-8e9d-1e75d6d3d7cb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:23.756595 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbcaec-4387-4736-8e9d-1e75d6d3d7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:23.756872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbcaec-4387-4736-8e9d-1e75d6d3d7cb None admin] PATH_INFO: `/v3/projects/57154af475b94a4e9002dd9f0d01559b` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:23.757993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cbcaec-4387-4736-8e9d-1e75d6d3d7cb None admin] RBAC: Authorizing `identity:get_project(project_id=57154af475b94a4e9002dd9f0d01559b)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:23.759417 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cbcaec-4387-4736-8e9d-1e75d6d3d7cb None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:23.761059 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 546/1122] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 19:01:23 2022] GET /identity/v3/projects/57154af475b94a4e9002dd9f0d01559b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:23.767204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b2285-860b-4deb-a7fd-044fc5b03086 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:23.862179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b2285-860b-4deb-a7fd-044fc5b03086 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:23.884346 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:23.894468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37464502-a40e-46fb-bcfe-6065077329ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:23.901893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464502-a40e-46fb-bcfe-6065077329ca None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:23.901893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464502-a40e-46fb-bcfe-6065077329ca None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:23.901893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37464502-a40e-46fb-bcfe-6065077329ca None admin] PATH_INFO: `/v3/projects/57154af475b94a4e9002dd9f0d01559b/users/7a2db0a8792c4bbebe1cc157beff1bce/roles/e4ff1977289a44cea73b844f8ad102a1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:23.901893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37464502-a40e-46fb-bcfe-6065077329ca None admin] RBAC: Authorizing `identity:create_grant(project_id=57154af475b94a4e9002dd9f0d01559b, user_id=7a2db0a8792c4bbebe1cc157beff1bce, role_id=e4ff1977289a44cea73b844f8ad102a1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:23.901893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37464502-a40e-46fb-bcfe-6065077329ca None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:23.977176 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 577/1123] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 19:01:23 2022] PUT /identity/v3/projects/57154af475b94a4e9002dd9f0d01559b/users/7a2db0a8792c4bbebe1cc157beff1bce/roles/e4ff1977289a44cea73b844f8ad102a1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:01:25.952061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32d6cb-29ee-448f-9fed-b6b928fe59b4 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:25.952621 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32d6cb-29ee-448f-9fed-b6b928fe59b4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:25.952621 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32d6cb-29ee-448f-9fed-b6b928fe59b4 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:25.953989 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 547/1124] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:25.959071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf418f-048a-4a53-86ba-48521102d946 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:25.959458 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf418f-048a-4a53-86ba-48521102d946 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:25.959625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf418f-048a-4a53-86ba-48521102d946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:25.977323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a0cf418f-048a-4a53-86ba-48521102d946 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:25.978543 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a0cf418f-048a-4a53-86ba-48521102d946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:26.041610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 578/1125] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:26.064890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32d6cb-29ee-448f-9fed-b6b928fe59b4 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:26.130222 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:26.164998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32d6cb-29ee-448f-9fed-b6b928fe59b4 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:26.199548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e0df4-c6a2-47c3-af82-36ce4fca840e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:26.200159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e0df4-c6a2-47c3-af82-36ce4fca840e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:26.200441 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e0df4-c6a2-47c3-af82-36ce4fca840e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:26.200714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e0df4-c6a2-47c3-af82-36ce4fca840e None admin] PATH_INFO: `/v3/roles/e4ff1977289a44cea73b844f8ad102a1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:26.202174 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e0df4-c6a2-47c3-af82-36ce4fca840e None admin] RBAC: Authorizing `identity:get_role(role_id=e4ff1977289a44cea73b844f8ad102a1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:26.203491 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e0df4-c6a2-47c3-af82-36ce4fca840e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:26.204801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 548/1126] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 19:01:26 2022] GET /identity/v3/roles/e4ff1977289a44cea73b844f8ad102a1 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:26.210646 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf418f-048a-4a53-86ba-48521102d946 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:26.305260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf418f-048a-4a53-86ba-48521102d946 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:26.318822 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:26.337901 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceee0e2-b65e-4828-917f-003c5ef7635f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:26.338538 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceee0e2-b65e-4828-917f-003c5ef7635f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:26.338814 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceee0e2-b65e-4828-917f-003c5ef7635f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:26.339082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceee0e2-b65e-4828-917f-003c5ef7635f None admin] PATH_INFO: `/v3/users/7a2db0a8792c4bbebe1cc157beff1bce` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:26.340182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceee0e2-b65e-4828-917f-003c5ef7635f None admin] RBAC: Authorizing `identity:get_user(user_id=7a2db0a8792c4bbebe1cc157beff1bce)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:26.341642 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceee0e2-b65e-4828-917f-003c5ef7635f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:26.343187 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 579/1127] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 19:01:26 2022] GET /identity/v3/users/7a2db0a8792c4bbebe1cc157beff1bce => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:26.348899 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e0df4-c6a2-47c3-af82-36ce4fca840e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:26.444301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e0df4-c6a2-47c3-af82-36ce4fca840e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:26.477002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096130a-7a42-41bd-a62d-2e066ff493c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:26.477681 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096130a-7a42-41bd-a62d-2e066ff493c2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:26.477970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096130a-7a42-41bd-a62d-2e066ff493c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:26.478245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096130a-7a42-41bd-a62d-2e066ff493c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:26.481375 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:26.550206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096130a-7a42-41bd-a62d-2e066ff493c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:26.551654 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096130a-7a42-41bd-a62d-2e066ff493c2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:26.645780 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 549/1128] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:01:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:01:26.652391 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceee0e2-b65e-4828-917f-003c5ef7635f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:26.749415 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceee0e2-b65e-4828-917f-003c5ef7635f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:26.782933 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8e799-a367-4e59-bcb8-da234a61da28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:26.783549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8e799-a367-4e59-bcb8-da234a61da28 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:26.783832 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8e799-a367-4e59-bcb8-da234a61da28 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:26.784106 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8e799-a367-4e59-bcb8-da234a61da28 None admin] PATH_INFO: `/v3/projects/57154af475b94a4e9002dd9f0d01559b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:26.785216 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8e799-a367-4e59-bcb8-da234a61da28 None admin] RBAC: Authorizing `identity:get_project(project_id=57154af475b94a4e9002dd9f0d01559b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:26.786678 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8e799-a367-4e59-bcb8-da234a61da28 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:26.788301 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 580/1129] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 19:01:26 2022] GET /identity/v3/projects/57154af475b94a4e9002dd9f0d01559b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:26.794853 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096130a-7a42-41bd-a62d-2e066ff493c2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:26.827788 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:26.892585 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096130a-7a42-41bd-a62d-2e066ff493c2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:26.924958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d2948-5b41-4118-9a2c-bc13c614fdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:26.925575 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d2948-5b41-4118-9a2c-bc13c614fdff None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:26.925859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d2948-5b41-4118-9a2c-bc13c614fdff None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:26.926134 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d2948-5b41-4118-9a2c-bc13c614fdff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:26.926850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d2948-5b41-4118-9a2c-bc13c614fdff None admin] RBAC: Adding query filter params (role.id=e4ff1977289a44cea73b844f8ad102a1, scope.project.id=57154af475b94a4e9002dd9f0d01559b, user.id=7a2db0a8792c4bbebe1cc157beff1bce) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:26.927160 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d2948-5b41-4118-9a2c-bc13c614fdff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:26.928582 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d2948-5b41-4118-9a2c-bc13c614fdff None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:26.934839 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 550/1130] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:01:26 2022] GET /identity/v3/role_assignments?user.id=7a2db0a8792c4bbebe1cc157beff1bce&scope.project.id=57154af475b94a4e9002dd9f0d01559b&role.id=e4ff1977289a44cea73b844f8ad102a1 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:28.930485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b77cd8-5f00-42ed-8a89-9393a9cda906 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:28.931024 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b77cd8-5f00-42ed-8a89-9393a9cda906 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:28.931024 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b77cd8-5f00-42ed-8a89-9393a9cda906 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:28.932411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 581/1131] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:28.937443 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2834f1-db30-40e5-99a9-9db32de47f00 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:28.937857 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2834f1-db30-40e5-99a9-9db32de47f00 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:28.938086 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2834f1-db30-40e5-99a9-9db32de47f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:28.956457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-8c2834f1-db30-40e5-99a9-9db32de47f00 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:28.957657 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8c2834f1-db30-40e5-99a9-9db32de47f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:29.022312 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 551/1132] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:29.044935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b77cd8-5f00-42ed-8a89-9393a9cda906 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:29.094479 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:29.143007 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b77cd8-5f00-42ed-8a89-9393a9cda906 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:29.175646 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c22039-2cdf-498d-b285-929342792954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:29.176261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c22039-2cdf-498d-b285-929342792954 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:29.176543 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c22039-2cdf-498d-b285-929342792954 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:29.176822 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c22039-2cdf-498d-b285-929342792954 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:29.177961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c22039-2cdf-498d-b285-929342792954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:29.179388 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c22039-2cdf-498d-b285-929342792954 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:29.180998 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 582/1133] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:01:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:29.187154 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2834f1-db30-40e5-99a9-9db32de47f00 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:29.214627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:29.285791 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2834f1-db30-40e5-99a9-9db32de47f00 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:29.318537 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485adc1-8544-4e86-83a2-6f84d01e5d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:29.319130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485adc1-8544-4e86-83a2-6f84d01e5d46 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:29.319408 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485adc1-8544-4e86-83a2-6f84d01e5d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:29.319675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485adc1-8544-4e86-83a2-6f84d01e5d46 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:29.320305 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485adc1-8544-4e86-83a2-6f84d01e5d46 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:29.321755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485adc1-8544-4e86-83a2-6f84d01e5d46 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:29.441825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 552/1134] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Aug 9 19:01:29 2022] POST /identity/v3/projects => generated 311 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:01:31.456151 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5a819-c89f-42ad-aee8-766dfafaeecd None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:31.456685 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5a819-c89f-42ad-aee8-766dfafaeecd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:31.456685 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5a819-c89f-42ad-aee8-766dfafaeecd None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:31.458089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 583/1135] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:31.463963 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c298593-bea4-42fc-88e6-70c7153caf2a None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:31.464384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c298593-bea4-42fc-88e6-70c7153caf2a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:31.464508 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c298593-bea4-42fc-88e6-70c7153caf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:31.482900 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-7c298593-bea4-42fc-88e6-70c7153caf2a None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:31.484098 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7c298593-bea4-42fc-88e6-70c7153caf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:31.549561 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 553/1136] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:31.573266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5a819-c89f-42ad-aee8-766dfafaeecd None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:31.671759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5a819-c89f-42ad-aee8-766dfafaeecd None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:31.688701 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:31.704419 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03873e8f-e043-4d0a-88f7-207c2eb01bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:31.705026 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03873e8f-e043-4d0a-88f7-207c2eb01bff None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:31.705303 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03873e8f-e043-4d0a-88f7-207c2eb01bff None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:31.705612 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03873e8f-e043-4d0a-88f7-207c2eb01bff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:31.706777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03873e8f-e043-4d0a-88f7-207c2eb01bff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:31.708149 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03873e8f-e043-4d0a-88f7-207c2eb01bff None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:31.709723 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 584/1137] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:01:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:31.715856 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c298593-bea4-42fc-88e6-70c7153caf2a None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:31.727283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:31.812148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c298593-bea4-42fc-88e6-70c7153caf2a None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:31.844441 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ce301-be94-447c-ab9e-db04f349b637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:31.845040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ce301-be94-447c-ab9e-db04f349b637 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:31.845321 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ce301-be94-447c-ab9e-db04f349b637 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:31.845615 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ce301-be94-447c-ab9e-db04f349b637 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:31.846264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ce301-be94-447c-ab9e-db04f349b637 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:31.847684 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ce301-be94-447c-ab9e-db04f349b637 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:31.937856 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 554/1138] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Aug 9 19:01:31 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:01:33.963683 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d3f04-3b5e-4c9e-b6c5-7c477d3f66ca None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:33.964214 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d3f04-3b5e-4c9e-b6c5-7c477d3f66ca None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:33.964214 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d3f04-3b5e-4c9e-b6c5-7c477d3f66ca None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:33.965600 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 585/1139] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:33.971047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1701d6-4013-4b6d-8504-e9e62bec3635 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:33.971436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1701d6-4013-4b6d-8504-e9e62bec3635 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:33.971596 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1701d6-4013-4b6d-8504-e9e62bec3635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:33.989003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2e1701d6-4013-4b6d-8504-e9e62bec3635 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:33.990206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2e1701d6-4013-4b6d-8504-e9e62bec3635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:34.047274 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:34.054377 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 555/1140] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:34.077782 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d3f04-3b5e-4c9e-b6c5-7c477d3f66ca None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:34.176413 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d3f04-3b5e-4c9e-b6c5-7c477d3f66ca None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:34.208988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735f896-f7cc-4215-88f5-081f9926adcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:34.209633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735f896-f7cc-4215-88f5-081f9926adcb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:34.209916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735f896-f7cc-4215-88f5-081f9926adcb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:34.210190 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735f896-f7cc-4215-88f5-081f9926adcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:34.220524 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735f896-f7cc-4215-88f5-081f9926adcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:01:34.225164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-d735f896-f7cc-4215-88f5-081f9926adcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:01:34.225164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:34.225164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:34.225164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:34.225164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:34.225164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:34.225164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:34.225164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:34.225164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:34.225164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:34.225164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:34.225164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:34.225164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:01:34.225164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:01:34.225164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:01:34.225164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:01:34.226340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:01:34.226340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:01:34.226340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:01:34.226340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:01:34.226340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:34.226340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:34.226340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:34.226340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:34.226340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:34.226340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:34.226340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:34.226340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:34.226340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:34.226340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:34.226340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:34.226340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:34.227666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:34.227666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:34.227666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:34.227666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:34.227666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:01:34.227666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:01:34.227666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:01:34.227666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:01:34.227666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:01:34.227666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:01:34.227666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:01:34.227666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:34.227666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 586/1141] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:01:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:01:34.232652 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1701d6-4013-4b6d-8504-e9e62bec3635 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:34.329154 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1701d6-4013-4b6d-8504-e9e62bec3635 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:34.361063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc351e-01a5-468c-b0b8-8ff5b4a0a175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:34.361694 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc351e-01a5-468c-b0b8-8ff5b4a0a175 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:34.361977 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc351e-01a5-468c-b0b8-8ff5b4a0a175 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:34.362249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc351e-01a5-468c-b0b8-8ff5b4a0a175 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:34.362904 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc351e-01a5-468c-b0b8-8ff5b4a0a175 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:34.363208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc351e-01a5-468c-b0b8-8ff5b4a0a175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:34.364566 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cc351e-01a5-468c-b0b8-8ff5b4a0a175 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:34.372952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 556/1142] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:01:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:34.378597 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735f896-f7cc-4215-88f5-081f9926adcb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:34.424896 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:34.476231 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735f896-f7cc-4215-88f5-081f9926adcb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:34.509072 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2633f1d-533e-41cd-819a-405f1ea0c2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:34.509918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2633f1d-533e-41cd-819a-405f1ea0c2bb None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:34.510201 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2633f1d-533e-41cd-819a-405f1ea0c2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:34.510472 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2633f1d-533e-41cd-819a-405f1ea0c2bb None admin] PATH_INFO: `/v3/users/f693227e6cff4c38ad27cb9ade4ec14b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:34.523417 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2633f1d-533e-41cd-819a-405f1ea0c2bb None admin] RBAC: Authorizing `identity:get_user(user_id=f693227e6cff4c38ad27cb9ade4ec14b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:34.524847 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2633f1d-533e-41cd-819a-405f1ea0c2bb None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:34.527082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 587/1143] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 19:01:34 2022] GET /identity/v3/users/f693227e6cff4c38ad27cb9ade4ec14b => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:34.532914 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc351e-01a5-468c-b0b8-8ff5b4a0a175 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:34.589215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:34.629210 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cc351e-01a5-468c-b0b8-8ff5b4a0a175 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:34.662480 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39d9b7-9804-4839-b07d-915bf16d2413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:34.663069 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39d9b7-9804-4839-b07d-915bf16d2413 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:34.663347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39d9b7-9804-4839-b07d-915bf16d2413 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:34.663614 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39d9b7-9804-4839-b07d-915bf16d2413 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:34.728936 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39d9b7-9804-4839-b07d-915bf16d2413 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:34.730343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39d9b7-9804-4839-b07d-915bf16d2413 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:34.784889 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:34.825755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 557/1144] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:01:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:01:34.831674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2633f1d-533e-41cd-819a-405f1ea0c2bb None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:34.927725 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2633f1d-533e-41cd-819a-405f1ea0c2bb None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:34.929991 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:34.959948 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a3f59-7bd4-435e-b3d2-7181a7db0165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:34.960554 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a3f59-7bd4-435e-b3d2-7181a7db0165 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:34.960833 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a3f59-7bd4-435e-b3d2-7181a7db0165 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:34.961102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a3f59-7bd4-435e-b3d2-7181a7db0165 None admin] PATH_INFO: `/v3/projects/8e41e2c4ffec4356a04b5c5c5fd60368` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:34.962239 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a3f59-7bd4-435e-b3d2-7181a7db0165 None admin] RBAC: Authorizing `identity:get_project(project_id=8e41e2c4ffec4356a04b5c5c5fd60368)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:34.963848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a3f59-7bd4-435e-b3d2-7181a7db0165 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:34.966079 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 588/1145] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 19:01:34 2022] GET /identity/v3/projects/8e41e2c4ffec4356a04b5c5c5fd60368 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:34.971675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39d9b7-9804-4839-b07d-915bf16d2413 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:35.066847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39d9b7-9804-4839-b07d-915bf16d2413 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:35.099266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785b5cc-2d49-4b38-b9bc-0c6a2b738196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:35.099857 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785b5cc-2d49-4b38-b9bc-0c6a2b738196 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:35.100136 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785b5cc-2d49-4b38-b9bc-0c6a2b738196 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:35.100408 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785b5cc-2d49-4b38-b9bc-0c6a2b738196 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:35.101117 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785b5cc-2d49-4b38-b9bc-0c6a2b738196 None admin] RBAC: Adding query filter params (role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.project.id=8e41e2c4ffec4356a04b5c5c5fd60368, user.id=f693227e6cff4c38ad27cb9ade4ec14b) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:35.101422 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785b5cc-2d49-4b38-b9bc-0c6a2b738196 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:35.102877 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e785b5cc-2d49-4b38-b9bc-0c6a2b738196 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:35.108288 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 558/1146] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:01:34 2022] GET /identity/v3/role_assignments?user.id=f693227e6cff4c38ad27cb9ade4ec14b&scope.project.id=8e41e2c4ffec4356a04b5c5c5fd60368&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:37.057961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7540c8-e713-46ed-9ed5-0cc7deaf9b7c None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:37.058527 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7540c8-e713-46ed-9ed5-0cc7deaf9b7c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:37.058527 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7540c8-e713-46ed-9ed5-0cc7deaf9b7c None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:37.059839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 589/1147] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:37.065082 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c6ceb-a8c2-4b35-b333-c3b17c9c6dbd None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:37.065501 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c6ceb-a8c2-4b35-b333-c3b17c9c6dbd None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:37.065671 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c6ceb-a8c2-4b35-b333-c3b17c9c6dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:37.083193 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-316c6ceb-a8c2-4b35-b333-c3b17c9c6dbd None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:37.084367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-316c6ceb-a8c2-4b35-b333-c3b17c9c6dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:37.100237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:37.148640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 559/1148] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:37.170719 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7540c8-e713-46ed-9ed5-0cc7deaf9b7c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:37.269667 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7540c8-e713-46ed-9ed5-0cc7deaf9b7c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:37.301380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bf386-0769-4931-b7ab-c4f782aac817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:37.302012 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bf386-0769-4931-b7ab-c4f782aac817 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:37.302287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bf386-0769-4931-b7ab-c4f782aac817 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:37.302552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bf386-0769-4931-b7ab-c4f782aac817 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:37.312697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bf386-0769-4931-b7ab-c4f782aac817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:01:37.317283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-1f2bf386-0769-4931-b7ab-c4f782aac817 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:01:37.317283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:37.317283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:37.317283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:37.317283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:37.317283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:37.317283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:37.317283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:37.317283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:37.317283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:37.317283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:37.317283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:37.317283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:01:37.317283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:01:37.317283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:01:37.317283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:01:37.318394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:01:37.318394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:01:37.318394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:01:37.318394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:01:37.318394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:37.318394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:37.318394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:37.318394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:37.318394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:37.318394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:37.318394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:37.318394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:37.318394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:37.318394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:37.318394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:37.318394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:37.319580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:37.319580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:37.319580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:37.319580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:37.319580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:01:37.319580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:01:37.319580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:01:37.319580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:01:37.319580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:01:37.319580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:01:37.319580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:01:37.319580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:37.319580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 590/1149] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:01:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:01:37.325228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c6ceb-a8c2-4b35-b333-c3b17c9c6dbd None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:37.418130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c6ceb-a8c2-4b35-b333-c3b17c9c6dbd None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:37.450314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f8a6d-b8c9-4cac-a119-73dda1b10c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:37.450901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f8a6d-b8c9-4cac-a119-73dda1b10c69 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:37.451179 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f8a6d-b8c9-4cac-a119-73dda1b10c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:37.451447 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f8a6d-b8c9-4cac-a119-73dda1b10c69 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:37.452097 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f8a6d-b8c9-4cac-a119-73dda1b10c69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:37.452395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f8a6d-b8c9-4cac-a119-73dda1b10c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:37.453776 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f8a6d-b8c9-4cac-a119-73dda1b10c69 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:37.461337 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 560/1150] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:01:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:37.467515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bf386-0769-4931-b7ab-c4f782aac817 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:37.499042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:37.567016 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bf386-0769-4931-b7ab-c4f782aac817 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:37.599814 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f74016-4efb-4214-a485-036460b6c07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:37.600433 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f74016-4efb-4214-a485-036460b6c07b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:37.600713 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f74016-4efb-4214-a485-036460b6c07b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:37.600984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f74016-4efb-4214-a485-036460b6c07b None admin] PATH_INFO: `/v3/users/f693227e6cff4c38ad27cb9ade4ec14b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:37.602100 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f74016-4efb-4214-a485-036460b6c07b None admin] RBAC: Authorizing `identity:get_user(user_id=f693227e6cff4c38ad27cb9ade4ec14b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:37.604199 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f74016-4efb-4214-a485-036460b6c07b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:37.605794 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 591/1151] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 19:01:37 2022] GET /identity/v3/users/f693227e6cff4c38ad27cb9ade4ec14b => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:37.611522 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f8a6d-b8c9-4cac-a119-73dda1b10c69 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:37.627022 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:37.707468 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f8a6d-b8c9-4cac-a119-73dda1b10c69 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:37.739237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ed486-7de2-4a93-9b7a-5e271c26fd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:37.739850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ed486-7de2-4a93-9b7a-5e271c26fd78 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:37.740125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ed486-7de2-4a93-9b7a-5e271c26fd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:37.740391 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ed486-7de2-4a93-9b7a-5e271c26fd78 None admin] PATH_INFO: `/v3/projects/8e41e2c4ffec4356a04b5c5c5fd60368` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:37.741492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ed486-7de2-4a93-9b7a-5e271c26fd78 None admin] RBAC: Authorizing `identity:get_project(project_id=8e41e2c4ffec4356a04b5c5c5fd60368)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:37.742914 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ed486-7de2-4a93-9b7a-5e271c26fd78 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:37.744727 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 561/1152] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 19:01:37 2022] GET /identity/v3/projects/8e41e2c4ffec4356a04b5c5c5fd60368 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:37.750543 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f74016-4efb-4214-a485-036460b6c07b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:37.843386 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:37.846300 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f74016-4efb-4214-a485-036460b6c07b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:37.878236 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbce3db-fd46-47a7-894f-e9609017fc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:37.878871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbce3db-fd46-47a7-894f-e9609017fc1c None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:37.879147 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbce3db-fd46-47a7-894f-e9609017fc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:37.879666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbce3db-fd46-47a7-894f-e9609017fc1c None admin] PATH_INFO: `/v3/projects/8e41e2c4ffec4356a04b5c5c5fd60368/users/f693227e6cff4c38ad27cb9ade4ec14b/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:37.881562 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbce3db-fd46-47a7-894f-e9609017fc1c None admin] RBAC: Authorizing `identity:create_grant(project_id=8e41e2c4ffec4356a04b5c5c5fd60368, user_id=f693227e6cff4c38ad27cb9ade4ec14b, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:37.882970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbce3db-fd46-47a7-894f-e9609017fc1c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:37.959534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 592/1153] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 19:01:37 2022] PUT /identity/v3/projects/8e41e2c4ffec4356a04b5c5c5fd60368/users/f693227e6cff4c38ad27cb9ade4ec14b/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:01:39.963478 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20213acd-f9ff-4a81-83b1-496f55350012 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:39.963996 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20213acd-f9ff-4a81-83b1-496f55350012 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:39.964085 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20213acd-f9ff-4a81-83b1-496f55350012 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:39.965375 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 562/1154] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:39.970555 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8af09-f0c4-40dd-87f2-ef2b54b5b86e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:39.970974 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8af09-f0c4-40dd-87f2-ef2b54b5b86e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:39.971085 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8af09-f0c4-40dd-87f2-ef2b54b5b86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:39.988597 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-95b8af09-f0c4-40dd-87f2-ef2b54b5b86e None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:39.989809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-95b8af09-f0c4-40dd-87f2-ef2b54b5b86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:40.053683 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 593/1155] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 19:01:40.076827 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20213acd-f9ff-4a81-83b1-496f55350012 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:40.158505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:40.176671 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20213acd-f9ff-4a81-83b1-496f55350012 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:40.209095 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc9f9-cf29-4d68-ae41-f0f1407e1899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:40.209768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc9f9-cf29-4d68-ae41-f0f1407e1899 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:40.210402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc9f9-cf29-4d68-ae41-f0f1407e1899 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:40.210671 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc9f9-cf29-4d68-ae41-f0f1407e1899 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:40.221196 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fc9f9-cf29-4d68-ae41-f0f1407e1899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:01:40.225831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-737fc9f9-cf29-4d68-ae41-f0f1407e1899 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:01:40.225831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:40.225831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:40.225831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:40.225831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:40.225831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:40.225831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:40.225831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:40.225831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:40.225831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:40.225831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:40.225831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:40.225831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:01:40.225831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:01:40.225831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:01:40.225831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:01:40.226940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:01:40.226940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:01:40.226940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:01:40.226940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:01:40.226940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:40.226940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:40.226940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:40.226940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:40.226940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:40.226940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:40.226940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:40.226940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:40.226940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:40.226940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:40.226940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:40.226940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:40.228618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:40.228618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:40.228618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:40.228618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:40.228618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:01:40.228618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:01:40.228618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:01:40.228618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:01:40.228618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:01:40.228618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:01:40.228618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:01:40.228618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:01:40.228618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 563/1156] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:01:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:01:40.233879 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8af09-f0c4-40dd-87f2-ef2b54b5b86e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:40.323023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:40.332204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8af09-f0c4-40dd-87f2-ef2b54b5b86e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:40.366327 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a7304-7f7e-440b-9768-fb3181102add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:40.366925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a7304-7f7e-440b-9768-fb3181102add None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:40.367202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a7304-7f7e-440b-9768-fb3181102add None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:40.367538 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a7304-7f7e-440b-9768-fb3181102add None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:40.368231 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a7304-7f7e-440b-9768-fb3181102add None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:40.368543 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a7304-7f7e-440b-9768-fb3181102add None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:40.370036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a7304-7f7e-440b-9768-fb3181102add None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:40.377759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 594/1157] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:01:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:40.383848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc9f9-cf29-4d68-ae41-f0f1407e1899 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:40.480073 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc9f9-cf29-4d68-ae41-f0f1407e1899 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:40.513432 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a89249-3957-4f51-8568-f31cc21ff0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:40.514143 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a89249-3957-4f51-8568-f31cc21ff0aa None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:40.514423 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a89249-3957-4f51-8568-f31cc21ff0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:40.514724 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a89249-3957-4f51-8568-f31cc21ff0aa None admin] PATH_INFO: `/v3/users/f693227e6cff4c38ad27cb9ade4ec14b` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:40.515844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a89249-3957-4f51-8568-f31cc21ff0aa None admin] RBAC: Authorizing `identity:get_user(user_id=f693227e6cff4c38ad27cb9ade4ec14b)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:40.517273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a89249-3957-4f51-8568-f31cc21ff0aa None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:40.518892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 564/1158] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 19:01:40 2022] GET /identity/v3/users/f693227e6cff4c38ad27cb9ade4ec14b => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:40.524654 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a7304-7f7e-440b-9768-fb3181102add None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:40.620634 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a7304-7f7e-440b-9768-fb3181102add None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:40.652696 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406ec6b-42ae-43eb-a4ff-fbcbfb3cb381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:40.653292 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406ec6b-42ae-43eb-a4ff-fbcbfb3cb381 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:40.653605 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406ec6b-42ae-43eb-a4ff-fbcbfb3cb381 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:40.653882 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406ec6b-42ae-43eb-a4ff-fbcbfb3cb381 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:40.674290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:40.718441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406ec6b-42ae-43eb-a4ff-fbcbfb3cb381 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:40.719891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406ec6b-42ae-43eb-a4ff-fbcbfb3cb381 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:40.814354 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 595/1159] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:01:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:01:40.820195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a89249-3957-4f51-8568-f31cc21ff0aa None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:40.832619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:40.918283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a89249-3957-4f51-8568-f31cc21ff0aa None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:40.950590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c437ec9-2b89-4596-b936-28cbc43cacc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:40.951207 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c437ec9-2b89-4596-b936-28cbc43cacc5 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:40.951486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c437ec9-2b89-4596-b936-28cbc43cacc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:40.951755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c437ec9-2b89-4596-b936-28cbc43cacc5 None admin] PATH_INFO: `/v3/projects/8e41e2c4ffec4356a04b5c5c5fd60368` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:40.952852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c437ec9-2b89-4596-b936-28cbc43cacc5 None admin] RBAC: Authorizing `identity:get_project(project_id=8e41e2c4ffec4356a04b5c5c5fd60368)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:40.954299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c437ec9-2b89-4596-b936-28cbc43cacc5 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:40.955944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 565/1160] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 19:01:40 2022] GET /identity/v3/projects/8e41e2c4ffec4356a04b5c5c5fd60368 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:40.962637 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406ec6b-42ae-43eb-a4ff-fbcbfb3cb381 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:41.012883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:41.057847 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406ec6b-42ae-43eb-a4ff-fbcbfb3cb381 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:41.090259 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50685707-5951-4d09-953a-348f22e4483e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:41.090790 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50685707-5951-4d09-953a-348f22e4483e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:41.091066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50685707-5951-4d09-953a-348f22e4483e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:41.091336 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50685707-5951-4d09-953a-348f22e4483e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:41.092054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50685707-5951-4d09-953a-348f22e4483e None admin] RBAC: Adding query filter params (role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.project.id=8e41e2c4ffec4356a04b5c5c5fd60368, user.id=f693227e6cff4c38ad27cb9ade4ec14b) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:41.092359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50685707-5951-4d09-953a-348f22e4483e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:41.093824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50685707-5951-4d09-953a-348f22e4483e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:41.099309 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 596/1161] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:01:40 2022] GET /identity/v3/role_assignments?user.id=f693227e6cff4c38ad27cb9ade4ec14b&scope.project.id=8e41e2c4ffec4356a04b5c5c5fd60368&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:43.103987 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d8360-3e64-4b7c-b509-934a842d1dc3 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:43.104517 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d8360-3e64-4b7c-b509-934a842d1dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:43.104517 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d8360-3e64-4b7c-b509-934a842d1dc3 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:43.105905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 566/1162] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:43.110941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56f16c-ffae-4c5d-a2c1-9c22fbc981f0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:43.111373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56f16c-ffae-4c5d-a2c1-9c22fbc981f0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:43.111475 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56f16c-ffae-4c5d-a2c1-9c22fbc981f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:43.129696 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-cf56f16c-ffae-4c5d-a2c1-9c22fbc981f0 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:43.130860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cf56f16c-ffae-4c5d-a2c1-9c22fbc981f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:43.194428 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 597/1163] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:43.217595 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d8360-3e64-4b7c-b509-934a842d1dc3 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:43.294026 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:43.315656 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d8360-3e64-4b7c-b509-934a842d1dc3 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:43.348433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3699253-3b87-406f-8746-8e60ec24117e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:43.349028 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3699253-3b87-406f-8746-8e60ec24117e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:43.349308 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3699253-3b87-406f-8746-8e60ec24117e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:43.349617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3699253-3b87-406f-8746-8e60ec24117e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:43.413728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3699253-3b87-406f-8746-8e60ec24117e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:43.415183 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3699253-3b87-406f-8746-8e60ec24117e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:43.487515 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:43.510440 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 567/1164] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:01:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:01:43.516190 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56f16c-ffae-4c5d-a2c1-9c22fbc981f0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:43.560521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:43.611210 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56f16c-ffae-4c5d-a2c1-9c22fbc981f0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:43.643878 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d939e-ad67-4c20-86dd-e1035ee7464b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:43.644503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d939e-ad67-4c20-86dd-e1035ee7464b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:43.644783 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d939e-ad67-4c20-86dd-e1035ee7464b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:43.645051 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d939e-ad67-4c20-86dd-e1035ee7464b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:43.651468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d939e-ad67-4c20-86dd-e1035ee7464b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:43.652901 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d939e-ad67-4c20-86dd-e1035ee7464b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:43.663818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-b41d939e-ad67-4c20-86dd-e1035ee7464b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 09 19:01:43.663818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:43.663818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 09 19:01:43.663818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 09 19:01:43.663818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:01:43.663818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:01:43.663818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:01:43.663818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:01:43.663818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 09 19:01:43.663818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:43.663818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:01:43.663818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:43.663818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:43.663818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:43.663818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:43.663818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:43.663818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:43.665534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:43.665534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:43.665534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:43.665534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:43.665534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:43.665534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:43.665534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:01:43.665534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:01:43.665534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:01:43.665534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:01:43.665534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:43.665534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:43.665534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:43.665534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:43.665534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:43.665534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:43.666401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:43.666401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:43.666401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:43.666401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:43.666401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:43.666401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:43.666401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:43.666401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:43.666401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:43.666401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:43.666401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 09 19:01:43.666401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:01:43.666401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 09 19:01:43.666401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:43.666401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 598/1165] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Aug 9 19:01:43 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:01:43.671489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3699253-3b87-406f-8746-8e60ec24117e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:43.768612 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3699253-3b87-406f-8746-8e60ec24117e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:43.802001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bcaf2-e7aa-4168-a01a-32239fcf2a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:43.802620 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bcaf2-e7aa-4168-a01a-32239fcf2a8c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:43.802896 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bcaf2-e7aa-4168-a01a-32239fcf2a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:43.803163 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bcaf2-e7aa-4168-a01a-32239fcf2a8c None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:43.803797 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bcaf2-e7aa-4168-a01a-32239fcf2a8c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:43.804095 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bcaf2-e7aa-4168-a01a-32239fcf2a8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:43.805444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bcaf2-e7aa-4168-a01a-32239fcf2a8c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:43.812460 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 568/1166] 10.222.0.65 () {56 vars in 1115 bytes} [Tue Aug 9 19:01:43 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:45.791523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf53d43-0b2a-45a9-aa1c-c647a538c615 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:45.792050 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf53d43-0b2a-45a9-aa1c-c647a538c615 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:45.792050 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf53d43-0b2a-45a9-aa1c-c647a538c615 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:45.793346 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 599/1167] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:45.798443 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8462be4-1a66-4cf6-b596-380874471e11 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:45.798845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8462be4-1a66-4cf6-b596-380874471e11 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:45.798997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8462be4-1a66-4cf6-b596-380874471e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:45.817283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-b8462be4-1a66-4cf6-b596-380874471e11 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:45.818499 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b8462be4-1a66-4cf6-b596-380874471e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:45.852860 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:45.882961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 569/1168] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:45.905648 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf53d43-0b2a-45a9-aa1c-c647a538c615 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:46.003624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf53d43-0b2a-45a9-aa1c-c647a538c615 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:46.010566 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:46.036062 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41685b73-844a-4b95-8137-e3b54250156a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:46.036718 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41685b73-844a-4b95-8137-e3b54250156a None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:46.036996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41685b73-844a-4b95-8137-e3b54250156a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:46.037285 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41685b73-844a-4b95-8137-e3b54250156a None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:46.037981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41685b73-844a-4b95-8137-e3b54250156a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:46.039344 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41685b73-844a-4b95-8137-e3b54250156a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:46.160538 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 600/1169] 10.222.0.65 () {60 vars in 1138 bytes} [Tue Aug 9 19:01:45 2022] POST /identity/v3/domains => generated 267 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:01:48.192350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbaadf-3961-4889-916b-59b3b81cf54f None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:48.192884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbaadf-3961-4889-916b-59b3b81cf54f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:48.192884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbaadf-3961-4889-916b-59b3b81cf54f None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:48.194273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 570/1170] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:48.200340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc86c6-43d2-4220-9ad0-8d68eeec0b62 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:48.200763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc86c6-43d2-4220-9ad0-8d68eeec0b62 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:48.200890 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc86c6-43d2-4220-9ad0-8d68eeec0b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:48.220178 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-48dc86c6-43d2-4220-9ad0-8d68eeec0b62 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:48.221359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-48dc86c6-43d2-4220-9ad0-8d68eeec0b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:48.288692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 601/1171] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 19:01:48.311946 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbaadf-3961-4889-916b-59b3b81cf54f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:48.410005 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbaadf-3961-4889-916b-59b3b81cf54f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:48.442343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ae7f8-8f0a-41e8-80b6-3d7b555beba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:48.443001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ae7f8-8f0a-41e8-80b6-3d7b555beba2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:48.443225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ae7f8-8f0a-41e8-80b6-3d7b555beba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:48.443490 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ae7f8-8f0a-41e8-80b6-3d7b555beba2 None admin] PATH_INFO: `/v3/domains/2cf1d63b77104b808fa0ee0a363101e3` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:48.453969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ae7f8-8f0a-41e8-80b6-3d7b555beba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2cf1d63b77104b808fa0ee0a363101e3)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:48.455399 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ae7f8-8f0a-41e8-80b6-3d7b555beba2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:48.456938 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 571/1172] 10.222.0.65 () {56 vars in 1183 bytes} [Tue Aug 9 19:01:48 2022] GET /identity/v3/domains/2cf1d63b77104b808fa0ee0a363101e3 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:48.463172 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc86c6-43d2-4220-9ad0-8d68eeec0b62 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:48.552561 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:48.558895 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc86c6-43d2-4220-9ad0-8d68eeec0b62 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:48.591384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47041195-6a4a-47d7-b1b5-c9fb72e40525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:48.592323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47041195-6a4a-47d7-b1b5-c9fb72e40525 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:48.592645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47041195-6a4a-47d7-b1b5-c9fb72e40525 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:48.592913 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47041195-6a4a-47d7-b1b5-c9fb72e40525 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:48.593580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47041195-6a4a-47d7-b1b5-c9fb72e40525 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:48.595022 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47041195-6a4a-47d7-b1b5-c9fb72e40525 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:48.680549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 602/1173] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Aug 9 19:01:48 2022] POST /identity/v3/projects => generated 361 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:01:50.715806 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac130d3-c5c6-4734-9f1f-b3ed399796fd None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:50.716335 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac130d3-c5c6-4734-9f1f-b3ed399796fd None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:50.716335 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac130d3-c5c6-4734-9f1f-b3ed399796fd None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:50.717712 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 572/1174] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:50.722844 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa008033-bb60-40a5-9396-ade4ba5067a9 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:50.723225 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa008033-bb60-40a5-9396-ade4ba5067a9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:50.723408 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa008033-bb60-40a5-9396-ade4ba5067a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:50.741592 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-aa008033-bb60-40a5-9396-ade4ba5067a9 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:50.743557 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-aa008033-bb60-40a5-9396-ade4ba5067a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:50.819242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 603/1175] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:50.849233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac130d3-c5c6-4734-9f1f-b3ed399796fd None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:50.884719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:50.966725 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac130d3-c5c6-4734-9f1f-b3ed399796fd None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:51.008914 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a188a70-8568-4a13-a692-52575928bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:51.009567 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a188a70-8568-4a13-a692-52575928bb7f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:51.009852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a188a70-8568-4a13-a692-52575928bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:51.010126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a188a70-8568-4a13-a692-52575928bb7f None admin] PATH_INFO: `/v3/domains/2cf1d63b77104b808fa0ee0a363101e3` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:51.011268 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a188a70-8568-4a13-a692-52575928bb7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=2cf1d63b77104b808fa0ee0a363101e3)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:51.012706 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a188a70-8568-4a13-a692-52575928bb7f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:51.014368 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 573/1176] 10.222.0.65 () {56 vars in 1183 bytes} [Tue Aug 9 19:01:50 2022] GET /identity/v3/domains/2cf1d63b77104b808fa0ee0a363101e3 => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:51.020351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa008033-bb60-40a5-9396-ade4ba5067a9 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:51.101660 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:51.121882 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa008033-bb60-40a5-9396-ade4ba5067a9 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:51.155980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4cf5e-51f5-4314-a26f-953bf4195e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:51.156576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4cf5e-51f5-4314-a26f-953bf4195e24 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:51.156851 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4cf5e-51f5-4314-a26f-953bf4195e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:51.157121 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4cf5e-51f5-4314-a26f-953bf4195e24 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:51.157788 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4cf5e-51f5-4314-a26f-953bf4195e24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:51.159263 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4cf5e-51f5-4314-a26f-953bf4195e24 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:51.268079 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 604/1177] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Aug 9 19:01:51 2022] POST /identity/v3/users => generated 311 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:01:53.305582 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b30c8-f399-4ce3-bc5d-73c759e84e12 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:53.335380 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b30c8-f399-4ce3-bc5d-73c759e84e12 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:53.335380 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b30c8-f399-4ce3-bc5d-73c759e84e12 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:53.335380 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 574/1178] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:53.335680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28c87c-b001-4917-9275-b5113ca2f149 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:53.335680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28c87c-b001-4917-9275-b5113ca2f149 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:53.335680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28c87c-b001-4917-9275-b5113ca2f149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:53.335680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1c28c87c-b001-4917-9275-b5113ca2f149 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:53.335680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1c28c87c-b001-4917-9275-b5113ca2f149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:53.397355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 605/1179] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:53.420956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b30c8-f399-4ce3-bc5d-73c759e84e12 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:53.516749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:53.520579 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b30c8-f399-4ce3-bc5d-73c759e84e12 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:53.553480 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79bacc-f5fe-4db3-9338-9fa5f9e8150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:53.554122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79bacc-f5fe-4db3-9338-9fa5f9e8150f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:53.554402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79bacc-f5fe-4db3-9338-9fa5f9e8150f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:53.555292 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79bacc-f5fe-4db3-9338-9fa5f9e8150f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:53.565639 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79bacc-f5fe-4db3-9338-9fa5f9e8150f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:01:53.570299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-aa79bacc-f5fe-4db3-9338-9fa5f9e8150f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:01:53.570299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:53.570299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:53.570299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:53.570299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:53.570299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:53.570299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:53.570299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:53.570299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:53.570299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:53.570299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:53.570299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:53.570299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:01:53.570299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:01:53.570299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:01:53.570299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:01:53.571458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:01:53.571458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:01:53.571458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:01:53.571458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:01:53.571458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:53.571458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:53.571458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:53.571458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:53.571458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:53.571458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:53.571458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:53.571458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:53.571458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:53.571458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:53.571458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:53.571458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:53.572667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:53.572667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:53.572667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:53.572667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:53.572667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:01:53.572667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:01:53.572667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:01:53.572667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:01:53.572667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:01:53.572667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:01:53.572667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:01:53.572667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:01:53.572667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 575/1180] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:01:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:01:53.577472 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28c87c-b001-4917-9275-b5113ca2f149 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:53.637092 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:53.672959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28c87c-b001-4917-9275-b5113ca2f149 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:53.705897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4fd9f-b866-40d2-9354-795010c71e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:53.706490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4fd9f-b866-40d2-9354-795010c71e34 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:53.706790 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4fd9f-b866-40d2-9354-795010c71e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:53.707064 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4fd9f-b866-40d2-9354-795010c71e34 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:53.707721 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4fd9f-b866-40d2-9354-795010c71e34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:53.708023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4fd9f-b866-40d2-9354-795010c71e34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:53.709379 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4fd9f-b866-40d2-9354-795010c71e34 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:53.717960 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 606/1181] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:01:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:53.723644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79bacc-f5fe-4db3-9338-9fa5f9e8150f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:53.824826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79bacc-f5fe-4db3-9338-9fa5f9e8150f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:53.857786 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3d13e-230d-45ba-97bb-dde11f6c42ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:53.858403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3d13e-230d-45ba-97bb-dde11f6c42ec None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:53.858680 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3d13e-230d-45ba-97bb-dde11f6c42ec None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:53.858956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3d13e-230d-45ba-97bb-dde11f6c42ec None admin] PATH_INFO: `/v3/users/93a6102c92f14d0cb8a9e532bf82691c` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:53.871644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3d13e-230d-45ba-97bb-dde11f6c42ec None admin] RBAC: Authorizing `identity:get_user(user_id=93a6102c92f14d0cb8a9e532bf82691c)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:53.873082 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e3d13e-230d-45ba-97bb-dde11f6c42ec None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:53.874676 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 576/1182] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 19:01:53 2022] GET /identity/v3/users/93a6102c92f14d0cb8a9e532bf82691c => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:53.880584 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4fd9f-b866-40d2-9354-795010c71e34 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:53.975555 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4fd9f-b866-40d2-9354-795010c71e34 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:54.000281 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:54.008833 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0810bdf-6367-470c-8b5a-13fa7a309a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:54.009435 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0810bdf-6367-470c-8b5a-13fa7a309a80 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:54.009735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0810bdf-6367-470c-8b5a-13fa7a309a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:54.010004 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0810bdf-6367-470c-8b5a-13fa7a309a80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:54.075626 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0810bdf-6367-470c-8b5a-13fa7a309a80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:54.076991 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0810bdf-6367-470c-8b5a-13fa7a309a80 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:54.171108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 607/1183] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:01:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:01:54.177032 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3d13e-230d-45ba-97bb-dde11f6c42ec None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:54.196016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:54.275428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3d13e-230d-45ba-97bb-dde11f6c42ec None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:54.308135 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ceab9f-045c-4495-9b1c-233b2cf7e8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:54.308749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceab9f-045c-4495-9b1c-233b2cf7e8bf None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:54.309026 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceab9f-045c-4495-9b1c-233b2cf7e8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:54.309295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ceab9f-045c-4495-9b1c-233b2cf7e8bf None admin] PATH_INFO: `/v3/projects/420e76a7f7fe45f0a9bca6737c33de98` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:54.310428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ceab9f-045c-4495-9b1c-233b2cf7e8bf None admin] RBAC: Authorizing `identity:get_project(project_id=420e76a7f7fe45f0a9bca6737c33de98)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:54.311842 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ceab9f-045c-4495-9b1c-233b2cf7e8bf None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:54.313434 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 577/1184] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 19:01:54 2022] GET /identity/v3/projects/420e76a7f7fe45f0a9bca6737c33de98 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:54.319547 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0810bdf-6367-470c-8b5a-13fa7a309a80 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:54.346060 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:54.415318 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0810bdf-6367-470c-8b5a-13fa7a309a80 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:54.447702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38387964-63fc-4a42-8ab4-4dc833570bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:54.448280 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38387964-63fc-4a42-8ab4-4dc833570bdc None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:54.448557 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38387964-63fc-4a42-8ab4-4dc833570bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:54.448824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38387964-63fc-4a42-8ab4-4dc833570bdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:54.449565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38387964-63fc-4a42-8ab4-4dc833570bdc None admin] RBAC: Adding query filter params (role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.project.id=420e76a7f7fe45f0a9bca6737c33de98, user.id=93a6102c92f14d0cb8a9e532bf82691c) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:54.449874 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38387964-63fc-4a42-8ab4-4dc833570bdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:54.451278 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38387964-63fc-4a42-8ab4-4dc833570bdc None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:54.456398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 608/1185] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:01:54 2022] GET /identity/v3/role_assignments?user.id=93a6102c92f14d0cb8a9e532bf82691c&scope.project.id=420e76a7f7fe45f0a9bca6737c33de98&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:56.416142 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbd63b-1b36-4bc4-88ff-d4f7852e30fe None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:56.416708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbd63b-1b36-4bc4-88ff-d4f7852e30fe None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:56.416708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbd63b-1b36-4bc4-88ff-d4f7852e30fe None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:56.418036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 578/1186] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:56.423214 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390ca2b-d99b-48c6-bd6f-5abfa2330b14 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:56.423648 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390ca2b-d99b-48c6-bd6f-5abfa2330b14 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:56.423749 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390ca2b-d99b-48c6-bd6f-5abfa2330b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:56.441398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a390ca2b-d99b-48c6-bd6f-5abfa2330b14 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:56.442612 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a390ca2b-d99b-48c6-bd6f-5abfa2330b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:56.506375 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 609/1187] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:56.529339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbd63b-1b36-4bc4-88ff-d4f7852e30fe None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:56.611223 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:56.625928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbd63b-1b36-4bc4-88ff-d4f7852e30fe None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:56.661482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e1424-ba6f-4fa8-a5f4-4d7ab57fa618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:56.662115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e1424-ba6f-4fa8-a5f4-4d7ab57fa618 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:56.662392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e1424-ba6f-4fa8-a5f4-4d7ab57fa618 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:56.662662 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e1424-ba6f-4fa8-a5f4-4d7ab57fa618 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:56.672465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e1424-ba6f-4fa8-a5f4-4d7ab57fa618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:01:56.677051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-017e1424-ba6f-4fa8-a5f4-4d7ab57fa618 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:01:56.677051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:56.677051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:56.677051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:56.677051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:56.677051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:56.677051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:56.677051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:56.677051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:56.677051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:56.677051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:56.677051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:56.677051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:01:56.677051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:01:56.677051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:01:56.677051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:01:56.678145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:01:56.678145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:01:56.678145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:01:56.678145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:01:56.678145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:56.678145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:56.678145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:56.678145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:56.678145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:56.678145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:56.678145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:56.678145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:56.678145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:56.678145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:56.678145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:56.678145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:56.679064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:56.679064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:56.679064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:56.679064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:56.679064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:01:56.679064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:01:56.679064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:01:56.679064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:01:56.679064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:01:56.679064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:01:56.679064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:01:56.679064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:01:56.679064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 579/1188] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:01:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:01:56.684359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390ca2b-d99b-48c6-bd6f-5abfa2330b14 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:56.705443 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:56.781653 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390ca2b-d99b-48c6-bd6f-5abfa2330b14 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:56.815380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104af89e-f975-4616-81c7-f772c28c5d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:56.815978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104af89e-f975-4616-81c7-f772c28c5d71 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:56.816255 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104af89e-f975-4616-81c7-f772c28c5d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:56.816525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104af89e-f975-4616-81c7-f772c28c5d71 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:56.817183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104af89e-f975-4616-81c7-f772c28c5d71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:56.817509 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104af89e-f975-4616-81c7-f772c28c5d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:56.818861 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104af89e-f975-4616-81c7-f772c28c5d71 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:56.827030 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 610/1189] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:01:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:56.832863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e1424-ba6f-4fa8-a5f4-4d7ab57fa618 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:56.927494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e1424-ba6f-4fa8-a5f4-4d7ab57fa618 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:56.960185 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd32659-cd7f-49a7-b353-bbdbcbde1e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:56.961008 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd32659-cd7f-49a7-b353-bbdbcbde1e11 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:56.961283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd32659-cd7f-49a7-b353-bbdbcbde1e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:56.961575 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd32659-cd7f-49a7-b353-bbdbcbde1e11 None admin] PATH_INFO: `/v3/users/93a6102c92f14d0cb8a9e532bf82691c` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:56.962685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd32659-cd7f-49a7-b353-bbdbcbde1e11 None admin] RBAC: Authorizing `identity:get_user(user_id=93a6102c92f14d0cb8a9e532bf82691c)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:56.964097 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd32659-cd7f-49a7-b353-bbdbcbde1e11 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:56.965658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 580/1190] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 19:01:56 2022] GET /identity/v3/users/93a6102c92f14d0cb8a9e532bf82691c => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:56.972340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104af89e-f975-4616-81c7-f772c28c5d71 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:57.053148 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:57.071631 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104af89e-f975-4616-81c7-f772c28c5d71 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:57.106570 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469b164-fc85-468f-88ef-ee1998d77a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:57.107189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469b164-fc85-468f-88ef-ee1998d77a93 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:57.107463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469b164-fc85-468f-88ef-ee1998d77a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:57.107729 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469b164-fc85-468f-88ef-ee1998d77a93 None admin] PATH_INFO: `/v3/projects/420e76a7f7fe45f0a9bca6737c33de98` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:57.108833 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469b164-fc85-468f-88ef-ee1998d77a93 None admin] RBAC: Authorizing `identity:get_project(project_id=420e76a7f7fe45f0a9bca6737c33de98)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:57.110294 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469b164-fc85-468f-88ef-ee1998d77a93 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:57.111906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 611/1191] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 19:01:56 2022] GET /identity/v3/projects/420e76a7f7fe45f0a9bca6737c33de98 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:57.119009 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd32659-cd7f-49a7-b353-bbdbcbde1e11 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:57.135513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:57.217401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd32659-cd7f-49a7-b353-bbdbcbde1e11 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:57.250565 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f046ca1-d5ec-4aab-a6bc-2bb27d10a305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:57.251214 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f046ca1-d5ec-4aab-a6bc-2bb27d10a305 None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:57.251497 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f046ca1-d5ec-4aab-a6bc-2bb27d10a305 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:57.251773 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f046ca1-d5ec-4aab-a6bc-2bb27d10a305 None admin] PATH_INFO: `/v3/projects/420e76a7f7fe45f0a9bca6737c33de98/users/93a6102c92f14d0cb8a9e532bf82691c/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:57.253950 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f046ca1-d5ec-4aab-a6bc-2bb27d10a305 None admin] RBAC: Authorizing `identity:create_grant(project_id=420e76a7f7fe45f0a9bca6737c33de98, user_id=93a6102c92f14d0cb8a9e532bf82691c, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:57.255391 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f046ca1-d5ec-4aab-a6bc-2bb27d10a305 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:57.324919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 581/1192] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 19:01:57 2022] PUT /identity/v3/projects/420e76a7f7fe45f0a9bca6737c33de98/users/93a6102c92f14d0cb8a9e532bf82691c/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:01:59.300680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41e9b0-5466-4046-a63e-e4b68ad9e132 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:59.301246 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41e9b0-5466-4046-a63e-e4b68ad9e132 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:59.301246 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41e9b0-5466-4046-a63e-e4b68ad9e132 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:59.302670 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 612/1193] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:01:59.307944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b092ab-29db-45d0-b40e-7b70088e9095 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:59.308374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b092ab-29db-45d0-b40e-7b70088e9095 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:59.308492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b092ab-29db-45d0-b40e-7b70088e9095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:59.326393 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-45b092ab-29db-45d0-b40e-7b70088e9095 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:01:59.327576 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-45b092ab-29db-45d0-b40e-7b70088e9095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:01:59.393709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 582/1194] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:01:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:01:59.417276 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41e9b0-5466-4046-a63e-e4b68ad9e132 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:59.514044 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41e9b0-5466-4046-a63e-e4b68ad9e132 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:59.546404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d5ec5-c07c-404f-aee9-d656059631d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:59.547014 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d5ec5-c07c-404f-aee9-d656059631d6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:59.547290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d5ec5-c07c-404f-aee9-d656059631d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:59.547557 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d5ec5-c07c-404f-aee9-d656059631d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:59.557754 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d5ec5-c07c-404f-aee9-d656059631d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:01:59.562293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-5a8d5ec5-c07c-404f-aee9-d656059631d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:01:59.562293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:01:59.562293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:01:59.562293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:01:59.562293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:01:59.562293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:01:59.562293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:01:59.562293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:01:59.562293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:01:59.562293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:01:59.562293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:01:59.562293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:01:59.562293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:01:59.562293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:01:59.562293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:01:59.562293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:01:59.563412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:01:59.563412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:01:59.563412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:01:59.563412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:01:59.563412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:01:59.563412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:01:59.563412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:01:59.563412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:01:59.563412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:01:59.563412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:01:59.563412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:01:59.563412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:01:59.563412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:01:59.563412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:01:59.563412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:01:59.563412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:01:59.564493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:01:59.564493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:01:59.564493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:01:59.564493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:01:59.564493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:01:59.564493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:01:59.564493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:01:59.564493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:01:59.564493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:01:59.564493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:01:59.564493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:01:59.564493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:01:59.564493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 613/1195] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:01:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:01:59.569327 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b092ab-29db-45d0-b40e-7b70088e9095 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:59.573054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:59.666214 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b092ab-29db-45d0-b40e-7b70088e9095 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:59.698907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11651d22-f997-4b8c-9dd5-b48af279ac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:59.699502 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11651d22-f997-4b8c-9dd5-b48af279ac1e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:59.699782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11651d22-f997-4b8c-9dd5-b48af279ac1e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:59.700053 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11651d22-f997-4b8c-9dd5-b48af279ac1e None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:59.700708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11651d22-f997-4b8c-9dd5-b48af279ac1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:01:59.701011 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11651d22-f997-4b8c-9dd5-b48af279ac1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:59.702404 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11651d22-f997-4b8c-9dd5-b48af279ac1e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:59.710093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 583/1196] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:01:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:01:59.715829 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d5ec5-c07c-404f-aee9-d656059631d6 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:59.728008 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:59.812872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d5ec5-c07c-404f-aee9-d656059631d6 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:59.845092 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dea7b0-1890-4aa1-b2b6-7ed352c9ca45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:59.845798 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dea7b0-1890-4aa1-b2b6-7ed352c9ca45 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:59.846073 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dea7b0-1890-4aa1-b2b6-7ed352c9ca45 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:59.846337 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dea7b0-1890-4aa1-b2b6-7ed352c9ca45 None admin] PATH_INFO: `/v3/users/93a6102c92f14d0cb8a9e532bf82691c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:01:59.847426 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dea7b0-1890-4aa1-b2b6-7ed352c9ca45 None admin] RBAC: Authorizing `identity:get_user(user_id=93a6102c92f14d0cb8a9e532bf82691c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:01:59.848834 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dea7b0-1890-4aa1-b2b6-7ed352c9ca45 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:01:59.850435 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 614/1197] 10.222.0.65 () {56 vars in 1177 bytes} [Tue Aug 9 19:01:59 2022] GET /identity/v3/users/93a6102c92f14d0cb8a9e532bf82691c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:01:59.856232 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11651d22-f997-4b8c-9dd5-b48af279ac1e None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:01:59.919845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:01:59.952875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11651d22-f997-4b8c-9dd5-b48af279ac1e None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:01:59.984874 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11f628-c627-451a-ac9c-c7476579baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:01:59.985494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11f628-c627-451a-ac9c-c7476579baba None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:01:59.985777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11f628-c627-451a-ac9c-c7476579baba None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:01:59.986045 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11f628-c627-451a-ac9c-c7476579baba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:02:00.050709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11f628-c627-451a-ac9c-c7476579baba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:02:00.052154 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e11f628-c627-451a-ac9c-c7476579baba None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:02:00.113075 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:02:00.147160 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 584/1198] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:01:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:02:00.153006 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dea7b0-1890-4aa1-b2b6-7ed352c9ca45 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:02:00.229346 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:02:00.250332 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dea7b0-1890-4aa1-b2b6-7ed352c9ca45 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:02:00.284014 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebab53-91e0-454c-9fe4-b7ea8cadedde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:02:00.284632 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebab53-91e0-454c-9fe4-b7ea8cadedde None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:02:00.284964 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebab53-91e0-454c-9fe4-b7ea8cadedde None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:02:00.285309 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebab53-91e0-454c-9fe4-b7ea8cadedde None admin] PATH_INFO: `/v3/projects/420e76a7f7fe45f0a9bca6737c33de98` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:02:00.286462 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebab53-91e0-454c-9fe4-b7ea8cadedde None admin] RBAC: Authorizing `identity:get_project(project_id=420e76a7f7fe45f0a9bca6737c33de98)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:02:00.287925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebab53-91e0-454c-9fe4-b7ea8cadedde None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:02:00.289942 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 615/1199] 10.222.0.65 () {56 vars in 1186 bytes} [Tue Aug 9 19:02:00 2022] GET /identity/v3/projects/420e76a7f7fe45f0a9bca6737c33de98 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:02:00.296940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11f628-c627-451a-ac9c-c7476579baba None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:02:00.393444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11f628-c627-451a-ac9c-c7476579baba None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:02:00.426579 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9285a9-fb6d-40e3-bcd4-ee9c5899468e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:02:00.427173 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9285a9-fb6d-40e3-bcd4-ee9c5899468e None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:02:00.427455 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9285a9-fb6d-40e3-bcd4-ee9c5899468e None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:02:00.427727 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9285a9-fb6d-40e3-bcd4-ee9c5899468e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:02:00.428448 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9285a9-fb6d-40e3-bcd4-ee9c5899468e None admin] RBAC: Adding query filter params (role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.project.id=420e76a7f7fe45f0a9bca6737c33de98, user.id=93a6102c92f14d0cb8a9e532bf82691c) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:02:00.428753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9285a9-fb6d-40e3-bcd4-ee9c5899468e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:02:00.430362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9285a9-fb6d-40e3-bcd4-ee9c5899468e None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:02:00.435962 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 585/1200] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:02:00 2022] GET /identity/v3/role_assignments?user.id=93a6102c92f14d0cb8a9e532bf82691c&scope.project.id=420e76a7f7fe45f0a9bca6737c33de98&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:02:10.279758 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=27 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:02:10.433397 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=85 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:11.826239 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815190f9-f8a0-40ed-a225-90b19f97b122 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:11.826788 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815190f9-f8a0-40ed-a225-90b19f97b122 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:11.826788 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815190f9-f8a0-40ed-a225-90b19f97b122 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:11.828245 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 616/1201] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:03:11.834260 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12662b-3133-4156-8c31-de261e9ad51c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:11.834702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12662b-3133-4156-8c31-de261e9ad51c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:11.834841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12662b-3133-4156-8c31-de261e9ad51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:11.853381 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1c12662b-3133-4156-8c31-de261e9ad51c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:03:11.854673 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1c12662b-3133-4156-8c31-de261e9ad51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:03:11.920237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 586/1202] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:03:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:03:11.944886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815190f9-f8a0-40ed-a225-90b19f97b122 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:12.046443 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815190f9-f8a0-40ed-a225-90b19f97b122 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:12.079304 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea206b8-38e6-48b2-81f8-9bfc924c0e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:12.079870 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea206b8-38e6-48b2-81f8-9bfc924c0e5f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:12.080147 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea206b8-38e6-48b2-81f8-9bfc924c0e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:12.080418 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea206b8-38e6-48b2-81f8-9bfc924c0e5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:12.091435 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea206b8-38e6-48b2-81f8-9bfc924c0e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:12.092904 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea206b8-38e6-48b2-81f8-9bfc924c0e5f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:12.106919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-bea206b8-38e6-48b2-81f8-9bfc924c0e5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:12.106919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:12.106919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:12.106919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:12.106919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:12.106919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:12.106919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:12.106919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:12.106919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:12.106919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:12.106919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:12.106919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:12.106919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:03:12.106919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:03:12.106919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:03:12.106919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:03:12.108127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:12.108127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:12.108127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:12.108127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:12.108127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:12.108127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:12.108127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:12.108127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:12.108127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:12.108127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:12.108127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:12.108127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:12.108127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:12.108127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:12.108127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:12.108127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:12.108127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:03:12.109195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:03:12.109195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:12.109195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:03:12.109195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 617/1203] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:12.114463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12662b-3133-4156-8c31-de261e9ad51c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:12.212294 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12662b-3133-4156-8c31-de261e9ad51c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:12.240838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:12.246330 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbe59c-c189-4f68-b9f4-f7d806008940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:12.246932 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbe59c-c189-4f68-b9f4-f7d806008940 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:12.247210 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbe59c-c189-4f68-b9f4-f7d806008940 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:12.247481 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbe59c-c189-4f68-b9f4-f7d806008940 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:12.248116 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbe59c-c189-4f68-b9f4-f7d806008940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:12.248418 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbe59c-c189-4f68-b9f4-f7d806008940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:12.249850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbe59c-c189-4f68-b9f4-f7d806008940 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:12.261421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 587/1204] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:12.267332 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea206b8-38e6-48b2-81f8-9bfc924c0e5f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:12.320875 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:12.368784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea206b8-38e6-48b2-81f8-9bfc924c0e5f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:12.403636 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42347c10-94fd-4792-847c-267668458a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:12.404234 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42347c10-94fd-4792-847c-267668458a95 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:12.404510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42347c10-94fd-4792-847c-267668458a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:12.404779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42347c10-94fd-4792-847c-267668458a95 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:12.405433 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42347c10-94fd-4792-847c-267668458a95 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:12.407766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42347c10-94fd-4792-847c-267668458a95 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:12.504545 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 618/1205] 10.222.0.65 () {60 vars in 1132 bytes} [Tue Aug 9 19:03:12 2022] POST /identity/v3/users => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:03:14.539809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993dc9e-fb86-49bc-abff-2f76c1c4892c None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:14.540361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993dc9e-fb86-49bc-abff-2f76c1c4892c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:14.540361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993dc9e-fb86-49bc-abff-2f76c1c4892c None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:14.541800 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 588/1206] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:03:14.547067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb257d-8bcd-4b0d-b3e1-5b5d8ccc2c72 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:14.547459 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb257d-8bcd-4b0d-b3e1-5b5d8ccc2c72 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:14.547637 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb257d-8bcd-4b0d-b3e1-5b5d8ccc2c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:14.566424 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-21bb257d-8bcd-4b0d-b3e1-5b5d8ccc2c72 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:03:14.567614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-21bb257d-8bcd-4b0d-b3e1-5b5d8ccc2c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:03:14.638924 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 619/1207] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:03:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:03:14.664608 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993dc9e-fb86-49bc-abff-2f76c1c4892c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:14.765955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993dc9e-fb86-49bc-abff-2f76c1c4892c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:14.798331 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768592a6-994f-4572-abac-afae9275fafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:14.798956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768592a6-994f-4572-abac-afae9275fafc None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:14.799236 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768592a6-994f-4572-abac-afae9275fafc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:14.799505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768592a6-994f-4572-abac-afae9275fafc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:14.810560 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768592a6-994f-4572-abac-afae9275fafc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:03:14.815927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-768592a6-994f-4572-abac-afae9275fafc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:03:14.815927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:14.815927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:14.815927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:14.815927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:14.815927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:14.815927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:14.815927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:14.815927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:14.815927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:14.815927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:14.815927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:14.815927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:03:14.815927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:03:14.815927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:03:14.815927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:03:14.817118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:03:14.817118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:03:14.817118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:03:14.817118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:03:14.817118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:14.817118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:14.817118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:14.817118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:14.817118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:14.817118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:14.817118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:14.817118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:14.817118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:14.817118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:14.817118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:14.817118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:14.818383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:14.818383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:14.818383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:14.818383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:14.818383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:03:14.818383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:03:14.818383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:03:14.818383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:03:14.818383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:03:14.818383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:03:14.818383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:03:14.818383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:14.818383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 589/1208] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:03:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:14.823078 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb257d-8bcd-4b0d-b3e1-5b5d8ccc2c72 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:14.860916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:14.919571 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb257d-8bcd-4b0d-b3e1-5b5d8ccc2c72 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:14.953712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dc1a5-8e92-41d6-8d50-2d9f82a816d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:14.954322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dc1a5-8e92-41d6-8d50-2d9f82a816d3 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:14.954595 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dc1a5-8e92-41d6-8d50-2d9f82a816d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:14.954865 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dc1a5-8e92-41d6-8d50-2d9f82a816d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:14.955526 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7dc1a5-8e92-41d6-8d50-2d9f82a816d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:14.956401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7dc1a5-8e92-41d6-8d50-2d9f82a816d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:14.957811 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7dc1a5-8e92-41d6-8d50-2d9f82a816d3 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:14.965497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 620/1209] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:03:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:03:14.971331 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768592a6-994f-4572-abac-afae9275fafc None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:15.021794 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:15.072604 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768592a6-994f-4572-abac-afae9275fafc None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:15.105286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d55b87-62f7-4fd6-b00e-d3cb3fae623f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:15.105937 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d55b87-62f7-4fd6-b00e-d3cb3fae623f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:15.106217 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d55b87-62f7-4fd6-b00e-d3cb3fae623f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:15.106487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d55b87-62f7-4fd6-b00e-d3cb3fae623f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:15.116752 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d55b87-62f7-4fd6-b00e-d3cb3fae623f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:15.118210 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d55b87-62f7-4fd6-b00e-d3cb3fae623f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:15.132536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-17d55b87-62f7-4fd6-b00e-d3cb3fae623f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:15.132536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:15.132536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:15.132536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:15.132536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:15.132536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:15.132536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:15.132536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:15.132536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:15.132536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:15.132536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:15.132536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:15.132536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:03:15.132536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:03:15.132536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:03:15.132536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:03:15.147570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:15.147570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:15.147570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:15.147570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:15.147570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:15.147570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:15.147570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:15.147570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:15.147570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:15.147570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:15.147570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:15.147570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:15.147570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:15.147570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:15.147570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:15.147570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:15.147570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:03:15.148722 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:03:15.148722 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:15.148722 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:15.148722 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 590/1210] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:15.149033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dc1a5-8e92-41d6-8d50-2d9f82a816d3 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:15.235071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:15.238163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dc1a5-8e92-41d6-8d50-2d9f82a816d3 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:15.271134 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880592c-7227-47ac-a89c-71632978aa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:15.271713 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880592c-7227-47ac-a89c-71632978aa43 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:15.272054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880592c-7227-47ac-a89c-71632978aa43 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:15.272264 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880592c-7227-47ac-a89c-71632978aa43 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:15.272932 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880592c-7227-47ac-a89c-71632978aa43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:15.273200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880592c-7227-47ac-a89c-71632978aa43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:15.274586 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9880592c-7227-47ac-a89c-71632978aa43 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:15.286114 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 621/1211] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:15.291942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d55b87-62f7-4fd6-b00e-d3cb3fae623f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:15.391796 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d55b87-62f7-4fd6-b00e-d3cb3fae623f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:15.393315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:15.425202 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c118d-501b-4ea1-b193-3431f9b3c38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:15.425860 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c118d-501b-4ea1-b193-3431f9b3c38a None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:15.426135 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c118d-501b-4ea1-b193-3431f9b3c38a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:15.426402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c118d-501b-4ea1-b193-3431f9b3c38a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:15.433757 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c118d-501b-4ea1-b193-3431f9b3c38a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:15.435193 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c118d-501b-4ea1-b193-3431f9b3c38a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:15.446709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-f72c118d-501b-4ea1-b193-3431f9b3c38a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 19:03:15.446709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:15.446709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:15.446709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:15.446709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:15.446709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:15.446709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:15.446709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:15.446709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:15.446709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:15.446709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:15.446709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:15.446709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:03:15.446709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:03:15.446709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:03:15.446709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:03:15.456225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:15.456225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:15.456225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:03:15.456225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:03:15.456225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:03:15.456225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:03:15.456225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:15.456225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:15.456225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:15.456225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:15.456225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:15.456225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:15.456225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:15.456225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:15.456225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:15.456225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:15.456225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:15.456225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:15.457384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:15.457384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:15.457384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:03:15.457384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:03:15.457384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:03:15.457384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:03:15.457384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:03:15.457384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:03:15.457384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 19:03:15.457384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:15.457384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 591/1212] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:03:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:15.458159 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880592c-7227-47ac-a89c-71632978aa43 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:15.555345 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880592c-7227-47ac-a89c-71632978aa43 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:15.589285 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2494d-2ac6-4ce0-8fc5-0182b2b793d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:15.589916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2494d-2ac6-4ce0-8fc5-0182b2b793d0 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:15.590199 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2494d-2ac6-4ce0-8fc5-0182b2b793d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:15.590471 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2494d-2ac6-4ce0-8fc5-0182b2b793d0 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:15.591195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2494d-2ac6-4ce0-8fc5-0182b2b793d0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:15.591502 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2494d-2ac6-4ce0-8fc5-0182b2b793d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:15.592918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2494d-2ac6-4ce0-8fc5-0182b2b793d0 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:15.609401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 622/1213] 10.222.0.65 () {56 vars in 1143 bytes} [Tue Aug 9 19:03:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:03:15.615909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c118d-501b-4ea1-b193-3431f9b3c38a None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:15.715630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c118d-501b-4ea1-b193-3431f9b3c38a None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:15.749786 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bc2b3-8302-4464-bc9d-10829296f78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:15.750390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bc2b3-8302-4464-bc9d-10829296f78f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:15.750671 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bc2b3-8302-4464-bc9d-10829296f78f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:15.750943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bc2b3-8302-4464-bc9d-10829296f78f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:15.781629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:15.818755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bc2b3-8302-4464-bc9d-10829296f78f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:15.820175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bc2b3-8302-4464-bc9d-10829296f78f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:15.915861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 592/1214] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:03:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:03:15.921737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2494d-2ac6-4ce0-8fc5-0182b2b793d0 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:15.940694 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:16.020273 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2494d-2ac6-4ce0-8fc5-0182b2b793d0 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:16.056568 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1be67-3957-42eb-af9a-feb0be2aa55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:16.057190 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1be67-3957-42eb-af9a-feb0be2aa55f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:16.057489 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1be67-3957-42eb-af9a-feb0be2aa55f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:16.057768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1be67-3957-42eb-af9a-feb0be2aa55f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:16.067873 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1be67-3957-42eb-af9a-feb0be2aa55f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:16.069356 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1be67-3957-42eb-af9a-feb0be2aa55f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:16.083525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-91b1be67-3957-42eb-af9a-feb0be2aa55f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:16.083525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:16.083525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:16.083525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:16.083525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:16.083525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:16.083525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:16.083525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:16.083525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:16.083525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:16.083525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:16.083525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:16.083525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:03:16.083525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:03:16.083525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:03:16.083525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:03:16.084618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:16.084618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:16.084618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:16.084618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:16.084618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:16.084618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:16.084618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:16.084618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:16.084618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:16.084618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:16.084618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:16.084618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:16.084618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:16.084618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:16.084618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:16.084618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:16.084618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:03:16.085808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:03:16.085808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:16.085808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:03:16.085808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 623/1215] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:16.090362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bc2b3-8302-4464-bc9d-10829296f78f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:16.150916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:16.187864 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bc2b3-8302-4464-bc9d-10829296f78f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:16.220856 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dde2bd-d636-4bd5-8690-24663d9549cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:16.222109 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dde2bd-d636-4bd5-8690-24663d9549cc None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:16.222393 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dde2bd-d636-4bd5-8690-24663d9549cc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:16.222678 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dde2bd-d636-4bd5-8690-24663d9549cc None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:16.223289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dde2bd-d636-4bd5-8690-24663d9549cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:16.223587 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dde2bd-d636-4bd5-8690-24663d9549cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:16.224938 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dde2bd-d636-4bd5-8690-24663d9549cc None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:16.235875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 593/1216] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:16.241739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1be67-3957-42eb-af9a-feb0be2aa55f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:16.309343 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:16.339700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1be67-3957-42eb-af9a-feb0be2aa55f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:16.372648 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acee695-67a6-4fe0-8619-408ed03ed818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:16.373262 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acee695-67a6-4fe0-8619-408ed03ed818 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:16.373565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acee695-67a6-4fe0-8619-408ed03ed818 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:16.373836 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acee695-67a6-4fe0-8619-408ed03ed818 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:16.380680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acee695-67a6-4fe0-8619-408ed03ed818 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:16.382228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acee695-67a6-4fe0-8619-408ed03ed818 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:16.394666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-8acee695-67a6-4fe0-8619-408ed03ed818 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:03:16.394666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:16.394666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:16.394666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:16.394666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:16.394666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:16.394666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:16.394666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:16.394666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:16.394666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:16.394666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:16.394666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:16.394666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:03:16.394666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:03:16.394666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:03:16.401988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:03:16.401988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:16.401988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:16.401988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:16.401988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:16.401988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:16.401988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:16.401988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:16.401988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:16.401988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:16.401988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:16.401988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:16.401988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:16.401988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:16.401988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:16.401988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:16.401988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:16.402953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:03:16.402953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:03:16.402953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:03:16.402953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:03:16.402953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:03:16.402953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:03:16.402953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:03:16.402953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:03:16.402953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 624/1217] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:03:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:16.403575 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dde2bd-d636-4bd5-8690-24663d9549cc None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:16.500516 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dde2bd-d636-4bd5-8690-24663d9549cc None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:16.523196 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:16.535098 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943b1f5-14f0-4a95-8f5c-945b968c8a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:16.535696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943b1f5-14f0-4a95-8f5c-945b968c8a23 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:16.535974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943b1f5-14f0-4a95-8f5c-945b968c8a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:16.536269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943b1f5-14f0-4a95-8f5c-945b968c8a23 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:16.536966 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943b1f5-14f0-4a95-8f5c-945b968c8a23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:16.537267 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943b1f5-14f0-4a95-8f5c-945b968c8a23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:16.538717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943b1f5-14f0-4a95-8f5c-945b968c8a23 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:16.550030 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 594/1218] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:03:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:16.556221 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acee695-67a6-4fe0-8619-408ed03ed818 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:16.654380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acee695-67a6-4fe0-8619-408ed03ed818 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:16.681907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:16.687533 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a75b92-5bc6-4074-8b9a-08e88965a1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:16.688126 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a75b92-5bc6-4074-8b9a-08e88965a1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:16.688403 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a75b92-5bc6-4074-8b9a-08e88965a1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:16.688676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a75b92-5bc6-4074-8b9a-08e88965a1c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:16.689385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a75b92-5bc6-4074-8b9a-08e88965a1c6 None admin] RBAC: Adding query filter params (role.id=973d37db3ba74af0b63e3570ab311e21, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=c6172f0733384291992624ef6a527ea2) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:16.689721 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a75b92-5bc6-4074-8b9a-08e88965a1c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:16.691363 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a75b92-5bc6-4074-8b9a-08e88965a1c6 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:16.696530 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 625/1219] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:03:16 2022] GET /identity/v3/role_assignments?user.id=c6172f0733384291992624ef6a527ea2&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=973d37db3ba74af0b63e3570ab311e21 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:03:18.636364 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b59fd-cf61-486e-97c8-2927305c02df None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:18.636948 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b59fd-cf61-486e-97c8-2927305c02df None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:18.636948 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b59fd-cf61-486e-97c8-2927305c02df None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:18.638299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 595/1220] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:03:18.643359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c33a73-5ff2-4efd-be80-e4c02377356a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:18.643857 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c33a73-5ff2-4efd-be80-e4c02377356a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:18.643947 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c33a73-5ff2-4efd-be80-e4c02377356a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:18.661602 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a7c33a73-5ff2-4efd-be80-e4c02377356a None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:03:18.667303 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a7c33a73-5ff2-4efd-be80-e4c02377356a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:03:18.728431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 626/1221] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:03:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:03:18.750508 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b59fd-cf61-486e-97c8-2927305c02df None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:18.852270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b59fd-cf61-486e-97c8-2927305c02df None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:18.886393 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b59a7-0dbb-4562-a840-6678cec2ff4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:18.887018 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b59a7-0dbb-4562-a840-6678cec2ff4d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:18.887302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b59a7-0dbb-4562-a840-6678cec2ff4d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:18.887576 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b59a7-0dbb-4562-a840-6678cec2ff4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:18.898529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b59a7-0dbb-4562-a840-6678cec2ff4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:03:18.903249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-132b59a7-0dbb-4562-a840-6678cec2ff4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:03:18.903249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:18.903249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:18.903249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:18.903249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:18.903249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:18.903249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:18.903249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:18.903249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:18.903249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:18.903249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:18.903249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:18.903249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:03:18.903249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:03:18.903249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:03:18.903249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:03:18.904212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:03:18.904212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:03:18.904212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:03:18.904212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:03:18.904212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:18.904212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:18.904212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:18.904212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:18.904212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:18.904212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:18.904212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:18.904212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:18.904212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:18.904212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:18.904212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:18.904212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:18.905125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:18.905125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:18.905125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:18.905125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:18.905125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:03:18.905125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:03:18.905125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:03:18.905125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:03:18.905125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:03:18.905125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:03:18.905125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:03:18.905125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:18.905125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 596/1222] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:03:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:18.910549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c33a73-5ff2-4efd-be80-e4c02377356a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:19.006585 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c33a73-5ff2-4efd-be80-e4c02377356a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:19.029278 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:19.039670 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cc267-517b-4c13-bd22-51705754e43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:19.040273 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cc267-517b-4c13-bd22-51705754e43b None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:19.040553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cc267-517b-4c13-bd22-51705754e43b None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:19.040827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cc267-517b-4c13-bd22-51705754e43b None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:19.041511 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cc267-517b-4c13-bd22-51705754e43b None admin] RBAC: Adding query filter params (name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:19.041814 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cc267-517b-4c13-bd22-51705754e43b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:19.043172 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cc267-517b-4c13-bd22-51705754e43b None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:19.050907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 627/1223] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:03:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:19.056665 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b59a7-0dbb-4562-a840-6678cec2ff4d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:19.100412 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:19.155882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b59a7-0dbb-4562-a840-6678cec2ff4d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:19.191346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f04555-fc55-41d8-909d-92c51ec8ea27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:19.191967 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f04555-fc55-41d8-909d-92c51ec8ea27 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:19.192247 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f04555-fc55-41d8-909d-92c51ec8ea27 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:19.192520 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f04555-fc55-41d8-909d-92c51ec8ea27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:19.202169 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f04555-fc55-41d8-909d-92c51ec8ea27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:19.203609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f04555-fc55-41d8-909d-92c51ec8ea27 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:19.217852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-73f04555-fc55-41d8-909d-92c51ec8ea27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:19.217852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:19.217852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:19.217852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:19.217852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:19.217852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:19.217852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:19.217852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:19.217852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:19.217852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:19.217852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:19.217852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:19.217852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:03:19.217852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:03:19.217852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:03:19.217852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:03:19.223852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:19.223852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:19.223852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:19.223852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:19.223852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:19.223852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:19.223852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:19.223852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:19.223852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:19.223852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:19.223852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:19.223852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:19.223852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:19.223852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:19.223852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:19.223852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:19.223852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:03:19.228577 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:03:19.228577 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:19.228577 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:19.228577 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 597/1224] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:19.228828 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cc267-517b-4c13-bd22-51705754e43b None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:19.325394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cc267-517b-4c13-bd22-51705754e43b None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:19.359875 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dfcdc-aa24-479e-9fc5-b1d4ac223226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:19.360478 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dfcdc-aa24-479e-9fc5-b1d4ac223226 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:19.360758 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dfcdc-aa24-479e-9fc5-b1d4ac223226 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:19.361031 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dfcdc-aa24-479e-9fc5-b1d4ac223226 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:19.361700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811dfcdc-aa24-479e-9fc5-b1d4ac223226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:19.362067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811dfcdc-aa24-479e-9fc5-b1d4ac223226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:19.363533 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811dfcdc-aa24-479e-9fc5-b1d4ac223226 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:19.375552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 628/1225] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:19.382376 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f04555-fc55-41d8-909d-92c51ec8ea27 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:19.474360 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:19.480923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f04555-fc55-41d8-909d-92c51ec8ea27 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:19.513731 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de185b-c379-4c53-bbf5-73257b8018ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:19.514339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de185b-c379-4c53-bbf5-73257b8018ff None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:19.514689 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de185b-c379-4c53-bbf5-73257b8018ff None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:19.514965 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de185b-c379-4c53-bbf5-73257b8018ff None admin] PATH_INFO: `/v3/users/placement` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:19.523299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de185b-c379-4c53-bbf5-73257b8018ff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:19.524850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de185b-c379-4c53-bbf5-73257b8018ff None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:19.536647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-d0de185b-c379-4c53-bbf5-73257b8018ff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 19:03:19.536647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:19.536647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:19.536647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:19.536647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:19.536647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:19.536647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:19.536647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:19.536647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:19.536647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:19.536647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:19.536647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:19.536647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:03:19.536647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:03:19.536647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:03:19.536647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:03:19.537692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:19.537692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:19.537692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:03:19.537692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:03:19.537692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:03:19.537692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:03:19.537692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:19.537692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:19.537692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:19.537692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:19.537692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:19.537692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:19.537692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:19.537692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:19.537692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:19.537692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:19.537692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:19.537692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:19.538740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:19.538740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:19.538740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:03:19.538740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:03:19.538740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:03:19.538740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:03:19.538740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:03:19.538740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:03:19.538740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 19:03:19.538740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:19.538740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 598/1226] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:03:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:19.543787 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dfcdc-aa24-479e-9fc5-b1d4ac223226 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:19.590802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:19.642680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dfcdc-aa24-479e-9fc5-b1d4ac223226 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:19.677201 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a667e8-54f2-4dec-95ad-df292866e590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:19.677888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a667e8-54f2-4dec-95ad-df292866e590 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:19.678100 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a667e8-54f2-4dec-95ad-df292866e590 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:19.678374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a667e8-54f2-4dec-95ad-df292866e590 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:19.679098 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a667e8-54f2-4dec-95ad-df292866e590 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:19.679412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a667e8-54f2-4dec-95ad-df292866e590 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:19.681029 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a667e8-54f2-4dec-95ad-df292866e590 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:19.698020 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 629/1227] 10.222.0.65 () {56 vars in 1143 bytes} [Tue Aug 9 19:03:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:19.703856 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de185b-c379-4c53-bbf5-73257b8018ff None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:19.801880 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de185b-c379-4c53-bbf5-73257b8018ff None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:19.837988 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d607fb-3c3c-44c8-b507-2d7c8e71310c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:19.838616 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d607fb-3c3c-44c8-b507-2d7c8e71310c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:19.838892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d607fb-3c3c-44c8-b507-2d7c8e71310c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:19.839164 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d607fb-3c3c-44c8-b507-2d7c8e71310c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:19.849904 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d607fb-3c3c-44c8-b507-2d7c8e71310c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:19.851346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d607fb-3c3c-44c8-b507-2d7c8e71310c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:19.864923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-03d607fb-3c3c-44c8-b507-2d7c8e71310c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:19.864923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:19.864923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:19.864923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:19.864923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:19.864923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:19.864923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:19.864923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:19.864923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:19.864923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:19.864923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:19.864923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:19.864923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:03:19.864923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:03:19.864923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:03:19.864923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:03:19.866126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:19.866126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:19.866126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:19.866126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:19.866126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:19.866126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:19.866126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:19.866126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:19.866126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:19.866126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:19.866126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:19.866126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:19.866126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:19.866126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:19.866126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:19.866126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:19.866126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:03:19.867143 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:03:19.867143 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:19.867143 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:19.867143 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 599/1228] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:19.871942 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a667e8-54f2-4dec-95ad-df292866e590 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:19.973014 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a667e8-54f2-4dec-95ad-df292866e590 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:19.975325 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:20.007731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37366ae5-91b0-4866-8bcc-54c47b71f293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:20.008325 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37366ae5-91b0-4866-8bcc-54c47b71f293 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:20.008602 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37366ae5-91b0-4866-8bcc-54c47b71f293 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:20.008869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37366ae5-91b0-4866-8bcc-54c47b71f293 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:20.009523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37366ae5-91b0-4866-8bcc-54c47b71f293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:20.009824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37366ae5-91b0-4866-8bcc-54c47b71f293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:20.011168 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37366ae5-91b0-4866-8bcc-54c47b71f293 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:20.022338 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 630/1229] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:20.028050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d607fb-3c3c-44c8-b507-2d7c8e71310c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:20.037829 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:20.128326 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d607fb-3c3c-44c8-b507-2d7c8e71310c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:20.164358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23739894-db8e-4e12-ac82-8049e880e0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:20.164978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23739894-db8e-4e12-ac82-8049e880e0bb None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:20.165253 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23739894-db8e-4e12-ac82-8049e880e0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:20.165546 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23739894-db8e-4e12-ac82-8049e880e0bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:20.171898 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23739894-db8e-4e12-ac82-8049e880e0bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:20.173330 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23739894-db8e-4e12-ac82-8049e880e0bb None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:20.184675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-23739894-db8e-4e12-ac82-8049e880e0bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:03:20.184675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:20.184675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:20.184675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:20.184675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:20.184675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:20.184675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:20.184675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:20.184675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:20.184675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:20.184675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:20.184675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:20.184675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:03:20.184675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:03:20.184675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:03:20.185766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:03:20.185766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:20.185766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:20.185766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:20.185766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:20.185766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:20.185766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:20.185766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:20.185766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:20.185766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:20.185766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:20.185766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:20.185766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:20.185766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:20.185766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:20.185766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:20.185766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:20.186872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:03:20.186872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:03:20.186872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:03:20.186872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:03:20.186872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:03:20.186872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:03:20.186872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:03:20.186872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:20.186872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 600/1230] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:03:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:20.192174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37366ae5-91b0-4866-8bcc-54c47b71f293 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:20.294021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37366ae5-91b0-4866-8bcc-54c47b71f293 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:20.326968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b84ce-62d2-428a-8e83-fabc8f0f36ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:20.327568 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b84ce-62d2-428a-8e83-fabc8f0f36ac None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:20.327846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b84ce-62d2-428a-8e83-fabc8f0f36ac None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:20.328118 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b84ce-62d2-428a-8e83-fabc8f0f36ac None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:20.328805 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b84ce-62d2-428a-8e83-fabc8f0f36ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:20.329124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b84ce-62d2-428a-8e83-fabc8f0f36ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:20.330730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b84ce-62d2-428a-8e83-fabc8f0f36ac None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:20.342373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 631/1231] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:03:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:20.349075 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23739894-db8e-4e12-ac82-8049e880e0bb None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:20.413479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:20.448350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23739894-db8e-4e12-ac82-8049e880e0bb None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:20.481146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cf01f-0bd3-4757-b226-d457cee32c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:20.481831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cf01f-0bd3-4757-b226-d457cee32c8a None admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:20.482098 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cf01f-0bd3-4757-b226-d457cee32c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:20.482369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cf01f-0bd3-4757-b226-d457cee32c8a None admin] PATH_INFO: `/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/c6172f0733384291992624ef6a527ea2/roles/973d37db3ba74af0b63e3570ab311e21` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:20.496109 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5cf01f-0bd3-4757-b226-d457cee32c8a None admin] RBAC: Authorizing `identity:create_grant(project_id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user_id=c6172f0733384291992624ef6a527ea2, role_id=973d37db3ba74af0b63e3570ab311e21)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:20.497566 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5cf01f-0bd3-4757-b226-d457cee32c8a None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:20.600853 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 601/1232] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 19:03:20 2022] PUT /identity/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/c6172f0733384291992624ef6a527ea2/roles/973d37db3ba74af0b63e3570ab311e21 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:03:22.565347 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158230da-6020-49a9-9eaa-85b17ca92177 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:22.566290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158230da-6020-49a9-9eaa-85b17ca92177 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:22.566290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158230da-6020-49a9-9eaa-85b17ca92177 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:22.567277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 632/1233] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:03:22.572331 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7e335-6aaf-4615-9e67-fe96627cfe72 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:22.572803 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7e335-6aaf-4615-9e67-fe96627cfe72 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:22.572913 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7e335-6aaf-4615-9e67-fe96627cfe72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:22.591328 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9fe7e335-6aaf-4615-9e67-fe96627cfe72 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:03:22.592500 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9fe7e335-6aaf-4615-9e67-fe96627cfe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:03:22.658731 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 602/1234] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:03:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:03:22.681808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158230da-6020-49a9-9eaa-85b17ca92177 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:22.707376 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:22.781198 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158230da-6020-49a9-9eaa-85b17ca92177 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:22.813882 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c85a6-887d-42e6-9505-b5a0f2319a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:22.814502 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c85a6-887d-42e6-9505-b5a0f2319a78 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:22.815326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c85a6-887d-42e6-9505-b5a0f2319a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:22.815702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c85a6-887d-42e6-9505-b5a0f2319a78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:22.825472 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c85a6-887d-42e6-9505-b5a0f2319a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:03:22.830128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-397c85a6-887d-42e6-9505-b5a0f2319a78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:03:22.830128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:22.830128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:22.830128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:22.830128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:22.830128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:22.830128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:22.830128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:22.830128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:22.830128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:22.830128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:22.830128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:22.830128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:03:22.830128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:03:22.830128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:03:22.830128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:03:22.831863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:03:22.831863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:03:22.831863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:03:22.831863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:03:22.831863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:22.831863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:22.831863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:22.831863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:22.831863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:22.831863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:22.831863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:22.831863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:22.831863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:22.831863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:22.831863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:22.831863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:22.833013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:22.833013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:22.833013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:22.833013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:22.833013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:03:22.833013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:03:22.833013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:03:22.833013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:03:22.833013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:03:22.833013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:03:22.833013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 19:03:22.833013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:03:22.833013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 633/1235] 10.222.0.65 () {56 vars in 1102 bytes} [Tue Aug 9 19:03:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:22.837853 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7e335-6aaf-4615-9e67-fe96627cfe72 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:22.883839 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:22.935084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7e335-6aaf-4615-9e67-fe96627cfe72 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:22.968721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8b247-a3e0-4fb2-b5d4-4c4c040cd83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:22.969319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8b247-a3e0-4fb2-b5d4-4c4c040cd83c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:22.969626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8b247-a3e0-4fb2-b5d4-4c4c040cd83c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:22.969895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8b247-a3e0-4fb2-b5d4-4c4c040cd83c None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:22.970548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8b247-a3e0-4fb2-b5d4-4c4c040cd83c None admin] RBAC: Adding query filter params (name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:22.970877 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8b247-a3e0-4fb2-b5d4-4c4c040cd83c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:22.972476 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8b247-a3e0-4fb2-b5d4-4c4c040cd83c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:22.980066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 603/1236] 10.222.0.65 () {56 vars in 1103 bytes} [Tue Aug 9 19:03:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:22.985906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c85a6-887d-42e6-9505-b5a0f2319a78 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:23.071358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:23.086974 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c85a6-887d-42e6-9505-b5a0f2319a78 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:23.119042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa28f6-4d15-47b7-bce9-c8506d736266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:23.119655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa28f6-4d15-47b7-bce9-c8506d736266 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:23.119932 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa28f6-4d15-47b7-bce9-c8506d736266 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:23.120200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa28f6-4d15-47b7-bce9-c8506d736266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:23.130395 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa28f6-4d15-47b7-bce9-c8506d736266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:23.131840 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa28f6-4d15-47b7-bce9-c8506d736266 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:23.145819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-f9aa28f6-4d15-47b7-bce9-c8506d736266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:23.145819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:23.145819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:23.145819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:23.145819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:23.145819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:23.145819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:23.145819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:23.145819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:23.145819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:23.145819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:23.145819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:23.145819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:03:23.145819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:03:23.145819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:03:23.145819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:03:23.147035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:23.147035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:23.147035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:23.147035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:23.147035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:23.147035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:23.147035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:23.147035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:23.147035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:23.147035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:23.147035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:23.147035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:23.147035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:23.147035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:23.147035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:23.147035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:23.147035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:03:23.148008 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:03:23.148008 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:23.148008 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:03:23.148008 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 634/1237] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:23.152640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8b247-a3e0-4fb2-b5d4-4c4c040cd83c None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:23.254266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8b247-a3e0-4fb2-b5d4-4c4c040cd83c None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:23.262934 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:23.288787 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f68a3-b10f-4e9a-b02a-77e244c75063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:23.289390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f68a3-b10f-4e9a-b02a-77e244c75063 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:23.289704 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f68a3-b10f-4e9a-b02a-77e244c75063 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:23.289979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f68a3-b10f-4e9a-b02a-77e244c75063 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:23.290617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f68a3-b10f-4e9a-b02a-77e244c75063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:23.290922 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f68a3-b10f-4e9a-b02a-77e244c75063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:23.292389 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f68a3-b10f-4e9a-b02a-77e244c75063 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:23.303900 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 604/1238] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:23.309659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa28f6-4d15-47b7-bce9-c8506d736266 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:23.407812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa28f6-4d15-47b7-bce9-c8506d736266 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:23.441360 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913600e2-c7b1-4fdf-a603-c792561fe77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:23.442013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913600e2-c7b1-4fdf-a603-c792561fe77d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:23.442351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913600e2-c7b1-4fdf-a603-c792561fe77d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:23.442628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913600e2-c7b1-4fdf-a603-c792561fe77d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:23.445599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:23.450662 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913600e2-c7b1-4fdf-a603-c792561fe77d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:23.452121 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913600e2-c7b1-4fdf-a603-c792561fe77d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:23.462907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-913600e2-c7b1-4fdf-a603-c792561fe77d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 19:03:23.462907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:23.462907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:23.462907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:23.462907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:23.462907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:23.462907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:23.462907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:23.462907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:23.462907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:23.462907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:23.462907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:23.462907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:03:23.462907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:03:23.462907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:03:23.462907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:03:23.464042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:23.464042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:23.464042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:03:23.464042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:03:23.464042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:03:23.464042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:03:23.464042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:23.464042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:23.464042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:23.464042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:23.464042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:23.464042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:23.464042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:23.464042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:23.464042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:23.464042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:23.464042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:23.464042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:23.465052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:23.465052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:23.465052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:03:23.465052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:03:23.465052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:03:23.465052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:03:23.465052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:03:23.465052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:03:23.465052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 19:03:23.465052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:03:23.465052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 635/1239] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:03:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:03:23.471429 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f68a3-b10f-4e9a-b02a-77e244c75063 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:23.569253 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f68a3-b10f-4e9a-b02a-77e244c75063 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:23.602578 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9397a2f-5aa7-4393-a662-d678996d9c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:23.603176 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9397a2f-5aa7-4393-a662-d678996d9c53 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:23.603453 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9397a2f-5aa7-4393-a662-d678996d9c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:23.603727 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9397a2f-5aa7-4393-a662-d678996d9c53 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:23.604476 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9397a2f-5aa7-4393-a662-d678996d9c53 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:23.604775 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9397a2f-5aa7-4393-a662-d678996d9c53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:23.606242 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9397a2f-5aa7-4393-a662-d678996d9c53 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:23.623824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 605/1240] 10.222.0.65 () {56 vars in 1143 bytes} [Tue Aug 9 19:03:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:23.630405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913600e2-c7b1-4fdf-a603-c792561fe77d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:23.730738 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913600e2-c7b1-4fdf-a603-c792561fe77d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:23.762596 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e72f5-02e7-48a0-88be-7a5cd31335a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:23.763188 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e72f5-02e7-48a0-88be-7a5cd31335a8 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:23.763464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e72f5-02e7-48a0-88be-7a5cd31335a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:23.763732 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e72f5-02e7-48a0-88be-7a5cd31335a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:23.823755 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:23.829963 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e72f5-02e7-48a0-88be-7a5cd31335a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:23.831992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e72f5-02e7-48a0-88be-7a5cd31335a8 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:23.926913 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 636/1241] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:03:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:03:23.932911 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9397a2f-5aa7-4393-a662-d678996d9c53 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:23.960258 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:24.031256 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9397a2f-5aa7-4393-a662-d678996d9c53 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:24.064285 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddac05c-c76b-4221-920e-ae5676b92a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:24.065421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddac05c-c76b-4221-920e-ae5676b92a64 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:24.065725 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddac05c-c76b-4221-920e-ae5676b92a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:24.065992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddac05c-c76b-4221-920e-ae5676b92a64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:24.076683 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddac05c-c76b-4221-920e-ae5676b92a64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:24.078195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddac05c-c76b-4221-920e-ae5676b92a64 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:24.093113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-8ddac05c-c76b-4221-920e-ae5676b92a64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:24.093113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:24.093113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:24.093113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:24.093113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:24.093113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:24.093113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:24.093113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:24.093113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:24.093113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:24.093113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:24.093113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:24.093113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:03:24.093113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:03:24.093113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:03:24.093113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:03:24.096314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:24.096314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:24.096314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:24.096314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:24.096314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:24.096314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:24.096314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:24.096314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:24.096314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:24.096314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:24.096314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:24.096314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:24.096314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:24.096314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:24.096314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:24.096314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:24.096314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:03:24.097222 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:03:24.097222 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:24.097222 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:24.097222 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 606/1242] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:24.099914 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e72f5-02e7-48a0-88be-7a5cd31335a8 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:24.193311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:24.198926 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e72f5-02e7-48a0-88be-7a5cd31335a8 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:24.232381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bf57b-4272-479b-919f-c83ad1fe872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:24.232985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bf57b-4272-479b-919f-c83ad1fe872e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:24.233266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bf57b-4272-479b-919f-c83ad1fe872e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:24.233575 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bf57b-4272-479b-919f-c83ad1fe872e None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:24.234277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bf57b-4272-479b-919f-c83ad1fe872e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:24.234583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bf57b-4272-479b-919f-c83ad1fe872e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:24.235953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bf57b-4272-479b-919f-c83ad1fe872e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:24.247193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 637/1243] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:24.253707 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddac05c-c76b-4221-920e-ae5676b92a64 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:24.330897 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:24.350963 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddac05c-c76b-4221-920e-ae5676b92a64 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:24.383383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566eea0-eb09-49b6-a968-5ac7dcf39ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:24.386294 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566eea0-eb09-49b6-a968-5ac7dcf39ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:24.386294 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566eea0-eb09-49b6-a968-5ac7dcf39ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:24.386294 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566eea0-eb09-49b6-a968-5ac7dcf39ca2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:24.391005 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566eea0-eb09-49b6-a968-5ac7dcf39ca2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:24.392433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566eea0-eb09-49b6-a968-5ac7dcf39ca2 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:24.403739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-3566eea0-eb09-49b6-a968-5ac7dcf39ca2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:03:24.403739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:24.403739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:24.403739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:24.403739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:24.403739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:24.403739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:24.403739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:24.403739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:24.403739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:24.403739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:24.403739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:24.403739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:03:24.403739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:03:24.403739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:03:24.404771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:03:24.404771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:24.404771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:24.404771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:24.404771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:24.404771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:24.404771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:24.404771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:24.404771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:24.404771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:24.404771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:24.404771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:24.404771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:24.404771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:24.404771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:24.404771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:24.404771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:24.405924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:03:24.405924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:03:24.405924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:03:24.405924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:03:24.405924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:03:24.405924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:03:24.405924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:03:24.405924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:24.405924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 607/1244] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:03:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:24.410673 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bf57b-4272-479b-919f-c83ad1fe872e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:24.509001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bf57b-4272-479b-919f-c83ad1fe872e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:24.541699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc755f-24c0-4f00-a18d-f02dc2dbcae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:24.542295 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc755f-24c0-4f00-a18d-f02dc2dbcae4 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:24.542571 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc755f-24c0-4f00-a18d-f02dc2dbcae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:24.542840 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc755f-24c0-4f00-a18d-f02dc2dbcae4 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:24.543544 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc755f-24c0-4f00-a18d-f02dc2dbcae4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:24.543846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc755f-24c0-4f00-a18d-f02dc2dbcae4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:24.545294 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc755f-24c0-4f00-a18d-f02dc2dbcae4 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:24.557291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 638/1245] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:03:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:24.563515 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566eea0-eb09-49b6-a968-5ac7dcf39ca2 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:24.663982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566eea0-eb09-49b6-a968-5ac7dcf39ca2 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:24.697991 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bfb7d-f179-4c5d-88e8-ef1ce6fdb36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:24.698593 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bfb7d-f179-4c5d-88e8-ef1ce6fdb36d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:24.698874 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bfb7d-f179-4c5d-88e8-ef1ce6fdb36d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:24.699146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bfb7d-f179-4c5d-88e8-ef1ce6fdb36d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:24.699861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bfb7d-f179-4c5d-88e8-ef1ce6fdb36d None admin] RBAC: Adding query filter params (role.id=973d37db3ba74af0b63e3570ab311e21, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=c6172f0733384291992624ef6a527ea2) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:24.700172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bfb7d-f179-4c5d-88e8-ef1ce6fdb36d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:24.701679 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bfb7d-f179-4c5d-88e8-ef1ce6fdb36d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:24.708244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 608/1246] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:03:24 2022] GET /identity/v3/role_assignments?user.id=c6172f0733384291992624ef6a527ea2&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=973d37db3ba74af0b63e3570ab311e21 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:26.810259 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30101a3b-a956-44ff-831a-f85bdb533392 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:26.810843 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30101a3b-a956-44ff-831a-f85bdb533392 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:26.810843 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30101a3b-a956-44ff-831a-f85bdb533392 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:26.812066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 639/1247] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:03:26.817386 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb873032-9a83-48e0-a152-572119107f22 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:26.817845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb873032-9a83-48e0-a152-572119107f22 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:26.817977 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb873032-9a83-48e0-a152-572119107f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:26.824503 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:26.837599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-cb873032-9a83-48e0-a152-572119107f22 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:03:26.838789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cb873032-9a83-48e0-a152-572119107f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:03:26.903261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 609/1248] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:03:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:03:26.927397 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30101a3b-a956-44ff-831a-f85bdb533392 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:26.945093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:27.028065 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30101a3b-a956-44ff-831a-f85bdb533392 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:27.060986 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2725a4-60be-4eb5-a9dc-51fb0a99bcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:27.061564 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2725a4-60be-4eb5-a9dc-51fb0a99bcc7 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:27.061842 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2725a4-60be-4eb5-a9dc-51fb0a99bcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:27.062112 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2725a4-60be-4eb5-a9dc-51fb0a99bcc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:27.073600 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2725a4-60be-4eb5-a9dc-51fb0a99bcc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:03:27.078319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9f2725a4-60be-4eb5-a9dc-51fb0a99bcc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:03:27.078319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:27.078319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:27.078319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:27.078319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:27.078319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:27.078319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:27.078319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:27.078319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:27.078319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:27.078319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:27.078319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:27.078319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:03:27.078319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:03:27.078319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:03:27.078319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:03:27.079399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:03:27.079399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:03:27.079399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:03:27.079399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:03:27.079399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:27.079399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:27.079399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:27.079399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:27.079399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:27.079399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:27.079399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:27.079399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:27.079399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:27.079399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:27.079399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:27.079399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:27.081130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:27.081130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:27.081130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:27.081130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:27.081130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:03:27.081130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:03:27.081130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:03:27.081130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:03:27.081130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:03:27.081130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:03:27.081130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:03:27.081130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:03:27.081130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 640/1249] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:03:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:27.086202 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb873032-9a83-48e0-a152-572119107f22 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:27.183310 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb873032-9a83-48e0-a152-572119107f22 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:27.213819 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:27.218613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c5d54-eedb-4208-b746-59a3dd2fbcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:27.219221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c5d54-eedb-4208-b746-59a3dd2fbcdc None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:27.219500 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c5d54-eedb-4208-b746-59a3dd2fbcdc None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:27.219772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c5d54-eedb-4208-b746-59a3dd2fbcdc None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:27.220427 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c5d54-eedb-4208-b746-59a3dd2fbcdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:27.220935 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c5d54-eedb-4208-b746-59a3dd2fbcdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:27.222331 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c5d54-eedb-4208-b746-59a3dd2fbcdc None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:27.230124 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 610/1250] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:03:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:27.236014 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2725a4-60be-4eb5-a9dc-51fb0a99bcc7 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:27.311243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:27.334185 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2725a4-60be-4eb5-a9dc-51fb0a99bcc7 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:27.365918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8b364-e586-4499-a169-6f0d238adc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:27.366526 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8b364-e586-4499-a169-6f0d238adc2f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:27.366799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8b364-e586-4499-a169-6f0d238adc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:27.367065 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8b364-e586-4499-a169-6f0d238adc2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:27.379845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8b364-e586-4499-a169-6f0d238adc2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:27.381274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8b364-e586-4499-a169-6f0d238adc2f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:27.395411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-eed8b364-e586-4499-a169-6f0d238adc2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:27.395411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:27.395411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:27.395411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:27.395411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:27.395411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:27.395411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:27.395411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:27.395411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:27.395411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:27.395411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:27.395411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:27.395411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:03:27.395411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:03:27.395411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:03:27.395411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:03:27.396616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:27.396616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:27.396616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:27.396616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:27.396616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:27.396616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:27.396616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:27.396616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:27.396616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:27.396616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:27.396616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:27.396616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:27.396616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:27.396616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:27.396616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:27.396616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:27.396616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:03:27.397675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:03:27.397675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:27.397675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:03:27.397675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 641/1251] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:27.402440 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c5d54-eedb-4208-b746-59a3dd2fbcdc None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:27.503656 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c5d54-eedb-4208-b746-59a3dd2fbcdc None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:27.536500 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a082b-13e7-4aa6-a62b-b03bd45adb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:27.537118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a082b-13e7-4aa6-a62b-b03bd45adb92 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:27.537401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a082b-13e7-4aa6-a62b-b03bd45adb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:27.537706 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a082b-13e7-4aa6-a62b-b03bd45adb92 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:27.538441 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a082b-13e7-4aa6-a62b-b03bd45adb92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:27.538777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a082b-13e7-4aa6-a62b-b03bd45adb92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:27.540213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a082b-13e7-4aa6-a62b-b03bd45adb92 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:27.552291 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 611/1252] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:27.557980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8b364-e586-4499-a169-6f0d238adc2f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:27.656399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8b364-e586-4499-a169-6f0d238adc2f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:27.682239 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:27.690774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c70d62-9755-4fa0-a96e-cffe9142230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:27.691393 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70d62-9755-4fa0-a96e-cffe9142230d None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:27.691671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70d62-9755-4fa0-a96e-cffe9142230d None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:27.691942 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70d62-9755-4fa0-a96e-cffe9142230d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:27.699299 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c70d62-9755-4fa0-a96e-cffe9142230d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:27.702211 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c70d62-9755-4fa0-a96e-cffe9142230d None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:27.711659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-c1c70d62-9755-4fa0-a96e-cffe9142230d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 19:03:27.711659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:27.711659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:27.711659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:27.711659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:27.711659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:27.711659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:27.711659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:27.711659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:27.711659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:27.711659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:27.711659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:27.711659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:03:27.711659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:03:27.711659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:03:27.711659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:03:27.712730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:27.712730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:27.712730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:03:27.712730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:03:27.712730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:03:27.712730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:03:27.712730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:27.712730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:27.712730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:27.712730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:27.712730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:27.712730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:27.712730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:27.712730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:27.712730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:27.712730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:27.712730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:27.712730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:27.713854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:27.713854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:27.713854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:03:27.713854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:03:27.713854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:03:27.713854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:03:27.713854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:03:27.713854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:03:27.713854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 19:03:27.713854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:03:27.713854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 642/1253] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:03:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:27.718671 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a082b-13e7-4aa6-a62b-b03bd45adb92 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:27.773699 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:27.819373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a082b-13e7-4aa6-a62b-b03bd45adb92 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:27.853560 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dc450-4139-49a2-927b-d244679a2184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:27.854163 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dc450-4139-49a2-927b-d244679a2184 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:27.854443 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dc450-4139-49a2-927b-d244679a2184 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:27.854713 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77dc450-4139-49a2-927b-d244679a2184 None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:27.855478 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77dc450-4139-49a2-927b-d244679a2184 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:27.855784 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77dc450-4139-49a2-927b-d244679a2184 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:27.857208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77dc450-4139-49a2-927b-d244679a2184 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:27.874819 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 612/1254] 10.222.0.65 () {56 vars in 1143 bytes} [Tue Aug 9 19:03:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:27.880864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c70d62-9755-4fa0-a96e-cffe9142230d None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:27.979393 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c70d62-9755-4fa0-a96e-cffe9142230d None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:28.011743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369a05c-0334-4137-bcd8-9a493f881956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:28.012336 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369a05c-0334-4137-bcd8-9a493f881956 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:28.012625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369a05c-0334-4137-bcd8-9a493f881956 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:28.012882 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369a05c-0334-4137-bcd8-9a493f881956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:28.066594 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:28.078283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369a05c-0334-4137-bcd8-9a493f881956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:28.079726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369a05c-0334-4137-bcd8-9a493f881956 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:28.175437 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 643/1255] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:03:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:03:28.181377 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dc450-4139-49a2-927b-d244679a2184 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:28.279191 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77dc450-4139-49a2-927b-d244679a2184 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:28.292646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:28.313023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c135583-d54c-4fa1-a03d-d4c4ae0e4548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:28.313689 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c135583-d54c-4fa1-a03d-d4c4ae0e4548 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:28.313975 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c135583-d54c-4fa1-a03d-d4c4ae0e4548 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:28.314305 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c135583-d54c-4fa1-a03d-d4c4ae0e4548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:28.324514 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c135583-d54c-4fa1-a03d-d4c4ae0e4548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:28.325999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c135583-d54c-4fa1-a03d-d4c4ae0e4548 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:28.340863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-2c135583-d54c-4fa1-a03d-d4c4ae0e4548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:28.340863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:28.340863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:28.340863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:28.340863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:28.340863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:28.340863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:28.340863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:28.340863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:28.340863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:28.340863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:28.340863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:28.340863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:03:28.340863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:03:28.340863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:03:28.340863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:03:28.342016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:28.342016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:28.342016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:28.342016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:28.342016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:28.342016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:28.342016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:28.342016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:28.342016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:28.342016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:28.342016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:28.342016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:28.342016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:28.342016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:28.342016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:28.342016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:28.342016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:03:28.343277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:03:28.343277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:28.343277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:28.343277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 613/1256] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:28.348532 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369a05c-0334-4137-bcd8-9a493f881956 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:28.433580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:28.445291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369a05c-0334-4137-bcd8-9a493f881956 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:28.478519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de8c0f-1b34-4023-ae0c-4b0f6b223f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:28.479116 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de8c0f-1b34-4023-ae0c-4b0f6b223f4e None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:28.479395 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de8c0f-1b34-4023-ae0c-4b0f6b223f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:28.479666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de8c0f-1b34-4023-ae0c-4b0f6b223f4e None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:28.480296 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de8c0f-1b34-4023-ae0c-4b0f6b223f4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:28.480602 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de8c0f-1b34-4023-ae0c-4b0f6b223f4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:28.481994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de8c0f-1b34-4023-ae0c-4b0f6b223f4e None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:28.492897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 644/1257] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:28.498632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c135583-d54c-4fa1-a03d-d4c4ae0e4548 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:28.600851 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c135583-d54c-4fa1-a03d-d4c4ae0e4548 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:28.634577 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63bac9-7f5d-4a12-a179-36a1123aad82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:28.635197 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63bac9-7f5d-4a12-a179-36a1123aad82 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:28.635473 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63bac9-7f5d-4a12-a179-36a1123aad82 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:28.635743 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63bac9-7f5d-4a12-a179-36a1123aad82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:28.643126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63bac9-7f5d-4a12-a179-36a1123aad82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:28.644811 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63bac9-7f5d-4a12-a179-36a1123aad82 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:28.655734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-cd63bac9-7f5d-4a12-a179-36a1123aad82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:03:28.655734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:28.655734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:28.655734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:28.655734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:28.655734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:28.655734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:28.655734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:28.655734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:28.655734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:28.655734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:28.655734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:28.655734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:03:28.655734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:03:28.655734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:03:28.656879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:03:28.656879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:28.656879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:28.656879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:28.656879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:28.656879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:28.656879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:28.656879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:28.656879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:28.656879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:28.656879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:28.656879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:28.656879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:28.656879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:28.656879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:28.656879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:28.656879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:28.658047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:03:28.658047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:03:28.658047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:03:28.658047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:03:28.658047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:03:28.658047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:03:28.658047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:03:28.658047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:28.658047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 614/1258] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:03:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:28.662695 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de8c0f-1b34-4023-ae0c-4b0f6b223f4e None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:28.759520 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de8c0f-1b34-4023-ae0c-4b0f6b223f4e None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:28.791989 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927907c4-c76e-42a2-a691-a98028a739c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:28.792584 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927907c4-c76e-42a2-a691-a98028a739c1 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:28.792863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927907c4-c76e-42a2-a691-a98028a739c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:28.793134 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927907c4-c76e-42a2-a691-a98028a739c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:28.793847 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927907c4-c76e-42a2-a691-a98028a739c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:28.794155 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927907c4-c76e-42a2-a691-a98028a739c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:28.795572 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927907c4-c76e-42a2-a691-a98028a739c1 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:28.806990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 645/1259] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:03:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:28.813106 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63bac9-7f5d-4a12-a179-36a1123aad82 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:28.840366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:28.911519 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63bac9-7f5d-4a12-a179-36a1123aad82 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:28.944748 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f20040-7493-423d-a5e9-1f7cb4bafdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:28.945344 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f20040-7493-423d-a5e9-1f7cb4bafdb7 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:28.945647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f20040-7493-423d-a5e9-1f7cb4bafdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:28.945919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f20040-7493-423d-a5e9-1f7cb4bafdb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:28.946633 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f20040-7493-423d-a5e9-1f7cb4bafdb7 None admin] RBAC: Adding query filter params (role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=c6172f0733384291992624ef6a527ea2) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:28.946947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f20040-7493-423d-a5e9-1f7cb4bafdb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:28.948375 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f20040-7493-423d-a5e9-1f7cb4bafdb7 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:28.953627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 615/1260] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:03:28 2022] GET /identity/v3/role_assignments?user.id=c6172f0733384291992624ef6a527ea2&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:30.926505 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d2ab0-517d-48a5-b436-c5a07db9d06e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:30.927032 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d2ab0-517d-48a5-b436-c5a07db9d06e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:30.927032 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d2ab0-517d-48a5-b436-c5a07db9d06e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:30.928408 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 646/1261] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:03:30.933662 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff2b9e-ce19-40af-9f58-342315e35743 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:30.934107 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff2b9e-ce19-40af-9f58-342315e35743 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:30.934244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff2b9e-ce19-40af-9f58-342315e35743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:30.952620 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-e1ff2b9e-ce19-40af-9f58-342315e35743 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:03:30.953843 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e1ff2b9e-ce19-40af-9f58-342315e35743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:03:31.019640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 616/1262] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:03:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:03:31.041655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d2ab0-517d-48a5-b436-c5a07db9d06e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:31.052370 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:31.140758 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d2ab0-517d-48a5-b436-c5a07db9d06e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:31.174277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e953b-c681-4705-8e2b-3daf4d87a1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:31.174893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e953b-c681-4705-8e2b-3daf4d87a1ab None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:31.175169 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e953b-c681-4705-8e2b-3daf4d87a1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:31.175438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e953b-c681-4705-8e2b-3daf4d87a1ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:31.185353 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e953b-c681-4705-8e2b-3daf4d87a1ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:03:31.190731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-250e953b-c681-4705-8e2b-3daf4d87a1ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:03:31.190731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:31.190731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:31.190731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:31.190731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:31.190731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:31.190731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:31.190731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:31.190731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:31.190731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:31.190731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:31.190731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:31.190731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:03:31.190731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:03:31.190731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:03:31.190731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:03:31.191936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:03:31.191936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:03:31.191936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:03:31.191936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:03:31.191936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:31.191936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:31.191936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:31.191936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:31.191936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:31.191936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:31.191936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:31.191936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:31.191936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:31.191936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:31.191936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:31.191936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:31.193195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:31.193195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:31.193195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:31.193195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:31.193195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:03:31.193195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:03:31.193195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:03:31.193195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:03:31.193195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:03:31.193195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:03:31.193195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:03:31.193195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:03:31.193195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 647/1263] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:03:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:31.197849 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff2b9e-ce19-40af-9f58-342315e35743 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:31.215859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:31.294417 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff2b9e-ce19-40af-9f58-342315e35743 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:31.328168 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7def2-eef9-457b-891c-683e5ab94a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:31.328761 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7def2-eef9-457b-891c-683e5ab94a38 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:31.329043 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7def2-eef9-457b-891c-683e5ab94a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:31.329386 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7def2-eef9-457b-891c-683e5ab94a38 None admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:31.330121 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7def2-eef9-457b-891c-683e5ab94a38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:31.330414 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7def2-eef9-457b-891c-683e5ab94a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:31.331860 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7def2-eef9-457b-891c-683e5ab94a38 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:31.340915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 617/1264] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:03:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:31.346867 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e953b-c681-4705-8e2b-3daf4d87a1ab None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:31.415487 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:31.449002 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e953b-c681-4705-8e2b-3daf4d87a1ab None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:31.481374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560b4e9-7962-40f7-8378-d21a4731c019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:31.482029 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560b4e9-7962-40f7-8378-d21a4731c019 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:31.482313 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560b4e9-7962-40f7-8378-d21a4731c019 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:31.482587 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560b4e9-7962-40f7-8378-d21a4731c019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:31.493512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560b4e9-7962-40f7-8378-d21a4731c019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:31.494957 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560b4e9-7962-40f7-8378-d21a4731c019 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:31.509645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-e560b4e9-7962-40f7-8378-d21a4731c019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:31.509645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:31.509645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:31.509645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:31.509645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:31.509645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:31.509645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:31.509645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:31.509645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:31.509645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:31.509645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:31.509645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:31.509645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:03:31.509645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:03:31.509645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:03:31.509645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:03:31.510708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:31.510708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:31.510708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:31.510708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:31.510708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:31.510708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:31.510708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:31.510708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:31.510708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:31.510708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:31.510708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:31.510708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:31.510708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:31.510708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:31.510708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:31.510708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:31.510708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:03:31.511630 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:03:31.511630 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:31.511630 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:03:31.511630 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 648/1265] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:31.516567 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7def2-eef9-457b-891c-683e5ab94a38 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:31.596511 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:31.615090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7def2-eef9-457b-891c-683e5ab94a38 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:31.646759 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed3f92-1991-478c-a1b7-8eeaefcc9916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:31.647362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed3f92-1991-478c-a1b7-8eeaefcc9916 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:31.647643 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed3f92-1991-478c-a1b7-8eeaefcc9916 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:31.647911 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed3f92-1991-478c-a1b7-8eeaefcc9916 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:31.648542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed3f92-1991-478c-a1b7-8eeaefcc9916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:31.648843 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed3f92-1991-478c-a1b7-8eeaefcc9916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:31.650225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed3f92-1991-478c-a1b7-8eeaefcc9916 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:31.662030 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 618/1266] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:31.668042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560b4e9-7962-40f7-8378-d21a4731c019 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:31.764851 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560b4e9-7962-40f7-8378-d21a4731c019 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:31.784896 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:31.799028 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a2c83-05b3-48b1-9cc8-dae0e4d9cc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:31.799644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a2c83-05b3-48b1-9cc8-dae0e4d9cc57 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:31.799921 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a2c83-05b3-48b1-9cc8-dae0e4d9cc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:31.800193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a2c83-05b3-48b1-9cc8-dae0e4d9cc57 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:31.807333 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a2c83-05b3-48b1-9cc8-dae0e4d9cc57 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:31.808754 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a2c83-05b3-48b1-9cc8-dae0e4d9cc57 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:31.819864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-fa5a2c83-05b3-48b1-9cc8-dae0e4d9cc57 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 19:03:31.819864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:31.819864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:31.819864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:31.819864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:31.819864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:31.819864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:31.819864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:31.819864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:31.819864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:31.819864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:31.819864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:31.819864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:03:31.819864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:03:31.819864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:03:31.819864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:03:31.821052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:31.821052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:31.821052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:03:31.821052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:03:31.821052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:03:31.821052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:03:31.821052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:31.821052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:31.821052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:31.821052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:31.821052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:31.821052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:31.821052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:31.821052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:31.821052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:31.821052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:31.821052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:31.821052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:31.822394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:31.822394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:31.822394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:03:31.822394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:03:31.822394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:03:31.822394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:03:31.822394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:03:31.822394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:03:31.822394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 19:03:31.822394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:03:31.822394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 649/1267] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:03:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:31.826864 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed3f92-1991-478c-a1b7-8eeaefcc9916 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:31.928339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed3f92-1991-478c-a1b7-8eeaefcc9916 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:31.962256 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5705c-4758-4f33-b53b-b008b4b2d44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:31.962854 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5705c-4758-4f33-b53b-b008b4b2d44d None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:31.963132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5705c-4758-4f33-b53b-b008b4b2d44d None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:31.963399 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5705c-4758-4f33-b53b-b008b4b2d44d None admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:31.964107 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5705c-4758-4f33-b53b-b008b4b2d44d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:31.964409 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5705c-4758-4f33-b53b-b008b4b2d44d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:31.965846 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5705c-4758-4f33-b53b-b008b4b2d44d None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:31.974260 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:31.982294 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 619/1268] 10.222.0.65 () {56 vars in 1143 bytes} [Tue Aug 9 19:03:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:31.988594 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a2c83-05b3-48b1-9cc8-dae0e4d9cc57 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:32.087821 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a2c83-05b3-48b1-9cc8-dae0e4d9cc57 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:32.120819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15ddb9-b818-4f88-be55-b8894ad6cb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:32.121443 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ddb9-b818-4f88-be55-b8894ad6cb69 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:32.121753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ddb9-b818-4f88-be55-b8894ad6cb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:32.122023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15ddb9-b818-4f88-be55-b8894ad6cb69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:32.132501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15ddb9-b818-4f88-be55-b8894ad6cb69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:32.136299 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15ddb9-b818-4f88-be55-b8894ad6cb69 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:32.148381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-de15ddb9-b818-4f88-be55-b8894ad6cb69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:32.148381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:32.148381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:32.148381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:32.148381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:32.148381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:32.148381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:32.148381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:32.148381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:32.148381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:32.148381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:32.148381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:32.148381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:03:32.148381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:03:32.148381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:03:32.148381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:03:32.149497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:32.149497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:32.149497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:32.149497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:32.149497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:32.149497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:32.149497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:32.149497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:32.149497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:32.149497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:32.149497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:32.149497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:32.149497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:32.149497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:32.149497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:32.149497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:32.149497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:03:32.150433 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:03:32.150433 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:32.150433 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:03:32.150433 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 650/1269] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:32.155459 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5705c-4758-4f33-b53b-b008b4b2d44d None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:32.255965 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5705c-4758-4f33-b53b-b008b4b2d44d None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:32.289891 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87183f44-2e5e-4cdc-a7cb-87d1e732b051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:32.290485 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87183f44-2e5e-4cdc-a7cb-87d1e732b051 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:32.290764 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87183f44-2e5e-4cdc-a7cb-87d1e732b051 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:32.291035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87183f44-2e5e-4cdc-a7cb-87d1e732b051 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:32.291664 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87183f44-2e5e-4cdc-a7cb-87d1e732b051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:32.291965 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87183f44-2e5e-4cdc-a7cb-87d1e732b051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:32.293322 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87183f44-2e5e-4cdc-a7cb-87d1e732b051 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:32.304155 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 620/1270] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:32.310038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15ddb9-b818-4f88-be55-b8894ad6cb69 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:32.342092 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:32.410024 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15ddb9-b818-4f88-be55-b8894ad6cb69 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:32.442854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa75f6e-54cd-48db-855d-7302272bb725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:32.443480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa75f6e-54cd-48db-855d-7302272bb725 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:32.443759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa75f6e-54cd-48db-855d-7302272bb725 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:32.444029 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa75f6e-54cd-48db-855d-7302272bb725 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:32.450398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa75f6e-54cd-48db-855d-7302272bb725 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:32.451838 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa75f6e-54cd-48db-855d-7302272bb725 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:32.462999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-bfa75f6e-54cd-48db-855d-7302272bb725 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:03:32.462999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:32.462999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:32.462999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:32.462999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:32.462999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:32.462999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:32.462999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:32.462999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:32.462999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:32.462999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:32.462999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:32.462999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:03:32.462999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:03:32.462999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:03:32.464046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:03:32.464046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:32.464046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:32.464046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:32.464046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:32.464046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:32.464046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:32.464046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:32.464046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:32.464046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:32.464046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:32.464046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:32.464046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:32.464046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:32.464046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:32.464046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:32.464046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:32.465173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:03:32.465173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:03:32.465173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:03:32.465173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:03:32.465173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:03:32.465173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:03:32.465173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:03:32.465173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:03:32.465173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 651/1271] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:03:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:32.470574 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87183f44-2e5e-4cdc-a7cb-87d1e732b051 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:32.530696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:32.572607 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87183f44-2e5e-4cdc-a7cb-87d1e732b051 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:32.606244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd07410-1147-4312-b715-dd264b418ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:32.606787 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd07410-1147-4312-b715-dd264b418ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:32.607069 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd07410-1147-4312-b715-dd264b418ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:32.607345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd07410-1147-4312-b715-dd264b418ec1 None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:32.608047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd07410-1147-4312-b715-dd264b418ec1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:32.608360 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd07410-1147-4312-b715-dd264b418ec1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:32.609820 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd07410-1147-4312-b715-dd264b418ec1 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:32.622083 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 621/1272] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:03:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:32.628899 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa75f6e-54cd-48db-855d-7302272bb725 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:32.721597 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:32.729924 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa75f6e-54cd-48db-855d-7302272bb725 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:32.762322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd5547-8321-437f-8ceb-0ce0944d4971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:32.762969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd5547-8321-437f-8ceb-0ce0944d4971 None admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:32.763247 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd5547-8321-437f-8ceb-0ce0944d4971 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:32.763517 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd5547-8321-437f-8ceb-0ce0944d4971 None admin] PATH_INFO: `/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/c6172f0733384291992624ef6a527ea2/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:32.765500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd5547-8321-437f-8ceb-0ce0944d4971 None admin] RBAC: Authorizing `identity:create_grant(project_id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user_id=c6172f0733384291992624ef6a527ea2, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:32.767425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd5547-8321-437f-8ceb-0ce0944d4971 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:32.827221 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 652/1273] 10.222.0.65 () {58 vars in 1439 bytes} [Tue Aug 9 19:03:32 2022] PUT /identity/v3/projects/c90c37ebe7a44ad2a10a9d2b5a1e2ec8/users/c6172f0733384291992624ef6a527ea2/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:03:34.831784 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64d99a-5977-43b1-a027-573c4bd244e2 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:34.832348 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64d99a-5977-43b1-a027-573c4bd244e2 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:34.832348 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64d99a-5977-43b1-a027-573c4bd244e2 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:34.833633 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 622/1274] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:03:34.838984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd573-abc4-4eac-a773-f53aaae7e85d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:34.839408 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd573-abc4-4eac-a773-f53aaae7e85d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:34.839595 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd573-abc4-4eac-a773-f53aaae7e85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:34.857524 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ca4dd573-abc4-4eac-a773-f53aaae7e85d None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:03:34.858705 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ca4dd573-abc4-4eac-a773-f53aaae7e85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:03:34.925640 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 653/1275] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:03:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:03:34.949288 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64d99a-5977-43b1-a027-573c4bd244e2 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:35.051349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64d99a-5977-43b1-a027-573c4bd244e2 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:35.068165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:35.084643 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01655bb-70b0-4879-a224-cebaacf27d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:35.085194 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01655bb-70b0-4879-a224-cebaacf27d26 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:35.085498 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01655bb-70b0-4879-a224-cebaacf27d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:35.085775 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01655bb-70b0-4879-a224-cebaacf27d26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:35.095980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01655bb-70b0-4879-a224-cebaacf27d26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 19:03:35.100719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-d01655bb-70b0-4879-a224-cebaacf27d26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:03:35.100719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:35.100719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:35.100719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:35.100719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:35.100719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:35.100719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:35.100719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:35.100719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:35.100719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:35.100719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:35.100719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:35.100719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 19:03:35.100719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 19:03:35.100719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 19:03:35.100719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 19:03:35.101835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 19:03:35.101835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 19:03:35.101835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 19:03:35.101835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 19:03:35.101835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:35.101835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:35.101835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:35.101835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:35.101835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:35.101835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:35.101835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:35.101835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:35.101835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:35.101835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:35.101835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:35.101835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:35.102875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:35.102875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:35.102875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:35.102875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:35.102875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 19:03:35.102875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 19:03:35.102875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 19:03:35.102875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 19:03:35.102875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 19:03:35.102875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 19:03:35.102875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 19:03:35.102875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:35.102875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 623/1276] 10.222.0.65 () {56 vars in 1096 bytes} [Tue Aug 9 19:03:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:35.108164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dd573-abc4-4eac-a773-f53aaae7e85d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:35.188091 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:35.206087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dd573-abc4-4eac-a773-f53aaae7e85d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:35.239131 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4fc3a-e0de-471f-b568-ca66073e1c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:35.239736 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4fc3a-e0de-471f-b568-ca66073e1c7a None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:35.240015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4fc3a-e0de-471f-b568-ca66073e1c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:35.240284 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4fc3a-e0de-471f-b568-ca66073e1c7a None admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:35.240951 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4fc3a-e0de-471f-b568-ca66073e1c7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:35.241255 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4fc3a-e0de-471f-b568-ca66073e1c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:35.242672 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4fc3a-e0de-471f-b568-ca66073e1c7a None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:35.250628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 654/1277] 10.222.0.65 () {56 vars in 1099 bytes} [Tue Aug 9 19:03:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:03:35.256888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01655bb-70b0-4879-a224-cebaacf27d26 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:35.356697 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01655bb-70b0-4879-a224-cebaacf27d26 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:35.390702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3fd5b-b52b-4a0c-90b1-65ed2b57eb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:35.391310 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3fd5b-b52b-4a0c-90b1-65ed2b57eb10 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:35.391590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3fd5b-b52b-4a0c-90b1-65ed2b57eb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:35.393592 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3fd5b-b52b-4a0c-90b1-65ed2b57eb10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:35.403460 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3fd5b-b52b-4a0c-90b1-65ed2b57eb10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:35.404878 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3fd5b-b52b-4a0c-90b1-65ed2b57eb10 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:35.418982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-31d3fd5b-b52b-4a0c-90b1-65ed2b57eb10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:35.418982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:35.418982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:35.418982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:35.418982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:35.418982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:35.418982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:35.418982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:35.418982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:35.418982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:35.418982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:35.418982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:35.418982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:03:35.418982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:03:35.418982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:03:35.418982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:03:35.420080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:35.420080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:35.420080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:35.420080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:35.420080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:35.420080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:35.420080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:35.420080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:35.420080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:35.420080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:35.420080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:35.420080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:35.420080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:35.420080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:35.420080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:35.420080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:35.420080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:03:35.421375 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:03:35.421375 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:35.421375 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:35.421375 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 624/1278] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:35.426263 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4fc3a-e0de-471f-b568-ca66073e1c7a None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:35.524442 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4fc3a-e0de-471f-b568-ca66073e1c7a None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:35.557503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ec14f-c5be-44e2-a8ab-c0b41b144247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:35.558134 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ec14f-c5be-44e2-a8ab-c0b41b144247 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:35.558424 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ec14f-c5be-44e2-a8ab-c0b41b144247 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:35.558696 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ec14f-c5be-44e2-a8ab-c0b41b144247 None admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:35.559330 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ec14f-c5be-44e2-a8ab-c0b41b144247 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:35.559638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ec14f-c5be-44e2-a8ab-c0b41b144247 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:35.561037 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ec14f-c5be-44e2-a8ab-c0b41b144247 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:35.573393 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 655/1279] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:35.579134 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3fd5b-b52b-4a0c-90b1-65ed2b57eb10 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:35.611095 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:35.679633 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3fd5b-b52b-4a0c-90b1-65ed2b57eb10 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:35.713035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8ea0f-fb66-40ad-910d-dd2ce2aecb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:35.713689 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8ea0f-fb66-40ad-910d-dd2ce2aecb92 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:35.713971 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8ea0f-fb66-40ad-910d-dd2ce2aecb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:35.714242 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8ea0f-fb66-40ad-910d-dd2ce2aecb92 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:35.721801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8ea0f-fb66-40ad-910d-dd2ce2aecb92 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:35.723284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8ea0f-fb66-40ad-910d-dd2ce2aecb92 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:35.734415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-9fc8ea0f-fb66-40ad-910d-dd2ce2aecb92 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 19:03:35.734415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:35.734415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:35.734415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:35.734415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:35.734415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:35.734415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:35.734415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:35.734415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:35.734415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:35.734415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:35.734415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:35.734415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 19:03:35.734415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 19:03:35.734415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 19:03:35.734415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 19:03:35.735626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:35.735626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:35.735626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 19:03:35.735626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:03:35.735626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 19:03:35.735626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 19:03:35.735626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:35.735626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:35.735626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:35.735626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:35.735626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:35.735626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:35.735626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:35.735626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:35.735626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:35.735626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:35.735626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:35.735626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:35.736597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:35.736597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:35.736597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 19:03:35.736597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 19:03:35.736597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 19:03:35.736597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 19:03:35.736597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 19:03:35.736597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 19:03:35.736597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 19:03:35.736597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:35.736597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 625/1280] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:03:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:35.741599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ec14f-c5be-44e2-a8ab-c0b41b144247 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:35.745296 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:35.838875 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ec14f-c5be-44e2-a8ab-c0b41b144247 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:35.872136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845d16b-288d-43d0-aa49-19b62801f2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:35.872733 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845d16b-288d-43d0-aa49-19b62801f2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:35.872951 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845d16b-288d-43d0-aa49-19b62801f2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:35.873224 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845d16b-288d-43d0-aa49-19b62801f2a2 None admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:35.873968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845d16b-288d-43d0-aa49-19b62801f2a2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:35.874274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845d16b-288d-43d0-aa49-19b62801f2a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:35.875940 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845d16b-288d-43d0-aa49-19b62801f2a2 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:35.895436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 656/1281] 10.222.0.65 () {56 vars in 1143 bytes} [Tue Aug 9 19:03:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:03:35.901351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8ea0f-fb66-40ad-910d-dd2ce2aecb92 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:35.989279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:35.998435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8ea0f-fb66-40ad-910d-dd2ce2aecb92 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:36.031113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaeb2eb-475d-449e-aaa8-39626c7c2c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:36.031710 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaeb2eb-475d-449e-aaa8-39626c7c2c70 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:36.032023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaeb2eb-475d-449e-aaa8-39626c7c2c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:36.032311 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaeb2eb-475d-449e-aaa8-39626c7c2c70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:36.099069 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaeb2eb-475d-449e-aaa8-39626c7c2c70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:36.100513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaeb2eb-475d-449e-aaa8-39626c7c2c70 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:36.185949 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:36.196562 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 626/1282] 10.222.0.65 () {58 vars in 1282 bytes} [Tue Aug 9 19:03:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 19:03:36.202613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845d16b-288d-43d0-aa49-19b62801f2a2 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:36.263234 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:36.300495 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845d16b-288d-43d0-aa49-19b62801f2a2 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:36.334400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd2ff5-fbd9-4310-a257-261530ff6f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:36.338744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd2ff5-fbd9-4310-a257-261530ff6f67 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:36.338744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd2ff5-fbd9-4310-a257-261530ff6f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:36.338744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd2ff5-fbd9-4310-a257-261530ff6f67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:36.345170 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd2ff5-fbd9-4310-a257-261530ff6f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:36.346620 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd2ff5-fbd9-4310-a257-261530ff6f67 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:36.360810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-9cbd2ff5-fbd9-4310-a257-261530ff6f67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:36.360810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:36.360810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:36.360810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:36.360810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:36.360810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:36.360810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:36.360810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:36.360810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:36.360810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:36.360810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:36.360810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:36.360810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 19:03:36.360810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 19:03:36.360810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 19:03:36.360810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 19:03:36.364297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:36.364297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:36.364297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:36.364297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:36.364297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:36.364297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:36.364297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:36.364297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:36.364297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:36.364297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:36.364297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:36.364297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:36.364297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:36.364297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:36.364297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:36.364297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:36.364297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 19:03:36.365228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 19:03:36.365228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 19:03:36.365228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:03:36.365228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 657/1283] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:36.367996 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaeb2eb-475d-449e-aaa8-39626c7c2c70 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:36.466791 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaeb2eb-475d-449e-aaa8-39626c7c2c70 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:36.499530 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93087e2c-1229-40f2-aec0-fc2d5014b701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:36.500224 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93087e2c-1229-40f2-aec0-fc2d5014b701 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:36.500502 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93087e2c-1229-40f2-aec0-fc2d5014b701 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:36.501075 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93087e2c-1229-40f2-aec0-fc2d5014b701 None admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:36.502248 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93087e2c-1229-40f2-aec0-fc2d5014b701 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:36.502550 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93087e2c-1229-40f2-aec0-fc2d5014b701 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:36.503915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93087e2c-1229-40f2-aec0-fc2d5014b701 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:36.515371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 627/1284] 10.222.0.65 () {56 vars in 1109 bytes} [Tue Aug 9 19:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:36.521312 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd2ff5-fbd9-4310-a257-261530ff6f67 None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:36.620214 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd2ff5-fbd9-4310-a257-261530ff6f67 None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:36.634178 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:36.653439 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2308f4-aba2-45ef-9db2-9b1f70bd0f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:36.654097 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2308f4-aba2-45ef-9db2-9b1f70bd0f7c None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:36.654376 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2308f4-aba2-45ef-9db2-9b1f70bd0f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:36.654647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2308f4-aba2-45ef-9db2-9b1f70bd0f7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:36.661244 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2308f4-aba2-45ef-9db2-9b1f70bd0f7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:36.662725 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2308f4-aba2-45ef-9db2-9b1f70bd0f7c None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:36.674173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application [None req-ef2308f4-aba2-45ef-9db2-9b1f70bd0f7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:03:36.674173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:36.674173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:36.674173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:36.674173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:36.674173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:36.674173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:36.674173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:36.674173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:36.674173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:36.674173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:36.674173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:36.674173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 19:03:36.674173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 19:03:36.674173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 19:03:36.675133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 19:03:36.675133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:36.675133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:36.675133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:36.675133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:36.675133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:36.675133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:36.675133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:36.675133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:36.675133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:36.675133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:36.675133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:36.675133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:36.675133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:36.675133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:36.675133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:36.675133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:36.676054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 19:03:36.676054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 19:03:36.676054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 19:03:36.676054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 19:03:36.676054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 19:03:36.676054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 19:03:36.676054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 19:03:36.676054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: ERROR keystone.server.flask.application Aug 09 19:03:36.677613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 658/1285] 10.222.0.65 () {56 vars in 1111 bytes} [Tue Aug 9 19:03:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:36.681651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93087e2c-1229-40f2-aec0-fc2d5014b701 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:36.730936 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:36.779527 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93087e2c-1229-40f2-aec0-fc2d5014b701 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:36.811578 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408bc2b-4db9-4bc6-b080-37eab2dbe1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:36.812172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408bc2b-4db9-4bc6-b080-37eab2dbe1cd None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:36.812449 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408bc2b-4db9-4bc6-b080-37eab2dbe1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:36.812720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408bc2b-4db9-4bc6-b080-37eab2dbe1cd None admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:36.813393 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408bc2b-4db9-4bc6-b080-37eab2dbe1cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:36.814270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408bc2b-4db9-4bc6-b080-37eab2dbe1cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:36.815775 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408bc2b-4db9-4bc6-b080-37eab2dbe1cd None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:36.828691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 628/1286] 10.222.0.65 () {56 vars in 1148 bytes} [Tue Aug 9 19:03:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:36.834629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2308f4-aba2-45ef-9db2-9b1f70bd0f7c None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:36.934837 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2308f4-aba2-45ef-9db2-9b1f70bd0f7c None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:36.967046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f08f0-481d-4ae1-8f3d-ef57bc6b6809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:36.967636 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f08f0-481d-4ae1-8f3d-ef57bc6b6809 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:36.967912 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f08f0-481d-4ae1-8f3d-ef57bc6b6809 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:36.968179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f08f0-481d-4ae1-8f3d-ef57bc6b6809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:36.968884 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f08f0-481d-4ae1-8f3d-ef57bc6b6809 None admin] RBAC: Adding query filter params (role.id=cc3fa8da8fea4b5893865a4f721f22cb, scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8, user.id=c6172f0733384291992624ef6a527ea2) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:36.969189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f08f0-481d-4ae1-8f3d-ef57bc6b6809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:36.971355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f08f0-481d-4ae1-8f3d-ef57bc6b6809 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:36.977009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 659/1287] 10.222.0.65 () {56 vars in 1374 bytes} [Tue Aug 9 19:03:36 2022] GET /identity/v3/role_assignments?user.id=c6172f0733384291992624ef6a527ea2&scope.project.id=c90c37ebe7a44ad2a10a9d2b5a1e2ec8&role.id=cc3fa8da8fea4b5893865a4f721f22cb => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:39.041091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f73a7-2aba-4bf3-bff3-9c0f8378e1e1 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:39.041700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f73a7-2aba-4bf3-bff3-9c0f8378e1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:39.041700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f73a7-2aba-4bf3-bff3-9c0f8378e1e1 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:39.043026 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 629/1288] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:03:39.048824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74df18-cb1c-4602-9d4b-1bda5ab2e2cb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:39.049310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74df18-cb1c-4602-9d4b-1bda5ab2e2cb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:39.050748 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74df18-cb1c-4602-9d4b-1bda5ab2e2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:39.069587 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9a74df18-cb1c-4602-9d4b-1bda5ab2e2cb None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:03:39.070779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9a74df18-cb1c-4602-9d4b-1bda5ab2e2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:03:39.101317 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:39.139334 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 660/1289] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:03:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:03:39.163640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f73a7-2aba-4bf3-bff3-9c0f8378e1e1 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:39.269709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f73a7-2aba-4bf3-bff3-9c0f8378e1e1 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:39.280037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:39.303709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486f3cc-ad67-4f9d-bb53-5b455b2aa311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:39.304274 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486f3cc-ad67-4f9d-bb53-5b455b2aa311 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:39.304555 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486f3cc-ad67-4f9d-bb53-5b455b2aa311 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:39.304834 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486f3cc-ad67-4f9d-bb53-5b455b2aa311 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:39.305415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486f3cc-ad67-4f9d-bb53-5b455b2aa311 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:39.306794 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486f3cc-ad67-4f9d-bb53-5b455b2aa311 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:39.315270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-4486f3cc-ad67-4f9d-bb53-5b455b2aa311 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 19:03:39.315270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:39.315270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:03:39.315270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:03:39.315270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:03:39.315270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:03:39.315270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:03:39.315270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:03:39.315270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 19:03:39.315270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:39.315270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:03:39.315270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:39.315270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:39.315270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:39.315270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:39.315270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:39.315270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:39.316487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:39.316487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:39.316487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:39.316487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:39.316487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:39.316487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:39.316487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:03:39.316487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:03:39.316487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:03:39.316487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:03:39.316487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:39.316487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:39.316487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:39.316487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:39.316487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:39.316487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:39.317584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:39.317584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:39.317584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:39.317584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:39.317584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:39.317584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:39.317584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:39.317584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:39.317584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:39.317584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:39.317584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:03:39.317584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:03:39.317584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 19:03:39.317584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:39.317584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 630/1290] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Aug 9 19:03:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:39.322476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74df18-cb1c-4602-9d4b-1bda5ab2e2cb None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:39.420507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74df18-cb1c-4602-9d4b-1bda5ab2e2cb None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:39.453419 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ae23d-94cb-479c-9648-2ac2711a2d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:39.454750 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ae23d-94cb-479c-9648-2ac2711a2d00 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:39.455195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ae23d-94cb-479c-9648-2ac2711a2d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:39.455681 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ae23d-94cb-479c-9648-2ac2711a2d00 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:39.456326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ae23d-94cb-479c-9648-2ac2711a2d00 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:39.456632 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ae23d-94cb-479c-9648-2ac2711a2d00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:39.458169 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ae23d-94cb-479c-9648-2ac2711a2d00 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:39.462843 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 661/1291] 10.222.0.65 () {56 vars in 1116 bytes} [Tue Aug 9 19:03:39 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:39.468726 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486f3cc-ad67-4f9d-bb53-5b455b2aa311 None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:39.567400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486f3cc-ad67-4f9d-bb53-5b455b2aa311 None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:39.600287 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa759c10-64d5-49e8-adad-c7de409b569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:39.600882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa759c10-64d5-49e8-adad-c7de409b569c None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:39.601160 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa759c10-64d5-49e8-adad-c7de409b569c None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:39.601488 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa759c10-64d5-49e8-adad-c7de409b569c None admin] PATH_INFO: `/v3/services` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:39.602098 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa759c10-64d5-49e8-adad-c7de409b569c None admin] RBAC: Adding query filter params (type=placement) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:39.602398 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa759c10-64d5-49e8-adad-c7de409b569c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:39.603744 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa759c10-64d5-49e8-adad-c7de409b569c None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:39.608023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 631/1292] 10.222.0.65 () {56 vars in 1116 bytes} [Tue Aug 9 19:03:39 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:41.593425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cd0a4-4ba4-44a1-a44b-60b95b1e761a None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:41.594023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cd0a4-4ba4-44a1-a44b-60b95b1e761a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:41.594023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cd0a4-4ba4-44a1-a44b-60b95b1e761a None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:41.595715 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 662/1293] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:03:41.600815 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b740375-d42b-4793-8bcf-7ae9d1fd5938 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:41.601545 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b740375-d42b-4793-8bcf-7ae9d1fd5938 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:41.601545 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b740375-d42b-4793-8bcf-7ae9d1fd5938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:41.619311 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2b740375-d42b-4793-8bcf-7ae9d1fd5938 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:03:41.620506 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2b740375-d42b-4793-8bcf-7ae9d1fd5938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:03:41.651134 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:41.688964 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 632/1294] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:03:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:03:41.711154 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cd0a4-4ba4-44a1-a44b-60b95b1e761a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:41.742354 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:41.812214 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cd0a4-4ba4-44a1-a44b-60b95b1e761a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:41.846722 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c398a-31b5-4ebb-b0a6-e43875f175c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:41.847317 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c398a-31b5-4ebb-b0a6-e43875f175c9 None admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:41.847598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c398a-31b5-4ebb-b0a6-e43875f175c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:41.847868 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c398a-31b5-4ebb-b0a6-e43875f175c9 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:41.848500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c398a-31b5-4ebb-b0a6-e43875f175c9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:41.850006 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c398a-31b5-4ebb-b0a6-e43875f175c9 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:41.918709 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 663/1295] 10.222.0.65 () {60 vars in 1141 bytes} [Tue Aug 9 19:03:41 2022] POST /identity/v3/services => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:03:43.931308 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff6049-e1bf-49f1-87e1-933a1cae8518 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:43.931828 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff6049-e1bf-49f1-87e1-933a1cae8518 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:43.931919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff6049-e1bf-49f1-87e1-933a1cae8518 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:43.933308 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 633/1296] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:03:43.938549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc181cdd-9925-4255-a644-72b85725d6f5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:43.938989 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc181cdd-9925-4255-a644-72b85725d6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:43.939163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc181cdd-9925-4255-a644-72b85725d6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:43.957948 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-fc181cdd-9925-4255-a644-72b85725d6f5 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:03:43.959168 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fc181cdd-9925-4255-a644-72b85725d6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:03:44.030386 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 664/1297] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:03:43 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:03:44.053220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff6049-e1bf-49f1-87e1-933a1cae8518 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:44.150841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff6049-e1bf-49f1-87e1-933a1cae8518 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:44.184716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e8301-d24c-4372-8901-e680d1c4932f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:44.185269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e8301-d24c-4372-8901-e680d1c4932f None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:44.185580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e8301-d24c-4372-8901-e680d1c4932f None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:44.185853 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e8301-d24c-4372-8901-e680d1c4932f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:44.186476 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e8301-d24c-4372-8901-e680d1c4932f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:44.187834 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e8301-d24c-4372-8901-e680d1c4932f None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:44.196406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-8f0e8301-d24c-4372-8901-e680d1c4932f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 19:03:44.196406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:44.196406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:03:44.196406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:03:44.196406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:03:44.196406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:03:44.196406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:03:44.196406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:03:44.196406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 19:03:44.196406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:44.196406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:03:44.196406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:44.196406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:44.196406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:44.196406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:44.196406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:44.196406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:44.197597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:44.197597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:44.197597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:44.197597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:44.197597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:44.197597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:44.197597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:03:44.197597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:03:44.197597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:03:44.197597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:03:44.197597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:44.197597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:44.197597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:44.197597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:44.197597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:44.197597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:44.198835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:44.198835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:44.198835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:44.198835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:44.198835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:44.198835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:44.198835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:44.198835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:44.198835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:44.198835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:44.198835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:03:44.198835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:03:44.198835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 19:03:44.198835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:44.198835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 634/1298] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Aug 9 19:03:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 19:03:44.204157 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc181cdd-9925-4255-a644-72b85725d6f5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:44.222672 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:44.300603 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc181cdd-9925-4255-a644-72b85725d6f5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:44.335488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9332b58-e2f4-442a-882c-97b0f9ffe76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:44.336088 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9332b58-e2f4-442a-882c-97b0f9ffe76f None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:44.336368 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9332b58-e2f4-442a-882c-97b0f9ffe76f None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:44.336640 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9332b58-e2f4-442a-882c-97b0f9ffe76f None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:44.337266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9332b58-e2f4-442a-882c-97b0f9ffe76f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:44.337603 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9332b58-e2f4-442a-882c-97b0f9ffe76f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:44.339057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9332b58-e2f4-442a-882c-97b0f9ffe76f None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:44.344012 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 665/1299] 10.222.0.65 () {56 vars in 1116 bytes} [Tue Aug 9 19:03:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:44.350313 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e8301-d24c-4372-8901-e680d1c4932f None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:44.382992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:44.449667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e8301-d24c-4372-8901-e680d1c4932f None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:44.482032 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c89ee8-5aeb-4046-90b9-7193d37a55b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:44.482634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c89ee8-5aeb-4046-90b9-7193d37a55b9 None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:44.482911 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c89ee8-5aeb-4046-90b9-7193d37a55b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:44.483179 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c89ee8-5aeb-4046-90b9-7193d37a55b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:44.483874 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c89ee8-5aeb-4046-90b9-7193d37a55b9 None admin] RBAC: Adding query filter params (interface=public, service_id=a8ce46b9d3514eb5aeca3465ff1662bc, region_id=RegionOne) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:44.484181 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c89ee8-5aeb-4046-90b9-7193d37a55b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:44.485734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c89ee8-5aeb-4046-90b9-7193d37a55b9 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:44.490533 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 635/1300] 10.222.0.65 () {56 vars in 1251 bytes} [Tue Aug 9 19:03:44 2022] GET /identity/v3/endpoints?service_id=a8ce46b9d3514eb5aeca3465ff1662bc&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:03:44.496194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9332b58-e2f4-442a-882c-97b0f9ffe76f None admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:44.577175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:44.595006 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9332b58-e2f4-442a-882c-97b0f9ffe76f None admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:44.627223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66380847-d101-4c26-af5c-7f2697583e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:44.627822 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66380847-d101-4c26-af5c-7f2697583e49 None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:44.628100 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66380847-d101-4c26-af5c-7f2697583e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:44.628373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66380847-d101-4c26-af5c-7f2697583e49 None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:44.628968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66380847-d101-4c26-af5c-7f2697583e49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:44.630338 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66380847-d101-4c26-af5c-7f2697583e49 None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:44.637086 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 666/1301] 10.222.0.65 () {56 vars in 1087 bytes} [Tue Aug 9 19:03:44 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:03:46.645061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e47dc-88d0-43f5-9140-0c659463b99a None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:46.645618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e47dc-88d0-43f5-9140-0c659463b99a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:46.645728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e47dc-88d0-43f5-9140-0c659463b99a None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:46.646980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 636/1302] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:03:46.652270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba7bcd-da1c-45f3-b1b8-3b87ae0fd795 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:46.652674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba7bcd-da1c-45f3-b1b8-3b87ae0fd795 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:46.652823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba7bcd-da1c-45f3-b1b8-3b87ae0fd795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:46.671251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-0dba7bcd-da1c-45f3-b1b8-3b87ae0fd795 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:03:46.673339 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0dba7bcd-da1c-45f3-b1b8-3b87ae0fd795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:03:46.738413 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 667/1303] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:03:46 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 19:03:46.761480 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e47dc-88d0-43f5-9140-0c659463b99a None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:46.856808 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:46.864042 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e47dc-88d0-43f5-9140-0c659463b99a None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:46.896342 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5082e-cc15-490a-bde2-684a89535cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:46.896959 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5082e-cc15-490a-bde2-684a89535cec None admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:46.897237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5082e-cc15-490a-bde2-684a89535cec None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:46.897531 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5082e-cc15-490a-bde2-684a89535cec None admin] PATH_INFO: `/v3/services/placement` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:46.898104 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5082e-cc15-490a-bde2-684a89535cec None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:46.899494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5082e-cc15-490a-bde2-684a89535cec None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:46.908644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application [None req-f9a5082e-cc15-490a-bde2-684a89535cec None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 19:03:46.908644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:46.908644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 19:03:46.908644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 19:03:46.908644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 19:03:46.908644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 19:03:46.908644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 19:03:46.908644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:03:46.908644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 19:03:46.908644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:46.908644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 19:03:46.908644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:46.908644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 19:03:46.908644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 19:03:46.908644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 19:03:46.908644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 19:03:46.908644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 19:03:46.909884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 19:03:46.909884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 19:03:46.909884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 19:03:46.909884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 19:03:46.909884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 19:03:46.909884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 19:03:46.909884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 19:03:46.909884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 19:03:46.909884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 19:03:46.909884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 19:03:46.909884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 19:03:46.909884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 19:03:46.909884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 19:03:46.909884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 19:03:46.909884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 19:03:46.909884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 19:03:46.910824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 19:03:46.910824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application with Lock( Aug 09 19:03:46.910824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 19:03:46.910824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self._enter() Aug 09 19:03:46.910824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 19:03:46.910824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 19:03:46.910824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 19:03:46.910824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application return self.creator() Aug 09 19:03:46.910824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 19:03:46.910824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application created_value = creator( Aug 09 19:03:46.910824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 19:03:46.910824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 19:03:46.910824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 19:03:46.910824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: ERROR keystone.server.flask.application Aug 09 19:03:46.910824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 637/1304] 10.222.0.65 () {56 vars in 1117 bytes} [Tue Aug 9 19:03:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 19:03:46.915958 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba7bcd-da1c-45f3-b1b8-3b87ae0fd795 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:46.990386 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:47.012233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba7bcd-da1c-45f3-b1b8-3b87ae0fd795 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:47.045299 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b73e44-187a-4df8-b846-ae5e018da3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:47.045935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b73e44-187a-4df8-b846-ae5e018da3dd None admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:47.046218 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b73e44-187a-4df8-b846-ae5e018da3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:47.046522 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b73e44-187a-4df8-b846-ae5e018da3dd None admin] PATH_INFO: `/v3/services` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:47.047148 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b73e44-187a-4df8-b846-ae5e018da3dd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:03:47.047451 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b73e44-187a-4df8-b846-ae5e018da3dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:47.049422 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b73e44-187a-4df8-b846-ae5e018da3dd None admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:47.054451 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 668/1305] 10.222.0.65 () {56 vars in 1116 bytes} [Tue Aug 9 19:03:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:03:47.060339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5082e-cc15-490a-bde2-684a89535cec None admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:03:47.160470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5082e-cc15-490a-bde2-684a89535cec None admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:03:47.193277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f56cd5-1826-45ca-a47c-e3313727de24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:03:47.193899 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f56cd5-1826-45ca-a47c-e3313727de24 None admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:03:47.194178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f56cd5-1826-45ca-a47c-e3313727de24 None admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:03:47.194447 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f56cd5-1826-45ca-a47c-e3313727de24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:03:47.195104 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f56cd5-1826-45ca-a47c-e3313727de24 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:03:47.196472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f56cd5-1826-45ca-a47c-e3313727de24 None admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:03:47.324846 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 638/1306] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:03:47 2022] POST /identity/v3/endpoints => generated 331 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:03:57.059542 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=30 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:03:57.320164 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:09:40.301708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beafe04-5393-441b-b094-849d3132add4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:40.302259 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beafe04-5393-441b-b094-849d3132add4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:40.302259 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beafe04-5393-441b-b094-849d3132add4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:40.308659 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614795d-15f1-46c7-8b5e-d9a0dc7d8a4f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:40.309122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614795d-15f1-46c7-8b5e-d9a0dc7d8a4f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:40.309218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614795d-15f1-46c7-8b5e-d9a0dc7d8a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:40.315254 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 669/1307] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:09:40 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:09:40.391533 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1614795d-15f1-46c7-8b5e-d9a0dc7d8a4f None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:09:40.392821 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1614795d-15f1-46c7-8b5e-d9a0dc7d8a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:40.525837 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 639/1308] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:09:40.566084 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c15fe-4e09-4bc9-8b50-18034ce234b5 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:40.566872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c15fe-4e09-4bc9-8b50-18034ce234b5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:40.567539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c15fe-4e09-4bc9-8b50-18034ce234b5 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:40.570491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 670/1309] 10.222.0.65 () {54 vars in 965 bytes} [Tue Aug 9 19:09:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:09:40.579328 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a01d0-66e5-4eda-91ff-b38575f8bb94 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:40.580483 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a01d0-66e5-4eda-91ff-b38575f8bb94 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:40.581575 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a01d0-66e5-4eda-91ff-b38575f8bb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:40.695098 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a49a01d0-66e5-4eda-91ff-b38575f8bb94 None None] MFA Rules not processed for user `a62d954163ca4bf298f461b4d253269e`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:09:40.696322 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a49a01d0-66e5-4eda-91ff-b38575f8bb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:40.723825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:09:40.789799 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 640/1310] 10.222.0.65 () {58 vars in 1062 bytes} [Tue Aug 9 19:09:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:09:40.794864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c15fe-4e09-4bc9-8b50-18034ce234b5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:09:40.796981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fb2c15fe-4e09-4bc9-8b50-18034ce234b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:40.914763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c15fe-4e09-4bc9-8b50-18034ce234b5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:09:40.993891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa06ba1-9ee9-4372-9351-0b82f9dfb2ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:09:40.994503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa06ba1-9ee9-4372-9351-0b82f9dfb2ea service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:40.994781 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa06ba1-9ee9-4372-9351-0b82f9dfb2ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:40.995049 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa06ba1-9ee9-4372-9351-0b82f9dfb2ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:40.996653 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-aaa06ba1-9ee9-4372-9351-0b82f9dfb2ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:41.052887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:09:41.107957 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa06ba1-9ee9-4372-9351-0b82f9dfb2ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:09:41.110337 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa06ba1-9ee9-4372-9351-0b82f9dfb2ea service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:09:41.130420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 671/1311] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:09:43.446777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057a385-f208-4673-8f89-ebaaab49a5cc None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:43.447345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057a385-f208-4673-8f89-ebaaab49a5cc None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:43.447345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057a385-f208-4673-8f89-ebaaab49a5cc None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:43.448678 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 641/1312] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:09:43.454427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e35e9-26c2-4b00-9b92-9224711da4a1 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:43.454866 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e35e9-26c2-4b00-9b92-9224711da4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:43.454989 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e35e9-26c2-4b00-9b92-9224711da4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:43.540719 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-458e35e9-26c2-4b00-9b92-9224711da4a1 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:09:43.541966 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-458e35e9-26c2-4b00-9b92-9224711da4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:43.645699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 672/1313] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:09:43.684381 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057a385-f208-4673-8f89-ebaaab49a5cc None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:09:43.686200 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3057a385-f208-4673-8f89-ebaaab49a5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:43.794375 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057a385-f208-4673-8f89-ebaaab49a5cc None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:09:43.862930 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:09:43.865503 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd314fd6-01e8-4eea-a636-7df5e306e005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:09:43.866101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd314fd6-01e8-4eea-a636-7df5e306e005 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:43.866394 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd314fd6-01e8-4eea-a636-7df5e306e005 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:43.866638 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd314fd6-01e8-4eea-a636-7df5e306e005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:43.868249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-bd314fd6-01e8-4eea-a636-7df5e306e005 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:43.979557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd314fd6-01e8-4eea-a636-7df5e306e005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:09:43.981124 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd314fd6-01e8-4eea-a636-7df5e306e005 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:09:44.001164 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 642/1314] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:09:46.474323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5fe24-731e-479c-beea-93ded185baa6 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:46.474791 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5fe24-731e-479c-beea-93ded185baa6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:46.474886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5fe24-731e-479c-beea-93ded185baa6 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:46.476223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 673/1315] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:09:46.481433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7f52e-c2a7-428d-980f-3c055e2c02c5 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:46.481910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7f52e-c2a7-428d-980f-3c055e2c02c5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:46.482025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7f52e-c2a7-428d-980f-3c055e2c02c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:46.556612 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-25c7f52e-c2a7-428d-980f-3c055e2c02c5 None None] MFA Rules not processed for user `52af65c8f39f4ae68548deb395a6c6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:09:46.557895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-25c7f52e-c2a7-428d-980f-3c055e2c02c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:46.611781 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:09:46.656801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 643/1316] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:09:46 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:09:46.697106 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5fe24-731e-479c-beea-93ded185baa6 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:09:46.698676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-89f5fe24-731e-479c-beea-93ded185baa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:46.709007 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:09:46.804730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5fe24-731e-479c-beea-93ded185baa6 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:09:46.879541 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c484ab9-d5bf-4390-8236-8c2aa499ca9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:09:46.880180 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c484ab9-d5bf-4390-8236-8c2aa499ca9c service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:46.880458 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c484ab9-d5bf-4390-8236-8c2aa499ca9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:46.880731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c484ab9-d5bf-4390-8236-8c2aa499ca9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:46.882416 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7c484ab9-d5bf-4390-8236-8c2aa499ca9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:46.944449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:09:46.990195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c484ab9-d5bf-4390-8236-8c2aa499ca9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:09:46.991626 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c484ab9-d5bf-4390-8236-8c2aa499ca9c service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:09:47.009568 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 674/1317] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:09:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:09:49.746237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e0b64-a299-437e-bcf9-ace9ee904524 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:49.746804 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e0b64-a299-437e-bcf9-ace9ee904524 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:49.746804 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e0b64-a299-437e-bcf9-ace9ee904524 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:49.748173 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 644/1318] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:09:49.754277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6011171-cb0f-4677-b1ad-9d39de1dfdee None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:49.754732 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6011171-cb0f-4677-b1ad-9d39de1dfdee None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:49.754846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6011171-cb0f-4677-b1ad-9d39de1dfdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:49.818388 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f6011171-cb0f-4677-b1ad-9d39de1dfdee None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:09:49.819503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f6011171-cb0f-4677-b1ad-9d39de1dfdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:49.912052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 675/1319] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:09:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:09:49.951020 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e0b64-a299-437e-bcf9-ace9ee904524 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:09:49.952609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5e4e0b64-a299-437e-bcf9-ace9ee904524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:50.055363 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e0b64-a299-437e-bcf9-ace9ee904524 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:09:50.126512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9beea6b-139d-4396-b7ec-e0a9755fc6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:09:50.127041 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beea6b-139d-4396-b7ec-e0a9755fc6af service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:50.127314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beea6b-139d-4396-b7ec-e0a9755fc6af service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:50.127580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9beea6b-139d-4396-b7ec-e0a9755fc6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:50.129172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c9beea6b-139d-4396-b7ec-e0a9755fc6af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:50.136268 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:09:50.234828 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9beea6b-139d-4396-b7ec-e0a9755fc6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:09:50.236251 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9beea6b-139d-4396-b7ec-e0a9755fc6af service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:09:50.254306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 645/1320] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:09:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:09:53.268310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714e3c0-0248-4219-a16b-9e524e56cfb7 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:53.268894 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714e3c0-0248-4219-a16b-9e524e56cfb7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:53.268894 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714e3c0-0248-4219-a16b-9e524e56cfb7 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:53.270227 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 676/1321] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:09:53.275618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4b2cf-c6f5-4238-a083-cecfd139b7a7 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:53.276039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4b2cf-c6f5-4238-a083-cecfd139b7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:53.276166 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4b2cf-c6f5-4238-a083-cecfd139b7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:53.343452 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-21a4b2cf-c6f5-4238-a083-cecfd139b7a7 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:09:53.344649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-21a4b2cf-c6f5-4238-a083-cecfd139b7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:53.403565 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:09:53.442963 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 646/1322] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:09:53.480380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714e3c0-0248-4219-a16b-9e524e56cfb7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:09:53.481998 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3714e3c0-0248-4219-a16b-9e524e56cfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:53.503774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:09:53.595402 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714e3c0-0248-4219-a16b-9e524e56cfb7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:09:53.671071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e47ade-2a2c-4d47-aeb9-4731f30b7f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:09:53.671680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e47ade-2a2c-4d47-aeb9-4731f30b7f66 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:53.671960 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e47ade-2a2c-4d47-aeb9-4731f30b7f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:53.672233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e47ade-2a2c-4d47-aeb9-4731f30b7f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:53.673878 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-30e47ade-2a2c-4d47-aeb9-4731f30b7f66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:53.743709 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:09:53.782199 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e47ade-2a2c-4d47-aeb9-4731f30b7f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:09:53.783675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e47ade-2a2c-4d47-aeb9-4731f30b7f66 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:09:53.802068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 677/1323] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:09:55.880513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89046d-757e-4985-ab5f-2bb926165a70 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:55.881021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89046d-757e-4985-ab5f-2bb926165a70 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:55.881111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89046d-757e-4985-ab5f-2bb926165a70 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:55.882470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 647/1324] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:09:55.887699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4234af-d6bb-4a06-939d-245b60fefa2e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:55.888131 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4234af-d6bb-4a06-939d-245b60fefa2e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:55.888256 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4234af-d6bb-4a06-939d-245b60fefa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:55.954491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5e4234af-d6bb-4a06-939d-245b60fefa2e None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:09:55.955610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5e4234af-d6bb-4a06-939d-245b60fefa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:56.051890 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 678/1325] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:09:56.099737 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db63764-570e-4d86-8594-48d289026353 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:56.100112 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db63764-570e-4d86-8594-48d289026353 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:56.100454 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db63764-570e-4d86-8594-48d289026353 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:56.101986 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 648/1326] 10.222.0.65 () {54 vars in 965 bytes} [Tue Aug 9 19:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:09:56.108510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758f5a1-13b2-470f-a601-3a6fe943df68 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:56.108790 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758f5a1-13b2-470f-a601-3a6fe943df68 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:56.109061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758f5a1-13b2-470f-a601-3a6fe943df68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:56.140310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:09:56.184403 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e758f5a1-13b2-470f-a601-3a6fe943df68 None None] MFA Rules not processed for user `a62d954163ca4bf298f461b4d253269e`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:09:56.185688 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e758f5a1-13b2-470f-a601-3a6fe943df68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:56.268247 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 679/1327] 10.222.0.65 () {58 vars in 1062 bytes} [Tue Aug 9 19:09:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:09:56.276917 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db63764-570e-4d86-8594-48d289026353 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:09:56.278472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7db63764-570e-4d86-8594-48d289026353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:56.386127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db63764-570e-4d86-8594-48d289026353 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:09:56.460568 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9d135-39b3-44af-b697-2735d86af185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:09:56.461083 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9d135-39b3-44af-b697-2735d86af185 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:56.461358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9d135-39b3-44af-b697-2735d86af185 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:56.461650 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9d135-39b3-44af-b697-2735d86af185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:56.463262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2ab9d135-39b3-44af-b697-2735d86af185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:56.481400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:09:56.581693 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9d135-39b3-44af-b697-2735d86af185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:09:56.583167 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9d135-39b3-44af-b697-2735d86af185 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:09:56.601434 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 649/1328] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:09:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:09:58.871519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb46bf-838a-4309-b2f9-075b56a951a9 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:58.872055 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb46bf-838a-4309-b2f9-075b56a951a9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:58.872055 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb46bf-838a-4309-b2f9-075b56a951a9 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:58.873598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 680/1329] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:09:58.878808 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89065b-5439-4c2e-b6f3-12899bc2dac3 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:58.879227 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89065b-5439-4c2e-b6f3-12899bc2dac3 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:58.879489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89065b-5439-4c2e-b6f3-12899bc2dac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:58.945928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-af89065b-5439-4c2e-b6f3-12899bc2dac3 None None] MFA Rules not processed for user `52af65c8f39f4ae68548deb395a6c6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:09:58.947039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-af89065b-5439-4c2e-b6f3-12899bc2dac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:59.014609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:09:59.047430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 650/1330] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:09:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:09:59.084518 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb46bf-838a-4309-b2f9-075b56a951a9 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:09:59.086134 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fbfb46bf-838a-4309-b2f9-075b56a951a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:59.209518 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb46bf-838a-4309-b2f9-075b56a951a9 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:09:59.230565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:09:59.287086 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6953ea-f28f-435c-ac15-314e96725b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:09:59.287687 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6953ea-f28f-435c-ac15-314e96725b5a service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:09:59.287964 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6953ea-f28f-435c-ac15-314e96725b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:09:59.288233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6953ea-f28f-435c-ac15-314e96725b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:09:59.289871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ea6953ea-f28f-435c-ac15-314e96725b5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:09:59.396043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6953ea-f28f-435c-ac15-314e96725b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:09:59.397584 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6953ea-f28f-435c-ac15-314e96725b5a service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:09:59.416446 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 681/1331] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:09:59 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:10:02.139003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2982bb-7246-48c9-92fd-f82eab64fc14 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:02.139533 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2982bb-7246-48c9-92fd-f82eab64fc14 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:02.139626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2982bb-7246-48c9-92fd-f82eab64fc14 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:02.140913 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 651/1332] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:10:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:02.146210 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fb92e-c066-4b45-943a-c292f9b13f09 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:02.146675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fb92e-c066-4b45-943a-c292f9b13f09 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:02.146773 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49fb92e-c066-4b45-943a-c292f9b13f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:02.209675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:02.212353 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c49fb92e-c066-4b45-943a-c292f9b13f09 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:02.213664 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c49fb92e-c066-4b45-943a-c292f9b13f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:02.311358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 682/1333] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:02.348596 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2982bb-7246-48c9-92fd-f82eab64fc14 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:10:02.350197 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8f2982bb-7246-48c9-92fd-f82eab64fc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:02.452319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2982bb-7246-48c9-92fd-f82eab64fc14 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:10:02.525752 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247d58b-6f95-46f6-82c0-fcac2342f7a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:10:02.526360 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247d58b-6f95-46f6-82c0-fcac2342f7a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:02.526639 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247d58b-6f95-46f6-82c0-fcac2342f7a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:02.526911 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247d58b-6f95-46f6-82c0-fcac2342f7a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:02.528533 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f247d58b-6f95-46f6-82c0-fcac2342f7a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:02.554636 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:02.636390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247d58b-6f95-46f6-82c0-fcac2342f7a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:10:02.637864 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247d58b-6f95-46f6-82c0-fcac2342f7a3 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:10:02.656467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 652/1334] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:10:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:10:04.687886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670966b-173c-41f0-ad70-8dabe6bee215 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:04.688457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670966b-173c-41f0-ad70-8dabe6bee215 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:04.688457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670966b-173c-41f0-ad70-8dabe6bee215 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:04.689789 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 683/1335] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:04.694805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c052f0-093f-4f71-bdea-31a44fe3da17 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:04.695185 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c052f0-093f-4f71-bdea-31a44fe3da17 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:04.695365 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c052f0-093f-4f71-bdea-31a44fe3da17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:04.762853 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a2c052f0-093f-4f71-bdea-31a44fe3da17 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:04.764174 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a2c052f0-093f-4f71-bdea-31a44fe3da17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:04.839735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:04.863345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 653/1336] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:04.903334 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670966b-173c-41f0-ad70-8dabe6bee215 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:10:04.905441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2670966b-173c-41f0-ad70-8dabe6bee215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:05.011796 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670966b-173c-41f0-ad70-8dabe6bee215 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:10:05.039457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:05.083199 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726d227-e95c-4f29-bd3a-c194e56f550e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:10:05.083794 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726d227-e95c-4f29-bd3a-c194e56f550e service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:05.084069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726d227-e95c-4f29-bd3a-c194e56f550e service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:05.084335 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726d227-e95c-4f29-bd3a-c194e56f550e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:05.085971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e726d227-e95c-4f29-bd3a-c194e56f550e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:05.190183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726d227-e95c-4f29-bd3a-c194e56f550e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:10:05.191599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726d227-e95c-4f29-bd3a-c194e56f550e service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:10:05.210023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 684/1337] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:10:07.994441 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8779b-7ae9-4b95-8d0a-85a366ea69ba None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:07.995070 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8779b-7ae9-4b95-8d0a-85a366ea69ba None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:07.995070 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8779b-7ae9-4b95-8d0a-85a366ea69ba None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:07.996347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 654/1338] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:08.002083 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc64f0b-23bd-4d7a-8041-380680075423 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:08.002534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc64f0b-23bd-4d7a-8041-380680075423 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:08.002637 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc64f0b-23bd-4d7a-8041-380680075423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:08.066116 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-0dc64f0b-23bd-4d7a-8041-380680075423 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:08.067301 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0dc64f0b-23bd-4d7a-8041-380680075423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:08.075819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:08.161026 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 685/1339] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:10:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:08.197635 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8779b-7ae9-4b95-8d0a-85a366ea69ba None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:10:08.199204 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6fd8779b-7ae9-4b95-8d0a-85a366ea69ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:08.300334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8779b-7ae9-4b95-8d0a-85a366ea69ba None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:10:08.373515 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb0c99-e4ba-41d0-9a40-3b5718e2bd97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:10:08.374116 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb0c99-e4ba-41d0-9a40-3b5718e2bd97 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:08.374392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb0c99-e4ba-41d0-9a40-3b5718e2bd97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:08.374657 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb0c99-e4ba-41d0-9a40-3b5718e2bd97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:08.376238 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5dfb0c99-e4ba-41d0-9a40-3b5718e2bd97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:08.411048 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:08.482781 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb0c99-e4ba-41d0-9a40-3b5718e2bd97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:10:08.484203 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb0c99-e4ba-41d0-9a40-3b5718e2bd97 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:10:08.504150 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 655/1340] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:10:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:10:12.823823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0d55c-e95a-495d-8ba2-87b9fe0067dd None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:12.824427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0d55c-e95a-495d-8ba2-87b9fe0067dd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:12.824427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0d55c-e95a-495d-8ba2-87b9fe0067dd None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:12.825827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 686/1341] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:12.831250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bc2e0-e5dc-47e2-999f-d7d7242860a9 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:12.831645 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bc2e0-e5dc-47e2-999f-d7d7242860a9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:12.831803 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bc2e0-e5dc-47e2-999f-d7d7242860a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:12.898634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ae4bc2e0-e5dc-47e2-999f-d7d7242860a9 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:12.899829 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ae4bc2e0-e5dc-47e2-999f-d7d7242860a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:12.984605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:12.995670 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 656/1342] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:13.035639 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0d55c-e95a-495d-8ba2-87b9fe0067dd None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:10:13.037308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-01c0d55c-e95a-495d-8ba2-87b9fe0067dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:13.140265 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0d55c-e95a-495d-8ba2-87b9fe0067dd None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:10:13.179131 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:13.215033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc11ad-310a-4aea-a9ec-fb83b76d169a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:10:13.216156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc11ad-310a-4aea-a9ec-fb83b76d169a service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:13.216435 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc11ad-310a-4aea-a9ec-fb83b76d169a service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:13.216704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc11ad-310a-4aea-a9ec-fb83b76d169a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:13.218501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e2cc11ad-310a-4aea-a9ec-fb83b76d169a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:13.327888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc11ad-310a-4aea-a9ec-fb83b76d169a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:10:13.329247 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc11ad-310a-4aea-a9ec-fb83b76d169a service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:10:13.347293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 687/1343] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:10:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:10:16.356745 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4061d0d-2b26-4107-9ad1-4dd992b0db4d None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:16.357281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4061d0d-2b26-4107-9ad1-4dd992b0db4d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:16.357378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4061d0d-2b26-4107-9ad1-4dd992b0db4d None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:16.358752 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 657/1344] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:10:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:16.364312 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b32da-06c9-4e1f-849a-ba6b38fcd87f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:16.364742 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b32da-06c9-4e1f-849a-ba6b38fcd87f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:16.364863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b32da-06c9-4e1f-849a-ba6b38fcd87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:16.430999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c66b32da-06c9-4e1f-849a-ba6b38fcd87f None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:16.432214 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c66b32da-06c9-4e1f-849a-ba6b38fcd87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:16.451067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:16.531817 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 688/1345] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:10:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:16.572622 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4061d0d-2b26-4107-9ad1-4dd992b0db4d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:10:16.574243 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b4061d0d-2b26-4107-9ad1-4dd992b0db4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:16.677358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4061d0d-2b26-4107-9ad1-4dd992b0db4d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:10:16.751420 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f14a8e-aedf-46b0-b430-960d52448879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:10:16.752023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f14a8e-aedf-46b0-b430-960d52448879 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:16.755296 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f14a8e-aedf-46b0-b430-960d52448879 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:16.755296 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f14a8e-aedf-46b0-b430-960d52448879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:16.755296 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-46f14a8e-aedf-46b0-b430-960d52448879 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:16.801772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:16.872522 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f14a8e-aedf-46b0-b430-960d52448879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:10:16.874057 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f14a8e-aedf-46b0-b430-960d52448879 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:10:16.892981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 658/1346] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:10:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:10:21.025252 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813db97-9783-48dd-a56d-964a0bf8b786 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:21.025817 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813db97-9783-48dd-a56d-964a0bf8b786 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:21.025914 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813db97-9783-48dd-a56d-964a0bf8b786 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:21.027235 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 689/1347] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:21.032963 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98b43e-607b-4732-81b3-cdf6a41aa125 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:21.033438 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98b43e-607b-4732-81b3-cdf6a41aa125 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:21.033581 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98b43e-607b-4732-81b3-cdf6a41aa125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:21.105265 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1e98b43e-607b-4732-81b3-cdf6a41aa125 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:21.106653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1e98b43e-607b-4732-81b3-cdf6a41aa125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:21.206856 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:21.209947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 659/1348] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:21.249085 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813db97-9783-48dd-a56d-964a0bf8b786 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:10:21.251173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f813db97-9783-48dd-a56d-964a0bf8b786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:21.362357 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813db97-9783-48dd-a56d-964a0bf8b786 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:10:21.409400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:21.437776 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0848a1c-7844-4bf6-92d6-7883863b8096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:10:21.438388 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0848a1c-7844-4bf6-92d6-7883863b8096 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:21.438664 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0848a1c-7844-4bf6-92d6-7883863b8096 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:21.438928 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0848a1c-7844-4bf6-92d6-7883863b8096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:21.440552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d0848a1c-7844-4bf6-92d6-7883863b8096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:21.555350 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0848a1c-7844-4bf6-92d6-7883863b8096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:10:21.556791 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0848a1c-7844-4bf6-92d6-7883863b8096 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:10:21.575541 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 690/1349] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:10:26.434676 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed5fe-dccc-4211-86d3-460ec862c22a None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:26.435655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed5fe-dccc-4211-86d3-460ec862c22a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:26.436162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed5fe-dccc-4211-86d3-460ec862c22a None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:26.438230 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 660/1350] 10.222.0.65 () {54 vars in 921 bytes} [Tue Aug 9 19:10:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:26.445555 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bc277-3cd9-4cda-a974-445fadad36ee None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:26.445980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bc277-3cd9-4cda-a974-445fadad36ee None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:26.446122 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bc277-3cd9-4cda-a974-445fadad36ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:26.576812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b73bc277-3cd9-4cda-a974-445fadad36ee None None] MFA Rules not processed for user `c6172f0733384291992624ef6a527ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:26.577990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b73bc277-3cd9-4cda-a974-445fadad36ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:26.597494 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:26.690067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 691/1351] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Aug 9 19:10:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:30.776024 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7c3be-46c3-4bb7-8f7e-72f00bb63274 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:30.777538 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7c3be-46c3-4bb7-8f7e-72f00bb63274 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:30.778031 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7c3be-46c3-4bb7-8f7e-72f00bb63274 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:30.779582 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 661/1352] 10.222.0.65 () {54 vars in 921 bytes} [Tue Aug 9 19:10:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:30.785174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baad230-2ca3-422b-b309-284fd67ec292 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:30.785770 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baad230-2ca3-422b-b309-284fd67ec292 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:30.786089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baad230-2ca3-422b-b309-284fd67ec292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:30.870166 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3baad230-2ca3-422b-b309-284fd67ec292 None None] MFA Rules not processed for user `c6172f0733384291992624ef6a527ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:30.871535 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3baad230-2ca3-422b-b309-284fd67ec292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:30.950419 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:30.989680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 692/1353] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Aug 9 19:10:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:32.304654 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24867df-6efc-4126-bdbe-19801118714f None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:32.305679 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24867df-6efc-4126-bdbe-19801118714f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:32.306035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24867df-6efc-4126-bdbe-19801118714f None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:32.308556 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 662/1354] 10.222.0.65 () {54 vars in 921 bytes} [Tue Aug 9 19:10:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:32.314041 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7c8c8-f13e-47e1-b9e9-daf96a4b9162 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:32.314529 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7c8c8-f13e-47e1-b9e9-daf96a4b9162 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:32.314636 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7c8c8-f13e-47e1-b9e9-daf96a4b9162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:32.396464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8df7c8c8-f13e-47e1-b9e9-daf96a4b9162 None None] MFA Rules not processed for user `c6172f0733384291992624ef6a527ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:32.397736 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8df7c8c8-f13e-47e1-b9e9-daf96a4b9162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:32.511332 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 693/1355] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Aug 9 19:10:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:35.935018 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba20445-1cff-4163-91c7-38f3a9769b04 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:35.935551 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba20445-1cff-4163-91c7-38f3a9769b04 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:35.935551 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba20445-1cff-4163-91c7-38f3a9769b04 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:35.937645 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 663/1356] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:35.942844 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855516ef-6c9c-4e61-a44e-a2436c2974a8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:35.944771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855516ef-6c9c-4e61-a44e-a2436c2974a8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:35.945197 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855516ef-6c9c-4e61-a44e-a2436c2974a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:36.000553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:36.038685 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-855516ef-6c9c-4e61-a44e-a2436c2974a8 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:36.040315 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-855516ef-6c9c-4e61-a44e-a2436c2974a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:36.146404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 694/1357] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:36.199960 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2836dd0-2c13-4e7d-b997-39fb6968602f None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:36.200437 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2836dd0-2c13-4e7d-b997-39fb6968602f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:36.200861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2836dd0-2c13-4e7d-b997-39fb6968602f None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:36.202440 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 664/1358] 10.222.0.65 () {54 vars in 962 bytes} [Tue Aug 9 19:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:10:36.210795 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f337df-cce9-4856-9cab-c563359b7b15 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:36.211427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f337df-cce9-4856-9cab-c563359b7b15 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:36.211822 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f337df-cce9-4856-9cab-c563359b7b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:36.300933 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e6f337df-cce9-4856-9cab-c563359b7b15 None None] MFA Rules not processed for user `2cfda1bec35145f3bbcc13fae0b7af2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:36.302487 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e6f337df-cce9-4856-9cab-c563359b7b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:36.358303 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:36.430256 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 695/1359] 10.222.0.65 () {58 vars in 1059 bytes} [Tue Aug 9 19:10:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:36.438383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2836dd0-2c13-4e7d-b997-39fb6968602f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:10:36.440051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d2836dd0-2c13-4e7d-b997-39fb6968602f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:36.594120 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2836dd0-2c13-4e7d-b997-39fb6968602f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:10:36.674908 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:36.718097 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ae184-8bc3-47ed-8156-04d7b82c494c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:10:36.718781 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ae184-8bc3-47ed-8156-04d7b82c494c service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:36.719164 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ae184-8bc3-47ed-8156-04d7b82c494c service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:36.719536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ae184-8bc3-47ed-8156-04d7b82c494c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:36.721264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7d2ae184-8bc3-47ed-8156-04d7b82c494c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:36.833179 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ae184-8bc3-47ed-8156-04d7b82c494c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:10:36.835122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ae184-8bc3-47ed-8156-04d7b82c494c service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:10:36.855850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 665/1360] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:10:39.114733 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee1515-5d84-46af-9ae9-ce1b00566241 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:39.115215 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee1515-5d84-46af-9ae9-ce1b00566241 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:39.115374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee1515-5d84-46af-9ae9-ce1b00566241 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:39.118277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 696/1361] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:39.122808 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc776f38-99b0-48c1-83e1-92c812caaabc None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:39.123295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc776f38-99b0-48c1-83e1-92c812caaabc None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:39.123295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc776f38-99b0-48c1-83e1-92c812caaabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:39.199741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-dc776f38-99b0-48c1-83e1-92c812caaabc None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:39.200879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-dc776f38-99b0-48c1-83e1-92c812caaabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:39.243109 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:39.306429 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 666/1362] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:39.351577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee1515-5d84-46af-9ae9-ce1b00566241 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:10:39.353141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-09ee1515-5d84-46af-9ae9-ce1b00566241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:39.529510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee1515-5d84-46af-9ae9-ce1b00566241 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:10:39.539640 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:39.675415 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8f1c4-9777-46b7-9aa2-0d9cd271645f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:10:39.676084 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8f1c4-9777-46b7-9aa2-0d9cd271645f service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:39.676470 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8f1c4-9777-46b7-9aa2-0d9cd271645f service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:39.676748 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8f1c4-9777-46b7-9aa2-0d9cd271645f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:39.678484 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-01b8f1c4-9777-46b7-9aa2-0d9cd271645f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:39.784472 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8f1c4-9777-46b7-9aa2-0d9cd271645f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:10:39.786472 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8f1c4-9777-46b7-9aa2-0d9cd271645f service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:10:39.808637 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 697/1363] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:10:42.270973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c74800-1e43-48e8-9f09-608a1e0810aa None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:42.271379 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c74800-1e43-48e8-9f09-608a1e0810aa None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:42.271550 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c74800-1e43-48e8-9f09-608a1e0810aa None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:42.273237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 667/1364] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:42.279269 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf4e1e-c2f1-4346-a903-1d01539ca71a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:42.280255 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf4e1e-c2f1-4346-a903-1d01539ca71a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:42.280537 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf4e1e-c2f1-4346-a903-1d01539ca71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:42.298186 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:42.357123 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b8bf4e1e-c2f1-4346-a903-1d01539ca71a None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:42.358391 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b8bf4e1e-c2f1-4346-a903-1d01539ca71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:42.477114 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 698/1365] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:42.524391 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb960f87-8a00-4f7a-ac36-0e59c05217c1 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:42.524670 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb960f87-8a00-4f7a-ac36-0e59c05217c1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:42.525019 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb960f87-8a00-4f7a-ac36-0e59c05217c1 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:42.532277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 668/1366] 10.222.0.65 () {54 vars in 962 bytes} [Tue Aug 9 19:10:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:42.534109 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba618a-1211-4bac-95da-428ac622093f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:42.534398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba618a-1211-4bac-95da-428ac622093f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:42.534703 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba618a-1211-4bac-95da-428ac622093f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:42.618798 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-78ba618a-1211-4bac-95da-428ac622093f None None] MFA Rules not processed for user `2cfda1bec35145f3bbcc13fae0b7af2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:42.620600 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-78ba618a-1211-4bac-95da-428ac622093f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:42.660449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:42.760707 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 699/1367] 10.222.0.65 () {58 vars in 1059 bytes} [Tue Aug 9 19:10:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:42.769242 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb960f87-8a00-4f7a-ac36-0e59c05217c1 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:10:42.770989 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cb960f87-8a00-4f7a-ac36-0e59c05217c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:42.936353 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb960f87-8a00-4f7a-ac36-0e59c05217c1 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:10:42.958834 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:43.061050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5fd1a-709c-4cc6-b708-7e939a8a45cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:10:43.061609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5fd1a-709c-4cc6-b708-7e939a8a45cb service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:43.061888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5fd1a-709c-4cc6-b708-7e939a8a45cb service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:43.062156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5fd1a-709c-4cc6-b708-7e939a8a45cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:43.063782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-caa5fd1a-709c-4cc6-b708-7e939a8a45cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:43.160946 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5fd1a-709c-4cc6-b708-7e939a8a45cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:10:43.162786 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5fd1a-709c-4cc6-b708-7e939a8a45cb service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:10:43.184586 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 669/1368] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:10:44.099239 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d25bb5-3e4c-4204-94ad-1d028edac3f2 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:44.099773 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d25bb5-3e4c-4204-94ad-1d028edac3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:44.099773 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d25bb5-3e4c-4204-94ad-1d028edac3f2 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:44.101295 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 700/1369] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:44.107098 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71935392-1090-4b40-81ac-7437c55791fb None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:44.107602 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71935392-1090-4b40-81ac-7437c55791fb None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:44.107685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71935392-1090-4b40-81ac-7437c55791fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:44.143110 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:44.179594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-71935392-1090-4b40-81ac-7437c55791fb None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:44.180815 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-71935392-1090-4b40-81ac-7437c55791fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:44.283500 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 670/1370] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:44.636837 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977f177-12df-4ee0-8a08-c74320754c1b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:44.637211 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977f177-12df-4ee0-8a08-c74320754c1b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:44.637581 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977f177-12df-4ee0-8a08-c74320754c1b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:44.639432 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 701/1371] 10.222.0.65 () {54 vars in 964 bytes} [Tue Aug 9 19:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:44.644161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bcb9f-3078-48a2-a0bc-e861d92f6abc None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:44.644518 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bcb9f-3078-48a2-a0bc-e861d92f6abc None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:44.644854 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bcb9f-3078-48a2-a0bc-e861d92f6abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:44.724324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f68bcb9f-3078-48a2-a0bc-e861d92f6abc None None] MFA Rules not processed for user `bca1eca610c64b3a8ab04792dcca18b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:44.725548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f68bcb9f-3078-48a2-a0bc-e861d92f6abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:44.775318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:44.805503 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 671/1372] 10.222.0.65 () {58 vars in 1061 bytes} [Tue Aug 9 19:10:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:44.813913 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977f177-12df-4ee0-8a08-c74320754c1b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:10:44.817627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f977f177-12df-4ee0-8a08-c74320754c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:44.925535 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977f177-12df-4ee0-8a08-c74320754c1b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:10:44.967825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:45.004518 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7ef62-8caa-473e-b560-f32efdd103c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:10:45.005122 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7ef62-8caa-473e-b560-f32efdd103c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:45.005398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7ef62-8caa-473e-b560-f32efdd103c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:45.005701 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7ef62-8caa-473e-b560-f32efdd103c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:45.007308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b5e7ef62-8caa-473e-b560-f32efdd103c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:45.122194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7ef62-8caa-473e-b560-f32efdd103c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:10:45.123638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7ef62-8caa-473e-b560-f32efdd103c4 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:10:45.142976 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 702/1373] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:10:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:10:45.430327 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc054e-0808-4b97-a5ca-14f4b21470e9 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:45.430751 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc054e-0808-4b97-a5ca-14f4b21470e9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:45.430751 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc054e-0808-4b97-a5ca-14f4b21470e9 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:45.434174 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 672/1374] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:10:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:45.439109 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086dc05-2c35-4f67-bbb6-f8310758e895 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:45.439452 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086dc05-2c35-4f67-bbb6-f8310758e895 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:45.439761 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086dc05-2c35-4f67-bbb6-f8310758e895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:45.515849 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e086dc05-2c35-4f67-bbb6-f8310758e895 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:45.515849 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e086dc05-2c35-4f67-bbb6-f8310758e895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:45.532746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:45.617499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 703/1375] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:45.660237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc054e-0808-4b97-a5ca-14f4b21470e9 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:10:45.661721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-aafc054e-0808-4b97-a5ca-14f4b21470e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:45.810802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc054e-0808-4b97-a5ca-14f4b21470e9 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:10:45.861897 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:45.925515 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f9838-074e-40ab-b763-0da75222ddf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:10:45.926050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f9838-074e-40ab-b763-0da75222ddf7 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:45.926331 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f9838-074e-40ab-b763-0da75222ddf7 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:45.926608 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f9838-074e-40ab-b763-0da75222ddf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:45.928218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-261f9838-074e-40ab-b763-0da75222ddf7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:46.018155 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f9838-074e-40ab-b763-0da75222ddf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:10:46.019762 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f9838-074e-40ab-b763-0da75222ddf7 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:10:46.037808 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 673/1376] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:10:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:10:48.138362 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d0184-48ca-4727-9d05-ca8996e91586 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:48.138877 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d0184-48ca-4727-9d05-ca8996e91586 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:48.138877 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d0184-48ca-4727-9d05-ca8996e91586 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:48.140241 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 704/1377] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:48.145589 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad900da-9c34-4105-8143-fe9c1f465286 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:48.146004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad900da-9c34-4105-8143-fe9c1f465286 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:48.146138 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad900da-9c34-4105-8143-fe9c1f465286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:48.225668 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-dad900da-9c34-4105-8143-fe9c1f465286 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:48.226870 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-dad900da-9c34-4105-8143-fe9c1f465286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:48.233563 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:48.336959 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 674/1378] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:10:48.382456 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d0184-48ca-4727-9d05-ca8996e91586 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:10:48.383979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6b5d0184-48ca-4727-9d05-ca8996e91586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:48.529775 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d0184-48ca-4727-9d05-ca8996e91586 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:10:48.533488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:48.652798 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33372246-f248-4051-a99b-dc9a2fdab28c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:10:48.653413 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33372246-f248-4051-a99b-dc9a2fdab28c service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:48.653725 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33372246-f248-4051-a99b-dc9a2fdab28c service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:48.653997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33372246-f248-4051-a99b-dc9a2fdab28c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:48.655601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-33372246-f248-4051-a99b-dc9a2fdab28c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:48.779118 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33372246-f248-4051-a99b-dc9a2fdab28c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:10:48.781535 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33372246-f248-4051-a99b-dc9a2fdab28c service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:10:48.805346 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 705/1379] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:10:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:10:51.061746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a9f37-0f94-4d0b-8a13-b49416006804 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:51.062185 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a9f37-0f94-4d0b-8a13-b49416006804 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:51.062261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a9f37-0f94-4d0b-8a13-b49416006804 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:51.066308 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 675/1380] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:10:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:51.069135 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c649f4-8f71-4b64-a3ba-9bcc3dccba63 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:51.069135 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c649f4-8f71-4b64-a3ba-9bcc3dccba63 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:51.069135 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c649f4-8f71-4b64-a3ba-9bcc3dccba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:51.081143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:51.140608 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-20c649f4-8f71-4b64-a3ba-9bcc3dccba63 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:51.141992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-20c649f4-8f71-4b64-a3ba-9bcc3dccba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:51.245711 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 706/1381] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:51.290673 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a9f37-0f94-4d0b-8a13-b49416006804 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:10:51.292427 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-740a9f37-0f94-4d0b-8a13-b49416006804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:51.440058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:51.451869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a9f37-0f94-4d0b-8a13-b49416006804 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:10:51.587968 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f56212-7fd8-48ba-8672-c2dd04909138 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:10:51.588616 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f56212-7fd8-48ba-8672-c2dd04909138 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:51.588935 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f56212-7fd8-48ba-8672-c2dd04909138 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:51.589974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f56212-7fd8-48ba-8672-c2dd04909138 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:51.591775 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f0f56212-7fd8-48ba-8672-c2dd04909138 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:51.693132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f56212-7fd8-48ba-8672-c2dd04909138 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:10:51.694901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f56212-7fd8-48ba-8672-c2dd04909138 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:10:51.707125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:51.716471 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 676/1382] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:10:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:10:53.902901 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9580c-1c95-4c37-8c74-6c4ebcba85df None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:53.903456 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9580c-1c95-4c37-8c74-6c4ebcba85df None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:53.903456 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9580c-1c95-4c37-8c74-6c4ebcba85df None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:53.904790 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 707/1383] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:10:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:53.911201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e89b45-b393-4250-95b4-b24287895071 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:53.911659 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e89b45-b393-4250-95b4-b24287895071 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:53.911757 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e89b45-b393-4250-95b4-b24287895071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:53.983234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-99e89b45-b393-4250-95b4-b24287895071 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:53.984857 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-99e89b45-b393-4250-95b4-b24287895071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:54.117479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 677/1384] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:10:54.169561 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9580c-1c95-4c37-8c74-6c4ebcba85df None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:10:54.171043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-40d9580c-1c95-4c37-8c74-6c4ebcba85df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:54.257871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:54.320615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9580c-1c95-4c37-8c74-6c4ebcba85df None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:10:54.447030 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ea2d7-2e94-45ce-a65b-2aef6b521b60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:10:54.447518 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ea2d7-2e94-45ce-a65b-2aef6b521b60 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:54.447796 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ea2d7-2e94-45ce-a65b-2aef6b521b60 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:54.448709 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ea2d7-2e94-45ce-a65b-2aef6b521b60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:54.450589 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-663ea2d7-2e94-45ce-a65b-2aef6b521b60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:54.501151 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:54.542916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ea2d7-2e94-45ce-a65b-2aef6b521b60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:10:54.544578 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ea2d7-2e94-45ce-a65b-2aef6b521b60 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:10:54.562438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 708/1385] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:10:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:10:56.817336 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc024b01-7f99-4ca1-a5ca-ba8ca7500d72 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:56.817896 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc024b01-7f99-4ca1-a5ca-ba8ca7500d72 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:56.818054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc024b01-7f99-4ca1-a5ca-ba8ca7500d72 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:56.819801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 678/1386] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:10:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:56.825813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394be58-bed0-46a0-aa45-c89e3dbcad5c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:56.826313 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394be58-bed0-46a0-aa45-c89e3dbcad5c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:56.826413 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394be58-bed0-46a0-aa45-c89e3dbcad5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:56.895759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f394be58-bed0-46a0-aa45-c89e3dbcad5c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:56.897441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f394be58-bed0-46a0-aa45-c89e3dbcad5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:57.006403 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 709/1387] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:57.051827 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc024b01-7f99-4ca1-a5ca-ba8ca7500d72 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:10:57.054050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-dc024b01-7f99-4ca1-a5ca-ba8ca7500d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:57.150876 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:57.224055 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc024b01-7f99-4ca1-a5ca-ba8ca7500d72 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:10:57.360537 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed567b-4771-4e44-8cf8-e1b8b0e75ee1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:10:57.361372 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed567b-4771-4e44-8cf8-e1b8b0e75ee1 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:57.361884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed567b-4771-4e44-8cf8-e1b8b0e75ee1 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:57.362330 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed567b-4771-4e44-8cf8-e1b8b0e75ee1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:57.365021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-85ed567b-4771-4e44-8cf8-e1b8b0e75ee1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:57.420494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:10:57.496972 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed567b-4771-4e44-8cf8-e1b8b0e75ee1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:10:57.499016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed567b-4771-4e44-8cf8-e1b8b0e75ee1 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:10:57.523241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 679/1388] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:10:59.688579 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280aa585-25f8-4f4a-8c3f-f8fa1ef7280c None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:59.689141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280aa585-25f8-4f4a-8c3f-f8fa1ef7280c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:59.689141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280aa585-25f8-4f4a-8c3f-f8fa1ef7280c None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:59.690530 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 710/1389] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:10:59.695875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed38cc-cd94-414d-b69b-8ff4c3d0483b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:10:59.696304 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed38cc-cd94-414d-b69b-8ff4c3d0483b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:10:59.696423 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed38cc-cd94-414d-b69b-8ff4c3d0483b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:10:59.764665 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2aed38cc-cd94-414d-b69b-8ff4c3d0483b None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:10:59.765826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2aed38cc-cd94-414d-b69b-8ff4c3d0483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:59.864356 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 680/1390] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:10:59.909846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280aa585-25f8-4f4a-8c3f-f8fa1ef7280c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:10:59.911466 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-280aa585-25f8-4f4a-8c3f-f8fa1ef7280c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:10:59.941915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:00.059051 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280aa585-25f8-4f4a-8c3f-f8fa1ef7280c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:00.159573 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:00.171405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a874495-5301-43cc-a2fc-af7255f57ebe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:00.172012 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a874495-5301-43cc-a2fc-af7255f57ebe service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:00.172290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a874495-5301-43cc-a2fc-af7255f57ebe service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:00.172565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a874495-5301-43cc-a2fc-af7255f57ebe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:00.174225 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3a874495-5301-43cc-a2fc-af7255f57ebe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:00.263070 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a874495-5301-43cc-a2fc-af7255f57ebe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:00.264683 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a874495-5301-43cc-a2fc-af7255f57ebe service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:00.282367 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 711/1391] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:11:00.492043 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c3f9f-e5f2-481e-9046-418d543c65cd None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:00.492494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c3f9f-e5f2-481e-9046-418d543c65cd None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:00.492773 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c3f9f-e5f2-481e-9046-418d543c65cd None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:00.494208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 681/1392] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:00.500741 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a80b82-a5e1-44c8-af1e-3593f8c277df None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:00.501175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a80b82-a5e1-44c8-af1e-3593f8c277df None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:00.501628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a80b82-a5e1-44c8-af1e-3593f8c277df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:00.574965 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d0a80b82-a5e1-44c8-af1e-3593f8c277df None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:00.576087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d0a80b82-a5e1-44c8-af1e-3593f8c277df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:00.638569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:00.675892 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 712/1393] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:00.732123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0105677-1734-4842-b95a-e98d92e6cf79 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:00.732579 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0105677-1734-4842-b95a-e98d92e6cf79 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:00.732677 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0105677-1734-4842-b95a-e98d92e6cf79 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:00.734027 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 682/1394] 10.222.0.65 () {54 vars in 967 bytes} [Tue Aug 9 19:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:00.739409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905ce01-1dd4-47e9-8754-65555ae5f86d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:00.739852 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905ce01-1dd4-47e9-8754-65555ae5f86d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:00.739948 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905ce01-1dd4-47e9-8754-65555ae5f86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:00.815860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2905ce01-1dd4-47e9-8754-65555ae5f86d None None] MFA Rules not processed for user `98d8000eb20445b78ee56ac372cd024c`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:00.817103 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2905ce01-1dd4-47e9-8754-65555ae5f86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:00.893347 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 713/1395] 10.222.0.65 () {58 vars in 1064 bytes} [Tue Aug 9 19:11:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:00.901526 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0105677-1734-4842-b95a-e98d92e6cf79 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:00.903048 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d0105677-1734-4842-b95a-e98d92e6cf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:00.916789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:01.007330 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0105677-1734-4842-b95a-e98d92e6cf79 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:01.080876 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a78e92-ab63-472c-9fd4-360780addbaf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d8000eb20445b78ee56ac372cd024c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:01.081510 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a78e92-ab63-472c-9fd4-360780addbaf service glance] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:01.081796 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a78e92-ab63-472c-9fd4-360780addbaf service glance] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:01.082063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a78e92-ab63-472c-9fd4-360780addbaf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:01.083678 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-87a78e92-ab63-472c-9fd4-360780addbaf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:01.151945 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:01.191868 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a78e92-ab63-472c-9fd4-360780addbaf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:01.193314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a78e92-ab63-472c-9fd4-360780addbaf service glance] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:01.212220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 683/1396] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:11:02.092099 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daec47-854a-4e37-af3c-cdf832bfc4f7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:02.092611 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daec47-854a-4e37-af3c-cdf832bfc4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:02.092795 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daec47-854a-4e37-af3c-cdf832bfc4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:02.159242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-08daec47-854a-4e37-af3c-cdf832bfc4f7 None None] MFA Rules not processed for user `5c29eab582a64a8991b171766d321e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:02.160449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-08daec47-854a-4e37-af3c-cdf832bfc4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:02.169641 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:02.253840 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 714/1397] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Aug 9 19:11:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:02.302337 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17dda9-b96f-48e2-a631-2306824aeac7 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:02.303237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17dda9-b96f-48e2-a631-2306824aeac7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:02.303717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17dda9-b96f-48e2-a631-2306824aeac7 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:02.306071 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 684/1398] 10.222.0.65 () {54 vars in 943 bytes} [Tue Aug 9 19:11:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:02.316670 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465802ea-6468-47a3-a214-b3eb8eaacf64 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:02.316969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465802ea-6468-47a3-a214-b3eb8eaacf64 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:02.317522 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465802ea-6468-47a3-a214-b3eb8eaacf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:02.410895 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-465802ea-6468-47a3-a214-b3eb8eaacf64 None None] MFA Rules not processed for user `aac48cd591b44f2999d2f172262019da`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:02.412346 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-465802ea-6468-47a3-a214-b3eb8eaacf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:02.414628 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e8b88-2b2f-4da7-bf50-652c52a5db86 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:02.414910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e8b88-2b2f-4da7-bf50-652c52a5db86 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:02.415181 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e8b88-2b2f-4da7-bf50-652c52a5db86 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:02.417254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 685/1399] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:11:02.423204 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf73cd7-7eae-4845-a800-3235fc20e1ff None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:02.424108 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf73cd7-7eae-4845-a800-3235fc20e1ff None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:02.424797 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf73cd7-7eae-4845-a800-3235fc20e1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:02.515880 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-fbf73cd7-7eae-4845-a800-3235fc20e1ff None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:02.518090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fbf73cd7-7eae-4845-a800-3235fc20e1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:02.551171 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:02.576962 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 715/1400] 10.222.0.65 () {58 vars in 1040 bytes} [Tue Aug 9 19:11:02 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:02.587327 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465802ea-6468-47a3-a214-b3eb8eaacf64 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:02.598891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465802ea-6468-47a3-a214-b3eb8eaacf64 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:02.649655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 686/1401] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:11:02.697284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf73cd7-7eae-4845-a800-3235fc20e1ff None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:02.699013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fbf73cd7-7eae-4845-a800-3235fc20e1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:02.726237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9765c1-6539-498b-b5d7-2087d0013b60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac48cd591b44f2999d2f172262019da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:02.727000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:02.727141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9765c1-6539-498b-b5d7-2087d0013b60 service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:02.727389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9765c1-6539-498b-b5d7-2087d0013b60 service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:02.727665 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9765c1-6539-498b-b5d7-2087d0013b60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:02.730396 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-dd9765c1-6539-498b-b5d7-2087d0013b60 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:02.819805 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9765c1-6539-498b-b5d7-2087d0013b60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:02.821337 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9765c1-6539-498b-b5d7-2087d0013b60 service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:02.828859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf73cd7-7eae-4845-a800-3235fc20e1ff None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:02.830999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 716/1402] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Aug 9 19:11:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 19:11:02.958073 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60385f97-94fa-49d2-9860-5e257d671f7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:02.958682 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60385f97-94fa-49d2-9860-5e257d671f7c service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:02.958964 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60385f97-94fa-49d2-9860-5e257d671f7c service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:02.959235 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60385f97-94fa-49d2-9860-5e257d671f7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:02.960845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-60385f97-94fa-49d2-9860-5e257d671f7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:02.980923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:03.066776 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60385f97-94fa-49d2-9860-5e257d671f7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:03.068368 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60385f97-94fa-49d2-9860-5e257d671f7c service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:03.094134 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 687/1403] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:11:05.279020 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b126c-d615-4144-9dd7-fe57233bb41f None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:05.279702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b126c-d615-4144-9dd7-fe57233bb41f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:05.279702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b126c-d615-4144-9dd7-fe57233bb41f None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:05.284935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 717/1404] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:11:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:05.286997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24796a52-203c-45d2-b134-27651e972007 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:05.287518 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24796a52-203c-45d2-b134-27651e972007 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:05.287953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24796a52-203c-45d2-b134-27651e972007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:05.398848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-24796a52-203c-45d2-b134-27651e972007 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:05.400872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-24796a52-203c-45d2-b134-27651e972007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:05.543030 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:05.549936 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 688/1405] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:11:05.597197 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b126c-d615-4144-9dd7-fe57233bb41f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:05.599143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cc8b126c-d615-4144-9dd7-fe57233bb41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:05.609683 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:05.760488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b126c-d615-4144-9dd7-fe57233bb41f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:05.851320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:05.892947 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b571885-c8d5-4e42-9c70-be0f05a4da9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:05.893588 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b571885-c8d5-4e42-9c70-be0f05a4da9d service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:05.893870 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b571885-c8d5-4e42-9c70-be0f05a4da9d service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:05.894143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b571885-c8d5-4e42-9c70-be0f05a4da9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:05.895927 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1b571885-c8d5-4e42-9c70-be0f05a4da9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:05.995267 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b571885-c8d5-4e42-9c70-be0f05a4da9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:05.997078 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b571885-c8d5-4e42-9c70-be0f05a4da9d service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:06.019708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 718/1406] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:11:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:11:08.169904 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e73cf6-c379-4750-b74d-93e393478b89 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:08.170438 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e73cf6-c379-4750-b74d-93e393478b89 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:08.170438 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e73cf6-c379-4750-b74d-93e393478b89 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:08.173487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 689/1407] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:08.177561 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bac0b-5390-4295-9fab-cb3fc1feef0e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:08.177981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bac0b-5390-4295-9fab-cb3fc1feef0e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:08.178177 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bac0b-5390-4295-9fab-cb3fc1feef0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:08.252314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e15bac0b-5390-4295-9fab-cb3fc1feef0e None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:08.253835 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e15bac0b-5390-4295-9fab-cb3fc1feef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:08.302637 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:08.365482 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 719/1408] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:08.403061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e73cf6-c379-4750-b74d-93e393478b89 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:08.404887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-87e73cf6-c379-4750-b74d-93e393478b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:08.580369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e73cf6-c379-4750-b74d-93e393478b89 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:08.653562 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:08.703044 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d49092-e297-4206-9727-46011c7bbf4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:08.705154 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d49092-e297-4206-9727-46011c7bbf4d service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:08.705154 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d49092-e297-4206-9727-46011c7bbf4d service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:08.705154 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d49092-e297-4206-9727-46011c7bbf4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:08.706640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e7d49092-e297-4206-9727-46011c7bbf4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:08.808453 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d49092-e297-4206-9727-46011c7bbf4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:08.810104 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d49092-e297-4206-9727-46011c7bbf4d service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:08.832779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 690/1409] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:11:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:11:18.353618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=23 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:18.829338 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=64 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:26.527357 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d421f-f79e-413f-a295-e23c89468c24 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:26.527870 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d421f-f79e-413f-a295-e23c89468c24 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:26.527978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d421f-f79e-413f-a295-e23c89468c24 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:26.529242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 720/1410] 10.222.0.65 () {54 vars in 918 bytes} [Tue Aug 9 19:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:26.534267 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc8bfa-7e9b-4003-9026-04fe092c6bb8 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:26.534700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc8bfa-7e9b-4003-9026-04fe092c6bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:26.534811 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc8bfa-7e9b-4003-9026-04fe092c6bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:26.610061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-fcbc8bfa-7e9b-4003-9026-04fe092c6bb8 None None] MFA Rules not processed for user `c6172f0733384291992624ef6a527ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:26.611331 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fcbc8bfa-7e9b-4003-9026-04fe092c6bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:26.718691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 691/1411] 10.222.0.65 () {58 vars in 1015 bytes} [Tue Aug 9 19:11:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:26.734613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637a7f9-d450-41d1-99d9-af6b9bab3f3f None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:26.734898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637a7f9-d450-41d1-99d9-af6b9bab3f3f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:26.735175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637a7f9-d450-41d1-99d9-af6b9bab3f3f None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:26.736519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 721/1412] 10.222.0.65 () {54 vars in 918 bytes} [Tue Aug 9 19:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:26.741580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079e1e5-a0c1-4d42-b69c-613a41cd3cd6 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:26.741870 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079e1e5-a0c1-4d42-b69c-613a41cd3cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:26.742143 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079e1e5-a0c1-4d42-b69c-613a41cd3cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:26.814426 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:26.817414 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-5079e1e5-a0c1-4d42-b69c-613a41cd3cd6 None None] MFA Rules not processed for user `2cfda1bec35145f3bbcc13fae0b7af2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:26.818664 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5079e1e5-a0c1-4d42-b69c-613a41cd3cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:26.933790 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 692/1413] 10.222.0.65 () {58 vars in 1015 bytes} [Tue Aug 9 19:11:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:29.401436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7cfb8-4a2e-4448-a421-9ec440f77a2f None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:29.402007 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7cfb8-4a2e-4448-a421-9ec440f77a2f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:29.402007 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7cfb8-4a2e-4448-a421-9ec440f77a2f None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:29.403361 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 722/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 19:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:29.408510 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df976c84-6703-417c-b72d-93f82c9c3d74 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:29.408957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df976c84-6703-417c-b72d-93f82c9c3d74 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:29.409056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df976c84-6703-417c-b72d-93f82c9c3d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:29.474971 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-df976c84-6703-417c-b72d-93f82c9c3d74 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:29.476197 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-df976c84-6703-417c-b72d-93f82c9c3d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:29.532110 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:29.573693 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 693/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 19:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:29.616585 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7cfb8-4a2e-4448-a421-9ec440f77a2f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:29.618275 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-23b7cfb8-4a2e-4448-a421-9ec440f77a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:29.761619 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7cfb8-4a2e-4448-a421-9ec440f77a2f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:29.836671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:29.875594 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca4a4c-cdf6-4d2c-871b-d6cadd962daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:29.876199 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca4a4c-cdf6-4d2c-871b-d6cadd962daa service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:29.876476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca4a4c-cdf6-4d2c-871b-d6cadd962daa service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:29.876746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca4a4c-cdf6-4d2c-871b-d6cadd962daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:29.878373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-aeca4a4c-cdf6-4d2c-871b-d6cadd962daa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:29.964590 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca4a4c-cdf6-4d2c-871b-d6cadd962daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:29.966244 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca4a4c-cdf6-4d2c-871b-d6cadd962daa service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:29.983941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 723/1416] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:11:30.879831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e6fa3-7c53-4a05-9914-67fce28de77f None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:30.880388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e6fa3-7c53-4a05-9914-67fce28de77f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:30.880388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e6fa3-7c53-4a05-9914-67fce28de77f None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:30.881805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 694/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 19:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:30.887526 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca8dcd-37f1-4990-b901-28a91ca1c842 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:30.887938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca8dcd-37f1-4990-b901-28a91ca1c842 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:30.888070 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca8dcd-37f1-4990-b901-28a91ca1c842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:30.963025 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1aca8dcd-37f1-4990-b901-28a91ca1c842 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:30.964240 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1aca8dcd-37f1-4990-b901-28a91ca1c842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:30.990427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:31.059547 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 724/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 19:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:31.208744 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e6fa3-7c53-4a05-9914-67fce28de77f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:31.210284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-497e6fa3-7c53-4a05-9914-67fce28de77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:31.357253 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e6fa3-7c53-4a05-9914-67fce28de77f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:31.398370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:31.470616 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6aa65-52c7-4c3b-a4d4-b35539c9e84a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:31.471136 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6aa65-52c7-4c3b-a4d4-b35539c9e84a service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:31.471413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6aa65-52c7-4c3b-a4d4-b35539c9e84a service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:31.471683 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6aa65-52c7-4c3b-a4d4-b35539c9e84a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:31.473281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7ac6aa65-52c7-4c3b-a4d4-b35539c9e84a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:31.562780 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6aa65-52c7-4c3b-a4d4-b35539c9e84a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:31.564395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6aa65-52c7-4c3b-a4d4-b35539c9e84a service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:31.582106 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 695/1419] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:11:32.470844 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd99b71-c887-4571-949e-6d35c093a8b4 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:32.471389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd99b71-c887-4571-949e-6d35c093a8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:32.471389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd99b71-c887-4571-949e-6d35c093a8b4 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:32.472746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 725/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 19:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:32.478593 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d734067-4bbe-43e5-8867-4a31d49521cb None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:32.479026 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d734067-4bbe-43e5-8867-4a31d49521cb None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:32.479144 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d734067-4bbe-43e5-8867-4a31d49521cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:32.534186 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:32.555935 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9d734067-4bbe-43e5-8867-4a31d49521cb None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:32.557149 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9d734067-4bbe-43e5-8867-4a31d49521cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:32.651146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 696/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 19:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:11:32.802735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd99b71-c887-4571-949e-6d35c093a8b4 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:32.804169 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9bd99b71-c887-4571-949e-6d35c093a8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:32.947474 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd99b71-c887-4571-949e-6d35c093a8b4 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:32.959226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:33.060061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d49bc-68a0-482c-98c9-7311daa7a623 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:33.060588 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d49bc-68a0-482c-98c9-7311daa7a623 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:33.060869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d49bc-68a0-482c-98c9-7311daa7a623 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:33.061141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d49bc-68a0-482c-98c9-7311daa7a623 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:33.062779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bf2d49bc-68a0-482c-98c9-7311daa7a623 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:33.150786 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d49bc-68a0-482c-98c9-7311daa7a623 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:33.152377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d49bc-68a0-482c-98c9-7311daa7a623 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:33.170032 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 726/1422] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:11:34.029306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f7e15-a8ac-4423-91be-eb6b875116fb None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:34.029917 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f7e15-a8ac-4423-91be-eb6b875116fb None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:34.029917 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f7e15-a8ac-4423-91be-eb6b875116fb None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:34.031227 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 697/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 19:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:34.036086 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619147d-45b6-4f0b-885e-10324a9126eb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:34.036519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619147d-45b6-4f0b-885e-10324a9126eb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:34.036646 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619147d-45b6-4f0b-885e-10324a9126eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:34.056943 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:34.113344 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c619147d-45b6-4f0b-885e-10324a9126eb None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:34.114581 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c619147d-45b6-4f0b-885e-10324a9126eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:34.208423 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 727/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 19:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:34.360002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f7e15-a8ac-4423-91be-eb6b875116fb None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:34.361795 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5e6f7e15-a8ac-4423-91be-eb6b875116fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:34.474828 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:34.514114 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f7e15-a8ac-4423-91be-eb6b875116fb None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:34.625307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0fbae-ff81-4b81-b941-e74cbb93bc4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:34.625848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0fbae-ff81-4b81-b941-e74cbb93bc4b service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:34.626127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0fbae-ff81-4b81-b941-e74cbb93bc4b service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:34.626397 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0fbae-ff81-4b81-b941-e74cbb93bc4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:34.627989 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8bf0fbae-ff81-4b81-b941-e74cbb93bc4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:34.702031 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:34.716098 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0fbae-ff81-4b81-b941-e74cbb93bc4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:34.717730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0fbae-ff81-4b81-b941-e74cbb93bc4b service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:34.736105 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 698/1425] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:11:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:11:35.601851 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f392957-be90-4293-9d71-a7701ae9834a None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:35.602404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f392957-be90-4293-9d71-a7701ae9834a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:35.602404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f392957-be90-4293-9d71-a7701ae9834a None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:35.603749 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 728/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 19:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:35.608736 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb473914-ee96-478e-a16f-421d82f225cb None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:35.609150 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb473914-ee96-478e-a16f-421d82f225cb None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:35.609285 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb473914-ee96-478e-a16f-421d82f225cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:35.683979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-cb473914-ee96-478e-a16f-421d82f225cb None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:35.685179 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cb473914-ee96-478e-a16f-421d82f225cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:35.780939 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 699/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 19:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:35.933317 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f392957-be90-4293-9d71-a7701ae9834a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:35.934880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6f392957-be90-4293-9d71-a7701ae9834a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:36.017640 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:36.079217 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f392957-be90-4293-9d71-a7701ae9834a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:36.310686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee66456-05df-4dbf-8190-8bdc5331e979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:36.311181 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee66456-05df-4dbf-8190-8bdc5331e979 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:36.311458 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee66456-05df-4dbf-8190-8bdc5331e979 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:36.311725 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee66456-05df-4dbf-8190-8bdc5331e979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:36.313308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4ee66456-05df-4dbf-8190-8bdc5331e979 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:36.359928 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:36.400699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee66456-05df-4dbf-8190-8bdc5331e979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:36.402315 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee66456-05df-4dbf-8190-8bdc5331e979 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:36.419819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 729/1428] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:11:37.282052 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e54e42-d536-4cda-90ea-48ebf07bfd46 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:37.282627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e54e42-d536-4cda-90ea-48ebf07bfd46 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:37.282627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e54e42-d536-4cda-90ea-48ebf07bfd46 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:37.284022 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 700/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 19:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:37.289676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5560eaa-4bff-4004-a817-095cf9585665 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:37.293601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5560eaa-4bff-4004-a817-095cf9585665 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:37.293601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5560eaa-4bff-4004-a817-095cf9585665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:37.367025 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b5560eaa-4bff-4004-a817-095cf9585665 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:37.368316 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b5560eaa-4bff-4004-a817-095cf9585665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:37.463057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 730/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 19:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:37.612909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e54e42-d536-4cda-90ea-48ebf07bfd46 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:37.614561 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-15e54e42-d536-4cda-90ea-48ebf07bfd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:37.662217 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:37.760113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e54e42-d536-4cda-90ea-48ebf07bfd46 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:37.869893 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e07d8-bdce-4922-b148-2bc7d89a57ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:37.870497 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e07d8-bdce-4922-b148-2bc7d89a57ce service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:37.870773 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e07d8-bdce-4922-b148-2bc7d89a57ce service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:37.871041 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e07d8-bdce-4922-b148-2bc7d89a57ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:37.872655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d97e07d8-bdce-4922-b148-2bc7d89a57ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:37.879639 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:37.963061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e07d8-bdce-4922-b148-2bc7d89a57ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:37.964699 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e07d8-bdce-4922-b148-2bc7d89a57ce service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:37.983461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 701/1431] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:11:38.823176 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18406a26-6281-4d99-9a55-82c520529b91 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:38.823692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18406a26-6281-4d99-9a55-82c520529b91 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:38.823692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18406a26-6281-4d99-9a55-82c520529b91 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:38.825006 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 731/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 19:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:38.830208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd870035-585b-4ed0-b07e-a48f29187341 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:38.830635 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd870035-585b-4ed0-b07e-a48f29187341 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:38.830793 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd870035-585b-4ed0-b07e-a48f29187341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:38.905107 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-fd870035-585b-4ed0-b07e-a48f29187341 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:38.906337 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fd870035-585b-4ed0-b07e-a48f29187341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:38.973063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:39.002134 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 702/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 19:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:39.153390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18406a26-6281-4d99-9a55-82c520529b91 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:39.155021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-18406a26-6281-4d99-9a55-82c520529b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:39.172935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:39.299470 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18406a26-6281-4d99-9a55-82c520529b91 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:39.384223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:39.409525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ac4d3-4dd1-49b4-ad35-a951b550878f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:39.410163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ac4d3-4dd1-49b4-ad35-a951b550878f service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:39.410442 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ac4d3-4dd1-49b4-ad35-a951b550878f service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:39.410710 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ac4d3-4dd1-49b4-ad35-a951b550878f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:39.412323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-988ac4d3-4dd1-49b4-ad35-a951b550878f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:39.499926 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ac4d3-4dd1-49b4-ad35-a951b550878f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:39.501614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ac4d3-4dd1-49b4-ad35-a951b550878f service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:39.519809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 732/1434] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:11:40.408992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1d867-9a51-456d-abac-6ba64c37b4ad None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:40.409575 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1d867-9a51-456d-abac-6ba64c37b4ad None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:40.409689 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1d867-9a51-456d-abac-6ba64c37b4ad None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:40.410976 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 703/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 19:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:40.416701 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011393f4-6401-460b-8e5e-b73111b35754 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:40.417173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011393f4-6401-460b-8e5e-b73111b35754 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:40.417269 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011393f4-6401-460b-8e5e-b73111b35754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:40.491210 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-011393f4-6401-460b-8e5e-b73111b35754 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:40.493024 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-011393f4-6401-460b-8e5e-b73111b35754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:40.534597 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:40.588186 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 733/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 19:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:40.740800 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1d867-9a51-456d-abac-6ba64c37b4ad None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:40.742639 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-65f1d867-9a51-456d-abac-6ba64c37b4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:41.008327 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1d867-9a51-456d-abac-6ba64c37b4ad None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:41.061254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:41.119817 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcac4b1-41e6-417b-ba76-c8427a6f5987 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:41.120420 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcac4b1-41e6-417b-ba76-c8427a6f5987 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:41.120701 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcac4b1-41e6-417b-ba76-c8427a6f5987 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:41.120973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcac4b1-41e6-417b-ba76-c8427a6f5987 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:41.122632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6bcac4b1-41e6-417b-ba76-c8427a6f5987 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:41.208618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcac4b1-41e6-417b-ba76-c8427a6f5987 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:41.210892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcac4b1-41e6-417b-ba76-c8427a6f5987 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:41.228189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 704/1437] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:11:42.090248 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ed874-36ac-4ad1-99e8-0692b15e2283 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:42.090707 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ed874-36ac-4ad1-99e8-0692b15e2283 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:42.090812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ed874-36ac-4ad1-99e8-0692b15e2283 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:42.092180 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 734/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 19:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:42.096924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21007c-ba6f-4b59-82ea-750449d57444 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:42.097375 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21007c-ba6f-4b59-82ea-750449d57444 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:42.097503 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21007c-ba6f-4b59-82ea-750449d57444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:42.171316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2f21007c-ba6f-4b59-82ea-750449d57444 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:42.172521 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2f21007c-ba6f-4b59-82ea-750449d57444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:42.174552 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:42.271611 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 705/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 19:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:42.426981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ed874-36ac-4ad1-99e8-0692b15e2283 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:42.428531 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-360ed874-36ac-4ad1-99e8-0692b15e2283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:42.577577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ed874-36ac-4ad1-99e8-0692b15e2283 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:42.602762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:42.687651 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe467d-e6ba-4925-a961-d50f89899055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:42.688259 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe467d-e6ba-4925-a961-d50f89899055 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:42.688539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe467d-e6ba-4925-a961-d50f89899055 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:42.688810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe467d-e6ba-4925-a961-d50f89899055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:42.690473 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9bfe467d-e6ba-4925-a961-d50f89899055 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:42.778680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe467d-e6ba-4925-a961-d50f89899055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:42.780272 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe467d-e6ba-4925-a961-d50f89899055 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:42.798074 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 735/1440] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:11:44.689504 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a79ff7-7ae7-4847-944a-883fd1226898 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:44.690005 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a79ff7-7ae7-4847-944a-883fd1226898 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:44.690118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a79ff7-7ae7-4847-944a-883fd1226898 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:44.691395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 706/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 19:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:44.697315 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b1abd-8ef0-4558-a0ad-90970752de01 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:44.697763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b1abd-8ef0-4558-a0ad-90970752de01 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:44.697884 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b1abd-8ef0-4558-a0ad-90970752de01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:44.737606 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:44.762537 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-de1b1abd-8ef0-4558-a0ad-90970752de01 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:44.763674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-de1b1abd-8ef0-4558-a0ad-90970752de01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:44.860158 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 736/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 19:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:44.900372 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a79ff7-7ae7-4847-944a-883fd1226898 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:44.902040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-17a79ff7-7ae7-4847-944a-883fd1226898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:45.003451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a79ff7-7ae7-4847-944a-883fd1226898 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:45.036455 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:45.077965 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e483a6-4c79-474e-97e0-c25775c6d95b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:45.078566 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e483a6-4c79-474e-97e0-c25775c6d95b service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:45.078844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e483a6-4c79-474e-97e0-c25775c6d95b service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:45.079112 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e483a6-4c79-474e-97e0-c25775c6d95b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:45.080699 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c4e483a6-4c79-474e-97e0-c25775c6d95b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:45.186419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e483a6-4c79-474e-97e0-c25775c6d95b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:45.187848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e483a6-4c79-474e-97e0-c25775c6d95b service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:45.205831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 707/1443] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:11:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:11:47.428716 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86793b43-a8bd-43e3-aba5-f60e02e25674 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:47.429268 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86793b43-a8bd-43e3-aba5-f60e02e25674 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:47.429268 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86793b43-a8bd-43e3-aba5-f60e02e25674 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:47.430793 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 737/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 19:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:47.436227 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d2344-9c28-4dce-bf49-5924c6c67496 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:47.436635 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d2344-9c28-4dce-bf49-5924c6c67496 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:47.436770 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d2344-9c28-4dce-bf49-5924c6c67496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:47.504790 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-e10d2344-9c28-4dce-bf49-5924c6c67496 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:47.506497 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e10d2344-9c28-4dce-bf49-5924c6c67496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:47.519589 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:47.602875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 708/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 19:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:47.641066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86793b43-a8bd-43e3-aba5-f60e02e25674 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:47.642655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-86793b43-a8bd-43e3-aba5-f60e02e25674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:47.746549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86793b43-a8bd-43e3-aba5-f60e02e25674 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:47.759126 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:47.819547 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b964c-0a4d-443a-9ef4-0b797c77bfa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:47.820729 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b964c-0a4d-443a-9ef4-0b797c77bfa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:47.821008 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b964c-0a4d-443a-9ef4-0b797c77bfa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:47.821281 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b964c-0a4d-443a-9ef4-0b797c77bfa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:47.822919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f62b964c-0a4d-443a-9ef4-0b797c77bfa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:47.929993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b964c-0a4d-443a-9ef4-0b797c77bfa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:47.931443 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b964c-0a4d-443a-9ef4-0b797c77bfa5 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:47.950462 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 738/1446] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:11:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:11:50.299149 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4946778-4642-4ccb-83cd-4af94f084152 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:50.299709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4946778-4642-4ccb-83cd-4af94f084152 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:50.299709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4946778-4642-4ccb-83cd-4af94f084152 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:50.301236 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 709/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 19:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:11:50.306829 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca135f9d-ffa7-4ed6-876f-62004e51f8cd None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:50.307247 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca135f9d-ffa7-4ed6-876f-62004e51f8cd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:50.307352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca135f9d-ffa7-4ed6-876f-62004e51f8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:50.354402 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:50.373076 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ca135f9d-ffa7-4ed6-876f-62004e51f8cd None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:50.374329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ca135f9d-ffa7-4ed6-876f-62004e51f8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:50.469677 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 739/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 19:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:50.510807 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4946778-4642-4ccb-83cd-4af94f084152 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:50.512364 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d4946778-4642-4ccb-83cd-4af94f084152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:50.614242 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4946778-4642-4ccb-83cd-4af94f084152 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:50.654080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:50.688442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48432a99-ab7e-4e3b-9058-0a42f6b0f537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:50.689043 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48432a99-ab7e-4e3b-9058-0a42f6b0f537 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:50.689317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48432a99-ab7e-4e3b-9058-0a42f6b0f537 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:50.689624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48432a99-ab7e-4e3b-9058-0a42f6b0f537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:50.691269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-48432a99-ab7e-4e3b-9058-0a42f6b0f537 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:50.797733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48432a99-ab7e-4e3b-9058-0a42f6b0f537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:50.799177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48432a99-ab7e-4e3b-9058-0a42f6b0f537 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:50.817442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 710/1449] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:11:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:11:52.943260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219886f-c1a6-4d30-910a-f9f058535ad7 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:52.943823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219886f-c1a6-4d30-910a-f9f058535ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:52.943823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219886f-c1a6-4d30-910a-f9f058535ad7 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:52.945691 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 740/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 19:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:52.951011 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b8f5d-6d90-4529-b19d-7ebb5093eaa4 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:52.951399 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b8f5d-6d90-4529-b19d-7ebb5093eaa4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:52.951560 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b8f5d-6d90-4529-b19d-7ebb5093eaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:53.016776 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c02b8f5d-6d90-4529-b19d-7ebb5093eaa4 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:53.018004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c02b8f5d-6d90-4529-b19d-7ebb5093eaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:53.038570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:53.113693 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 711/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 19:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:53.154299 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219886f-c1a6-4d30-910a-f9f058535ad7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:53.155872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a219886f-c1a6-4d30-910a-f9f058535ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:53.259182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219886f-c1a6-4d30-910a-f9f058535ad7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:53.278373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:53.331045 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1173f-574a-4050-b5f1-8280463c7b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:53.331644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1173f-574a-4050-b5f1-8280463c7b96 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:53.331924 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1173f-574a-4050-b5f1-8280463c7b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:53.332196 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1173f-574a-4050-b5f1-8280463c7b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:53.333825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b2e1173f-574a-4050-b5f1-8280463c7b96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:53.441488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1173f-574a-4050-b5f1-8280463c7b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:53.442937 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1173f-574a-4050-b5f1-8280463c7b96 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:53.460627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 741/1452] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:11:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:11:55.496899 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022e694-3468-456c-8da0-ae2e385b4772 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:55.497493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022e694-3468-456c-8da0-ae2e385b4772 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:55.497493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022e694-3468-456c-8da0-ae2e385b4772 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:55.498805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 712/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 19:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:11:55.504143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a1680-6bfa-484a-a61e-b2d559d6f8ce None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:55.504558 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a1680-6bfa-484a-a61e-b2d559d6f8ce None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:55.504780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a1680-6bfa-484a-a61e-b2d559d6f8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:55.567481 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:55.570111 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-010a1680-6bfa-484a-a61e-b2d559d6f8ce None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:55.571311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-010a1680-6bfa-484a-a61e-b2d559d6f8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:55.666577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 742/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 19:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:11:55.705017 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022e694-3468-456c-8da0-ae2e385b4772 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:55.706970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f022e694-3468-456c-8da0-ae2e385b4772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:55.810199 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022e694-3468-456c-8da0-ae2e385b4772 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:55.859797 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:55.884349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf7328-58ac-4bfb-b2d8-88c2da0af082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:55.884978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf7328-58ac-4bfb-b2d8-88c2da0af082 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:55.885234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf7328-58ac-4bfb-b2d8-88c2da0af082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:55.885532 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf7328-58ac-4bfb-b2d8-88c2da0af082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:55.887139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f4bf7328-58ac-4bfb-b2d8-88c2da0af082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:55.995585 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf7328-58ac-4bfb-b2d8-88c2da0af082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:55.997023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf7328-58ac-4bfb-b2d8-88c2da0af082 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:56.014907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 713/1455] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:11:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:11:58.083015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce15dd-2a38-4e4b-8ff1-1e50db9d6e83 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:58.083509 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce15dd-2a38-4e4b-8ff1-1e50db9d6e83 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:58.083666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce15dd-2a38-4e4b-8ff1-1e50db9d6e83 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:58.085036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 743/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 19:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:11:58.090737 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f934d3-6788-456d-8bf3-5269444d7522 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:58.091175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f934d3-6788-456d-8bf3-5269444d7522 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:58.091273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f934d3-6788-456d-8bf3-5269444d7522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:58.156715 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-31f934d3-6788-456d-8bf3-5269444d7522 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:11:58.157953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-31f934d3-6788-456d-8bf3-5269444d7522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:58.187116 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:58.254148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 714/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 19:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:11:58.292880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce15dd-2a38-4e4b-8ff1-1e50db9d6e83 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:11:58.294454 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ecce15dd-2a38-4e4b-8ff1-1e50db9d6e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:58.398610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce15dd-2a38-4e4b-8ff1-1e50db9d6e83 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:11:58.427226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:58.471967 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ea041-5b3f-4aed-9526-5ccb41440086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:11:58.472489 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ea041-5b3f-4aed-9526-5ccb41440086 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:11:58.472767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ea041-5b3f-4aed-9526-5ccb41440086 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:11:58.473039 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ea041-5b3f-4aed-9526-5ccb41440086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:11:58.474699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-221ea041-5b3f-4aed-9526-5ccb41440086 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:11:58.583769 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ea041-5b3f-4aed-9526-5ccb41440086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:11:58.585889 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ea041-5b3f-4aed-9526-5ccb41440086 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:11:58.604410 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 744/1458] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:12:00.649959 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c29aa-83e4-4993-a4a5-3f1dc605e942 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:00.650498 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c29aa-83e4-4993-a4a5-3f1dc605e942 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:00.650621 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c29aa-83e4-4993-a4a5-3f1dc605e942 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:00.651900 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 715/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 19:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:12:00.657167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200573a5-fb89-4a23-92ab-592d341bf5a0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:00.657631 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200573a5-fb89-4a23-92ab-592d341bf5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:00.657741 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200573a5-fb89-4a23-92ab-592d341bf5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:00.722883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-200573a5-fb89-4a23-92ab-592d341bf5a0 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:12:00.724086 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-200573a5-fb89-4a23-92ab-592d341bf5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:00.732240 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:00.822910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 745/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 19:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:12:00.859701 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c29aa-83e4-4993-a4a5-3f1dc605e942 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:12:00.861507 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-688c29aa-83e4-4993-a4a5-3f1dc605e942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:00.963198 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c29aa-83e4-4993-a4a5-3f1dc605e942 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:12:01.016866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:01.034645 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e491e-e0c4-4da8-9ae9-7edc97047b38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:12:01.035248 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e491e-e0c4-4da8-9ae9-7edc97047b38 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:01.035531 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e491e-e0c4-4da8-9ae9-7edc97047b38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:01.035798 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e491e-e0c4-4da8-9ae9-7edc97047b38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:01.037407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cd1e491e-e0c4-4da8-9ae9-7edc97047b38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:01.144528 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e491e-e0c4-4da8-9ae9-7edc97047b38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:12:01.146001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e491e-e0c4-4da8-9ae9-7edc97047b38 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:12:01.164145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 716/1461] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:12:03.398743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ced671-abd6-4b18-859e-772a4eb3171b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:03.399308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ced671-abd6-4b18-859e-772a4eb3171b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:03.399308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ced671-abd6-4b18-859e-772a4eb3171b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:03.400649 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 746/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 19:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:12:03.405985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba841b6-49fc-40ec-af27-ca2d506a3c1e None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:03.406411 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba841b6-49fc-40ec-af27-ca2d506a3c1e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:03.406522 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba841b6-49fc-40ec-af27-ca2d506a3c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:03.471513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-0ba841b6-49fc-40ec-af27-ca2d506a3c1e None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:12:03.472732 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0ba841b6-49fc-40ec-af27-ca2d506a3c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:03.511929 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:03.571053 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 717/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 19:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:12:03.609748 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ced671-abd6-4b18-859e-772a4eb3171b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:12:03.611538 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a3ced671-abd6-4b18-859e-772a4eb3171b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:03.713302 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ced671-abd6-4b18-859e-772a4eb3171b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:12:03.754287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:03.790805 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a19854-ab71-46aa-8734-09789ddcfddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:12:03.791405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a19854-ab71-46aa-8734-09789ddcfddd service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:03.791737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a19854-ab71-46aa-8734-09789ddcfddd service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:03.792039 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a19854-ab71-46aa-8734-09789ddcfddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:03.793666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e0a19854-ab71-46aa-8734-09789ddcfddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:03.900699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a19854-ab71-46aa-8734-09789ddcfddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:12:03.902204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a19854-ab71-46aa-8734-09789ddcfddd service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:12:03.921810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 747/1464] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:12:05.921486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34643e06-fb44-4a6d-a179-e0319bf3fc65 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:05.922021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34643e06-fb44-4a6d-a179-e0319bf3fc65 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:05.922021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34643e06-fb44-4a6d-a179-e0319bf3fc65 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:05.923377 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 718/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 19:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:12:05.931141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4cd74-31c1-480c-96d0-8b15d2e76e43 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:05.931538 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4cd74-31c1-480c-96d0-8b15d2e76e43 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:05.931698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4cd74-31c1-480c-96d0-8b15d2e76e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:05.997876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c1d4cd74-31c1-480c-96d0-8b15d2e76e43 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:12:05.999072 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c1d4cd74-31c1-480c-96d0-8b15d2e76e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:06.016891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:06.092942 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 748/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 19:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:12:06.129609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34643e06-fb44-4a6d-a179-e0319bf3fc65 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:12:06.131975 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-34643e06-fb44-4a6d-a179-e0319bf3fc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:06.232187 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34643e06-fb44-4a6d-a179-e0319bf3fc65 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:12:06.299026 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:06.306035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd5f5d-a04c-40c5-a5b8-a779c03101fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:12:06.306634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd5f5d-a04c-40c5-a5b8-a779c03101fa service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:06.306912 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd5f5d-a04c-40c5-a5b8-a779c03101fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:06.307186 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd5f5d-a04c-40c5-a5b8-a779c03101fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:06.308780 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-acbd5f5d-a04c-40c5-a5b8-a779c03101fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:06.415168 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd5f5d-a04c-40c5-a5b8-a779c03101fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:12:06.416604 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd5f5d-a04c-40c5-a5b8-a779c03101fa service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:12:06.434960 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 719/1467] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:12:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:12:08.469651 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861907c-f846-44c1-a700-409449130539 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:08.470261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861907c-f846-44c1-a700-409449130539 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:08.470261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861907c-f846-44c1-a700-409449130539 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:08.471536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 749/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 19:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:12:08.477580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927d86a-b0f0-4fdb-b5d2-811879794b3f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:08.477996 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927d86a-b0f0-4fdb-b5d2-811879794b3f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:08.478140 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927d86a-b0f0-4fdb-b5d2-811879794b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:08.545288 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9927d86a-b0f0-4fdb-b5d2-811879794b3f None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:12:08.546530 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9927d86a-b0f0-4fdb-b5d2-811879794b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:08.593617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:08.642861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 720/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 19:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:12:08.680227 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861907c-f846-44c1-a700-409449130539 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:12:08.681820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b861907c-f846-44c1-a700-409449130539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:08.783545 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861907c-f846-44c1-a700-409449130539 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:12:08.830316 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:08.856770 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282af3b-8462-469d-8f85-ab6838f8a839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:12:08.857373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282af3b-8462-469d-8f85-ab6838f8a839 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:08.857680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282af3b-8462-469d-8f85-ab6838f8a839 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:08.857950 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282af3b-8462-469d-8f85-ab6838f8a839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:08.859554 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6282af3b-8462-469d-8f85-ab6838f8a839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:08.964596 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282af3b-8462-469d-8f85-ab6838f8a839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:12:08.966157 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282af3b-8462-469d-8f85-ab6838f8a839 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:12:08.984589 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 750/1470] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:12:18.641049 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=22 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:18.982364 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=66 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:28.344374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5aeeaf-3995-4144-9424-857ca4b5c490 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:28.344908 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5aeeaf-3995-4144-9424-857ca4b5c490 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:28.344908 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5aeeaf-3995-4144-9424-857ca4b5c490 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:28.346189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 721/1471] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:12:28.351436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f012f-5aeb-41e3-b68e-2567afdd9faf None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:28.351868 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f012f-5aeb-41e3-b68e-2567afdd9faf None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:28.352014 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f012f-5aeb-41e3-b68e-2567afdd9faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:28.416968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-494f012f-5aeb-41e3-b68e-2567afdd9faf None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:12:28.418205 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-494f012f-5aeb-41e3-b68e-2567afdd9faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:28.515929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 751/1472] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:12:28.599762 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9d048-9b59-47f6-99f2-2e0bd35f5055 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:28.600046 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9d048-9b59-47f6-99f2-2e0bd35f5055 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:28.600320 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9d048-9b59-47f6-99f2-2e0bd35f5055 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:28.601801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 722/1473] 10.222.0.65 () {54 vars in 967 bytes} [Tue Aug 9 19:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:12:28.606569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab07fde-254b-4a1e-959b-0bf91d8c3eca None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:28.606863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab07fde-254b-4a1e-959b-0bf91d8c3eca None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:28.607136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab07fde-254b-4a1e-959b-0bf91d8c3eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:28.682575 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8ab07fde-254b-4a1e-959b-0bf91d8c3eca None None] MFA Rules not processed for user `98d8000eb20445b78ee56ac372cd024c`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:12:28.683791 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8ab07fde-254b-4a1e-959b-0bf91d8c3eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:28.703976 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:28.759126 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 752/1474] 10.222.0.65 () {58 vars in 1064 bytes} [Tue Aug 9 19:12:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:12:28.766958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9d048-9b59-47f6-99f2-2e0bd35f5055 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:12:28.768546 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-aaf9d048-9b59-47f6-99f2-2e0bd35f5055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:28.870982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9d048-9b59-47f6-99f2-2e0bd35f5055 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:12:28.944164 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7181a00-eceb-4b65-8fe7-769b10aa56e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d8000eb20445b78ee56ac372cd024c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:12:28.944805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7181a00-eceb-4b65-8fe7-769b10aa56e4 service glance] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:28.945093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7181a00-eceb-4b65-8fe7-769b10aa56e4 service glance] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:28.945365 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7181a00-eceb-4b65-8fe7-769b10aa56e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:28.947042 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a7181a00-eceb-4b65-8fe7-769b10aa56e4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:29.000221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:29.055221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7181a00-eceb-4b65-8fe7-769b10aa56e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:12:29.056662 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7181a00-eceb-4b65-8fe7-769b10aa56e4 service glance] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:12:29.075635 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 723/1475] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:12:31.167904 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857b075-9012-4ec4-801f-cc171362c7ed None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:31.168453 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857b075-9012-4ec4-801f-cc171362c7ed None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:31.168453 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857b075-9012-4ec4-801f-cc171362c7ed None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:31.169864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 753/1476] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:12:31.174973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a52099-6322-4be9-b5fe-8f271c40fe84 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:31.175393 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a52099-6322-4be9-b5fe-8f271c40fe84 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:31.175525 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a52099-6322-4be9-b5fe-8f271c40fe84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:31.241768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-49a52099-6322-4be9-b5fe-8f271c40fe84 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:12:31.242994 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-49a52099-6322-4be9-b5fe-8f271c40fe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:31.338509 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 724/1477] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:12:31.362022 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857b075-9012-4ec4-801f-cc171362c7ed None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:12:31.363621 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f857b075-9012-4ec4-801f-cc171362c7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:31.486668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857b075-9012-4ec4-801f-cc171362c7ed None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:12:31.534310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:31.576823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1212d3-3fa4-431b-93e2-918ddb6dc064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:12:31.577420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1212d3-3fa4-431b-93e2-918ddb6dc064 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:31.577721 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1212d3-3fa4-431b-93e2-918ddb6dc064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:31.577987 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1212d3-3fa4-431b-93e2-918ddb6dc064 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:31.578622 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1212d3-3fa4-431b-93e2-918ddb6dc064 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:12:31.581163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-bd1212d3-3fa4-431b-93e2-918ddb6dc064 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:12:31.581163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: warnings.warn(msg) Aug 09 19:12:31.581163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: Aug 09 19:12:31.582941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1212d3-3fa4-431b-93e2-918ddb6dc064 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:12:31.601610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 754/1478] 10.222.0.65 () {56 vars in 1108 bytes} [Tue Aug 9 19:12:31 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:12:33.605866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4de6b-5b27-4d9b-93ba-ee19acb749fa None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:33.606410 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4de6b-5b27-4d9b-93ba-ee19acb749fa None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:33.606410 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4de6b-5b27-4d9b-93ba-ee19acb749fa None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:33.607736 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 725/1479] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:12:33.613064 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2513eca-864f-423c-b71b-8e762301f0d4 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:33.614031 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2513eca-864f-423c-b71b-8e762301f0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:33.614139 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2513eca-864f-423c-b71b-8e762301f0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:33.679829 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e2513eca-864f-423c-b71b-8e762301f0d4 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:12:33.681035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e2513eca-864f-423c-b71b-8e762301f0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:33.778350 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 755/1480] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:12:33.821286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4de6b-5b27-4d9b-93ba-ee19acb749fa None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:12:33.822867 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-97e4de6b-5b27-4d9b-93ba-ee19acb749fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:33.833131 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:33.967784 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4de6b-5b27-4d9b-93ba-ee19acb749fa None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:12:34.044853 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:34.077325 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0805c4-a555-497c-840c-6fe69d449cd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:12:34.077952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0805c4-a555-497c-840c-6fe69d449cd7 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:34.078231 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0805c4-a555-497c-840c-6fe69d449cd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:34.078502 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0805c4-a555-497c-840c-6fe69d449cd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:34.080290 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ca0805c4-a555-497c-840c-6fe69d449cd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:34.169401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0805c4-a555-497c-840c-6fe69d449cd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:12:34.171016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0805c4-a555-497c-840c-6fe69d449cd7 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:12:34.188529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 726/1481] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:12:36.356065 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53b82c-35f2-453e-bc25-925c2d1e1923 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:36.356599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53b82c-35f2-453e-bc25-925c2d1e1923 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:36.356599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53b82c-35f2-453e-bc25-925c2d1e1923 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:36.357978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 756/1482] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:12:36.363957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe390a1e-6932-4003-a224-3f47d8c21cb8 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:36.364383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe390a1e-6932-4003-a224-3f47d8c21cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:36.364786 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe390a1e-6932-4003-a224-3f47d8c21cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:36.430237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-fe390a1e-6932-4003-a224-3f47d8c21cb8 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:12:36.431434 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fe390a1e-6932-4003-a224-3f47d8c21cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:36.478974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:36.529920 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 727/1483] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:12:36.567381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53b82c-35f2-453e-bc25-925c2d1e1923 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:12:36.569111 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ec53b82c-35f2-453e-bc25-925c2d1e1923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:36.593283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:36.674311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53b82c-35f2-453e-bc25-925c2d1e1923 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:12:36.746950 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8606e-6926-4cfe-9177-0ce2c6f08b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:12:36.747564 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8606e-6926-4cfe-9177-0ce2c6f08b89 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:36.747846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8606e-6926-4cfe-9177-0ce2c6f08b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:36.748121 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8606e-6926-4cfe-9177-0ce2c6f08b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:36.749768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-58d8606e-6926-4cfe-9177-0ce2c6f08b89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:36.824217 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:36.859190 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8606e-6926-4cfe-9177-0ce2c6f08b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:12:36.860890 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8606e-6926-4cfe-9177-0ce2c6f08b89 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:12:36.879025 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 757/1484] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:12:38.986166 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b88445-372a-4907-aa56-51ace4760ef9 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:38.986771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b88445-372a-4907-aa56-51ace4760ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:38.986771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b88445-372a-4907-aa56-51ace4760ef9 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:38.988570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 728/1485] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:12:38.993993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d369ae2-d0ff-4714-adb7-33efe2bef80d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:38.994424 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d369ae2-d0ff-4714-adb7-33efe2bef80d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:38.994530 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d369ae2-d0ff-4714-adb7-33efe2bef80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:39.060206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8d369ae2-d0ff-4714-adb7-33efe2bef80d None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:12:39.061413 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8d369ae2-d0ff-4714-adb7-33efe2bef80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:39.156266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 758/1486] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:12:39.195715 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b88445-372a-4907-aa56-51ace4760ef9 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:12:39.197343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-75b88445-372a-4907-aa56-51ace4760ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:39.298168 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b88445-372a-4907-aa56-51ace4760ef9 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:12:39.372003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:39.373845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5666e5-2f9f-49ce-aebc-4071901bc1c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:12:39.374454 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5666e5-2f9f-49ce-aebc-4071901bc1c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:39.374730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5666e5-2f9f-49ce-aebc-4071901bc1c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:39.374999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5666e5-2f9f-49ce-aebc-4071901bc1c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:39.376610 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0f5666e5-2f9f-49ce-aebc-4071901bc1c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:39.483729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5666e5-2f9f-49ce-aebc-4071901bc1c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:12:39.485430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5666e5-2f9f-49ce-aebc-4071901bc1c8 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:12:39.503760 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 729/1487] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:12:41.619720 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192118b0-2561-40b9-9717-33be0a111636 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:41.620306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192118b0-2561-40b9-9717-33be0a111636 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:41.620306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192118b0-2561-40b9-9717-33be0a111636 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:41.621654 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 759/1488] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:12:41.626962 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7853bc-6d39-42fd-8a85-98c74b0c55a7 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:41.627396 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7853bc-6d39-42fd-8a85-98c74b0c55a7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:41.627506 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7853bc-6d39-42fd-8a85-98c74b0c55a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:41.701827 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3b7853bc-6d39-42fd-8a85-98c74b0c55a7 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:12:41.703050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3b7853bc-6d39-42fd-8a85-98c74b0c55a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:41.755977 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:41.799226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 730/1489] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:12:41.840622 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192118b0-2561-40b9-9717-33be0a111636 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:12:41.842196 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-192118b0-2561-40b9-9717-33be0a111636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:41.878045 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:41.946727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192118b0-2561-40b9-9717-33be0a111636 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:12:42.017625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6a854-47c3-4019-bed3-f98668f9ae9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:12:42.018221 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6a854-47c3-4019-bed3-f98668f9ae9b service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:42.018498 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6a854-47c3-4019-bed3-f98668f9ae9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:42.018765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6a854-47c3-4019-bed3-f98668f9ae9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:42.020608 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c2e6a854-47c3-4019-bed3-f98668f9ae9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:42.098343 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:42.128073 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6a854-47c3-4019-bed3-f98668f9ae9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:12:42.130469 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6a854-47c3-4019-bed3-f98668f9ae9b service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:12:42.148514 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 760/1490] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:12:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:12:44.530105 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e53bb2-be15-43e2-9f0b-d937a8d4bf4d None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:44.530658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e53bb2-be15-43e2-9f0b-d937a8d4bf4d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:44.530658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e53bb2-be15-43e2-9f0b-d937a8d4bf4d None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:44.532025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 731/1491] 10.222.0.65 () {54 vars in 927 bytes} [Tue Aug 9 19:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:12:44.537309 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734efff1-2bc3-4991-9e3e-244fd6ba52eb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:44.537757 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734efff1-2bc3-4991-9e3e-244fd6ba52eb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:44.537894 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734efff1-2bc3-4991-9e3e-244fd6ba52eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:44.602452 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-734efff1-2bc3-4991-9e3e-244fd6ba52eb None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:12:44.603650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-734efff1-2bc3-4991-9e3e-244fd6ba52eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:44.698233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 761/1492] 10.222.0.65 () {58 vars in 1024 bytes} [Tue Aug 9 19:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:12:44.737394 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e53bb2-be15-43e2-9f0b-d937a8d4bf4d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:12:44.739527 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b4e53bb2-be15-43e2-9f0b-d937a8d4bf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:44.843716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e53bb2-be15-43e2-9f0b-d937a8d4bf4d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:12:44.917667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de01e0-18b2-4687-9546-b436a9382c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:12:44.918273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de01e0-18b2-4687-9546-b436a9382c9d service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:12:44.918552 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de01e0-18b2-4687-9546-b436a9382c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:12:44.918823 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de01e0-18b2-4687-9546-b436a9382c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:12:44.920539 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f6de01e0-18b2-4687-9546-b436a9382c9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:12:44.929940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:45.028990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de01e0-18b2-4687-9546-b436a9382c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:12:45.030516 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de01e0-18b2-4687-9546-b436a9382c9d service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:12:45.048660 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 732/1493] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:12:54.696474 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=82 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:55.046402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=50 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:02.914186 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806f7a3-2603-451a-93c6-f79d7d31df7d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:14:02.914777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806f7a3-2603-451a-93c6-f79d7d31df7d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:14:02.914777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806f7a3-2603-451a-93c6-f79d7d31df7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:14:02.989614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9806f7a3-2603-451a-93c6-f79d7d31df7d None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:14:02.990833 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9806f7a3-2603-451a-93c6-f79d7d31df7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:14:03.085340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 762/1494] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:14:03.093851 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0391e04-649e-497a-9acc-e207da06fc0f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:14:03.094356 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0391e04-649e-497a-9acc-e207da06fc0f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:14:03.094464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0391e04-649e-497a-9acc-e207da06fc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:14:03.169228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f0391e04-649e-497a-9acc-e207da06fc0f None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:14:03.171028 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f0391e04-649e-497a-9acc-e207da06fc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:14:03.268249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 733/1495] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:14:03.272963 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806f7a3-2603-451a-93c6-f79d7d31df7d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:14:03.274211 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9806f7a3-2603-451a-93c6-f79d7d31df7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:14:03.286290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806f7a3-2603-451a-93c6-f79d7d31df7d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:14:03.347612 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:03.381241 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4ad17-bb0f-4cdf-9dae-a9f31904da1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:14:03.381883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4ad17-bb0f-4cdf-9dae-a9f31904da1d admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:14:03.382161 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4ad17-bb0f-4cdf-9dae-a9f31904da1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:14:03.382429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4ad17-bb0f-4cdf-9dae-a9f31904da1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:14:03.383071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4ad17-bb0f-4cdf-9dae-a9f31904da1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:14:03.383372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4ad17-bb0f-4cdf-9dae-a9f31904da1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:14:03.384388 dv-cinder-852654-1-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-aea4ad17-bb0f-4cdf-9dae-a9f31904da1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:14:03.384388 dv-cinder-852654-1-smb devstack@keystone.service[80524]: warnings.warn(msg) Aug 09 19:14:03.384388 dv-cinder-852654-1-smb devstack@keystone.service[80524]: Aug 09 19:14:03.385274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4ad17-bb0f-4cdf-9dae-a9f31904da1d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:14:03.396703 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 763/1496] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:14:03.406351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0391e04-649e-497a-9acc-e207da06fc0f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:14:03.415551 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0391e04-649e-497a-9acc-e207da06fc0f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:14:03.487599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:03.525288 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7a54f-ee02-4414-b225-d6f00ff6c470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:14:03.525998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7a54f-ee02-4414-b225-d6f00ff6c470 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:14:03.526283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7a54f-ee02-4414-b225-d6f00ff6c470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:14:03.526558 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7a54f-ee02-4414-b225-d6f00ff6c470 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:14:03.527222 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7a54f-ee02-4414-b225-d6f00ff6c470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:14:03.528975 dv-cinder-852654-1-smb devstack@keystone.service[80523]: WARNING py.warnings [None req-d9b7a54f-ee02-4414-b225-d6f00ff6c470 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:14:03.528975 dv-cinder-852654-1-smb devstack@keystone.service[80523]: warnings.warn(msg) Aug 09 19:14:03.528975 dv-cinder-852654-1-smb devstack@keystone.service[80523]: Aug 09 19:14:03.531314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7a54f-ee02-4414-b225-d6f00ff6c470 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:14:03.675525 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 734/1497] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:14:03 2022] POST /identity/v3/projects => generated 379 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:14:03.680246 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4ad17-bb0f-4cdf-9dae-a9f31904da1d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:14:03.682664 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-aea4ad17-bb0f-4cdf-9dae-a9f31904da1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:14:03.721123 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4ad17-bb0f-4cdf-9dae-a9f31904da1d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:14:03.838401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba035afd-6a7b-4de0-bd8e-b185fb27dc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:14:03.839008 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba035afd-6a7b-4de0-bd8e-b185fb27dc16 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:14:03.839285 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba035afd-6a7b-4de0-bd8e-b185fb27dc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:14:03.839556 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba035afd-6a7b-4de0-bd8e-b185fb27dc16 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:14:03.840177 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba035afd-6a7b-4de0-bd8e-b185fb27dc16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:14:03.841251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-ba035afd-6a7b-4de0-bd8e-b185fb27dc16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:14:03.841251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: warnings.warn(msg) Aug 09 19:14:03.841251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: Aug 09 19:14:03.843243 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba035afd-6a7b-4de0-bd8e-b185fb27dc16 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:14:03.962391 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 764/1498] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:14:03 2022] POST /identity/v3/users => generated 290 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:14:03.967971 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7a54f-ee02-4414-b225-d6f00ff6c470 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:14:03.969607 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d9b7a54f-ee02-4414-b225-d6f00ff6c470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:14:04.035463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7a54f-ee02-4414-b225-d6f00ff6c470 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:14:04.116693 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:04.127905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c18bdd-ac1c-447c-a730-3c1cbe42208f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:14:04.128428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c18bdd-ac1c-447c-a730-3c1cbe42208f admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:14:04.128705 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c18bdd-ac1c-447c-a730-3c1cbe42208f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:14:04.128973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c18bdd-ac1c-447c-a730-3c1cbe42208f admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:14:04.129641 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c18bdd-ac1c-447c-a730-3c1cbe42208f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:14:04.130650 dv-cinder-852654-1-smb devstack@keystone.service[80523]: WARNING py.warnings [None req-90c18bdd-ac1c-447c-a730-3c1cbe42208f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:14:04.130650 dv-cinder-852654-1-smb devstack@keystone.service[80523]: warnings.warn(msg) Aug 09 19:14:04.130650 dv-cinder-852654-1-smb devstack@keystone.service[80523]: Aug 09 19:14:04.133403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c18bdd-ac1c-447c-a730-3c1cbe42208f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:14:04.145697 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 735/1499] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:14:04.149834 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba035afd-6a7b-4de0-bd8e-b185fb27dc16 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:14:04.151412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ba035afd-6a7b-4de0-bd8e-b185fb27dc16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:14:04.163006 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba035afd-6a7b-4de0-bd8e-b185fb27dc16 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:14:04.188003 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:04.265755 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac04ff-aefb-4c6a-b3cd-27fc5d987ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:14:04.266363 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac04ff-aefb-4c6a-b3cd-27fc5d987ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:14:04.266641 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac04ff-aefb-4c6a-b3cd-27fc5d987ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:14:04.266908 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac04ff-aefb-4c6a-b3cd-27fc5d987ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:14:04.267548 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac04ff-aefb-4c6a-b3cd-27fc5d987ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:14:04.268550 dv-cinder-852654-1-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-26ac04ff-aefb-4c6a-b3cd-27fc5d987ec8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:14:04.268550 dv-cinder-852654-1-smb devstack@keystone.service[80524]: warnings.warn(msg) Aug 09 19:14:04.268550 dv-cinder-852654-1-smb devstack@keystone.service[80524]: Aug 09 19:14:04.269432 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac04ff-aefb-4c6a-b3cd-27fc5d987ec8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:14:04.282259 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 765/1500] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:14:04.286543 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c18bdd-ac1c-447c-a730-3c1cbe42208f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:14:04.288063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-90c18bdd-ac1c-447c-a730-3c1cbe42208f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:14:04.321858 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c18bdd-ac1c-447c-a730-3c1cbe42208f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:14:04.415240 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19e1c3-050e-4f60-a8bc-ac012d8665db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:14:04.415907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19e1c3-050e-4f60-a8bc-ac012d8665db admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:14:04.416190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19e1c3-050e-4f60-a8bc-ac012d8665db admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:14:04.416465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19e1c3-050e-4f60-a8bc-ac012d8665db admin admin] PATH_INFO: `/v3/projects/89f2caea828f4cddab3dce78f2cbe9ed/users/89c6b28a5f5f4f01844a868430307848/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:14:04.439731 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19e1c3-050e-4f60-a8bc-ac012d8665db admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f2caea828f4cddab3dce78f2cbe9ed, user_id=89c6b28a5f5f4f01844a868430307848, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:14:04.440765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: WARNING py.warnings [None req-de19e1c3-050e-4f60-a8bc-ac012d8665db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:14:04.440765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: warnings.warn(msg) Aug 09 19:14:04.440765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: Aug 09 19:14:04.442749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19e1c3-050e-4f60-a8bc-ac012d8665db admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:14:04.541951 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 736/1501] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:14:04 2022] PUT /identity/v3/projects/89f2caea828f4cddab3dce78f2cbe9ed/users/89c6b28a5f5f4f01844a868430307848/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:14:04.555016 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e7fd4-7c40-47d9-bfcd-5f8fa8919094 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:14:04.555333 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e7fd4-7c40-47d9-bfcd-5f8fa8919094 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:14:04.555667 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e7fd4-7c40-47d9-bfcd-5f8fa8919094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:14:04.611836 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-398e7fd4-7c40-47d9-bfcd-5f8fa8919094 None None] MFA Rules not processed for user `89c6b28a5f5f4f01844a868430307848`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:14:04.613038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-398e7fd4-7c40-47d9-bfcd-5f8fa8919094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:14:04.689361 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 766/1502] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:14:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:14:04.702550 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca3ddd-2980-41ee-a179-d5ae0addd0a3 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:14:04.702838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca3ddd-2980-41ee-a179-d5ae0addd0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:14:04.703120 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca3ddd-2980-41ee-a179-d5ae0addd0a3 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:14:04.704452 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 737/1503] 10.222.0.65 () {54 vars in 964 bytes} [Tue Aug 9 19:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:14:04.709079 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275691ba-98cf-4e41-931e-d9a97e185f57 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:14:04.709362 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275691ba-98cf-4e41-931e-d9a97e185f57 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:14:04.709679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275691ba-98cf-4e41-931e-d9a97e185f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:14:04.741089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:04.784206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-275691ba-98cf-4e41-931e-d9a97e185f57 None None] MFA Rules not processed for user `bca1eca610c64b3a8ab04792dcca18b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:14:04.785435 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-275691ba-98cf-4e41-931e-d9a97e185f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:14:04.859657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 767/1504] 10.222.0.65 () {58 vars in 1061 bytes} [Tue Aug 9 19:14:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:14:04.867443 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca3ddd-2980-41ee-a179-d5ae0addd0a3 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:14:04.869048 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c0ca3ddd-2980-41ee-a179-d5ae0addd0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:14:04.918563 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:04.972163 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca3ddd-2980-41ee-a179-d5ae0addd0a3 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:14:05.045576 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d835a8-ca9e-4f3b-913c-fb291ac8ffcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:14:05.046202 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d835a8-ca9e-4f3b-913c-fb291ac8ffcb service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:14:05.046481 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d835a8-ca9e-4f3b-913c-fb291ac8ffcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:14:05.046752 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d835a8-ca9e-4f3b-913c-fb291ac8ffcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:14:05.048385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f1d835a8-ca9e-4f3b-913c-fb291ac8ffcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:14:05.144738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d835a8-ca9e-4f3b-913c-fb291ac8ffcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:14:05.146207 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d835a8-ca9e-4f3b-913c-fb291ac8ffcb service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:14:05.149744 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:05.164691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 738/1505] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:14:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:14:05.209928 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab242801-3611-4e2d-a9c6-d6acbaa255ca None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:14:05.210376 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab242801-3611-4e2d-a9c6-d6acbaa255ca None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:14:05.210485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab242801-3611-4e2d-a9c6-d6acbaa255ca None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:14:05.211745 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 768/1506] 10.222.0.65 () {52 vars in 830 bytes} [Tue Aug 9 19:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:14:05.215270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d835a8-ca9e-4f3b-913c-fb291ac8ffcb service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:14:05.216480 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f1d835a8-ca9e-4f3b-913c-fb291ac8ffcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:14:05.319157 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d835a8-ca9e-4f3b-913c-fb291ac8ffcb service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:14:05.411453 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df439754-03e0-4342-bc80-6e73688a0c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:14:05.412016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df439754-03e0-4342-bc80-6e73688a0c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:14:05.412296 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df439754-03e0-4342-bc80-6e73688a0c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:14:05.412569 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df439754-03e0-4342-bc80-6e73688a0c1b admin admin] PATH_INFO: `/v3/users/89c6b28a5f5f4f01844a868430307848` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:14:05.424410 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df439754-03e0-4342-bc80-6e73688a0c1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=89c6b28a5f5f4f01844a868430307848)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:14:05.425484 dv-cinder-852654-1-smb devstack@keystone.service[80523]: WARNING py.warnings [None req-df439754-03e0-4342-bc80-6e73688a0c1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:14:05.425484 dv-cinder-852654-1-smb devstack@keystone.service[80523]: warnings.warn(msg) Aug 09 19:14:05.425484 dv-cinder-852654-1-smb devstack@keystone.service[80523]: Aug 09 19:14:05.426695 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df439754-03e0-4342-bc80-6e73688a0c1b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:14:05.436831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:05.641875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-df439754-03e0-4342-bc80-6e73688a0c1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89c6b28a5f5f4f01844a868430307848'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:14:05.655967 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-df439754-03e0-4342-bc80-6e73688a0c1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89c6b28a5f5f4f01844a868430307848'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:14:05.656521 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-df439754-03e0-4342-bc80-6e73688a0c1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89c6b28a5f5f4f01844a868430307848'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:14:05.656941 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-df439754-03e0-4342-bc80-6e73688a0c1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89c6b28a5f5f4f01844a868430307848'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:14:05.729241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-df439754-03e0-4342-bc80-6e73688a0c1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89c6b28a5f5f4f01844a868430307848'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:14:05.758590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 739/1507] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:14:05 2022] DELETE /identity/v3/users/89c6b28a5f5f4f01844a868430307848 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:14:05.762960 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3ec37-15c2-4ac3-99bf-b5af15a7870b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:14:05.763267 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3ec37-15c2-4ac3-99bf-b5af15a7870b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:14:05.763547 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3ec37-15c2-4ac3-99bf-b5af15a7870b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:14:05.820377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-08a3ec37-15c2-4ac3-99bf-b5af15a7870b None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:14:05.821608 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-08a3ec37-15c2-4ac3-99bf-b5af15a7870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:14:05.896511 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:05.909860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 769/1508] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:14:05.919550 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df439754-03e0-4342-bc80-6e73688a0c1b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:14:05.921197 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-df439754-03e0-4342-bc80-6e73688a0c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:14:06.025814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df439754-03e0-4342-bc80-6e73688a0c1b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:14:06.083024 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:06.102292 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e6f4a-6920-49e9-85c3-fc99ff4f70ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:14:06.102901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e6f4a-6920-49e9-85c3-fc99ff4f70ee service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:14:06.103174 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e6f4a-6920-49e9-85c3-fc99ff4f70ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:14:06.103442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e6f4a-6920-49e9-85c3-fc99ff4f70ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:14:06.105032 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-453e6f4a-6920-49e9-85c3-fc99ff4f70ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:14:06.222354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e6f4a-6920-49e9-85c3-fc99ff4f70ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:14:06.223831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e6f4a-6920-49e9-85c3-fc99ff4f70ee service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:14:06.242888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 740/1509] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:14:06.776822 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3ec37-15c2-4ac3-99bf-b5af15a7870b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:14:06.778928 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-08a3ec37-15c2-4ac3-99bf-b5af15a7870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:14:06.789375 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3ec37-15c2-4ac3-99bf-b5af15a7870b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:14:06.884748 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c16b56-7423-4919-b53c-1549a92eacb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:14:06.885375 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c16b56-7423-4919-b53c-1549a92eacb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:14:06.885676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c16b56-7423-4919-b53c-1549a92eacb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:14:06.885945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c16b56-7423-4919-b53c-1549a92eacb7 admin admin] PATH_INFO: `/v3/projects/89f2caea828f4cddab3dce78f2cbe9ed` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:14:06.896610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c16b56-7423-4919-b53c-1549a92eacb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f2caea828f4cddab3dce78f2cbe9ed)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:14:06.897647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-a2c16b56-7423-4919-b53c-1549a92eacb7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:14:06.897647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: warnings.warn(msg) Aug 09 19:14:06.897647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: Aug 09 19:14:06.898850 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c16b56-7423-4919-b53c-1549a92eacb7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:14:07.014839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a2c16b56-7423-4919-b53c-1549a92eacb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f2caea828f4cddab3dce78f2cbe9ed', 'request_id': 'req-a2c16b56-7423-4919-b53c-1549a92eacb7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:14:07.021220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a2c16b56-7423-4919-b53c-1549a92eacb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f2caea828f4cddab3dce78f2cbe9ed', 'request_id': 'req-a2c16b56-7423-4919-b53c-1549a92eacb7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:14:07.111932 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a2c16b56-7423-4919-b53c-1549a92eacb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f2caea828f4cddab3dce78f2cbe9ed', 'request_id': 'req-a2c16b56-7423-4919-b53c-1549a92eacb7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:14:07.141861 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a2c16b56-7423-4919-b53c-1549a92eacb7 admin admin] The token cache is being invalidate because project 89f2caea828f4cddab3dce78f2cbe9ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:14:07.142061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a2c16b56-7423-4919-b53c-1549a92eacb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:14:07.142583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a2c16b56-7423-4919-b53c-1549a92eacb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:14:07.143883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 770/1510] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:14:06 2022] DELETE /identity/v3/projects/89f2caea828f4cddab3dce78f2cbe9ed => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:14:16.240618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=62 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:17.139203 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:43.039774 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c8ae2-78f6-4eed-b059-77daafd84b3d None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:15:43.040390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c8ae2-78f6-4eed-b059-77daafd84b3d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:15:43.040390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c8ae2-78f6-4eed-b059-77daafd84b3d None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:15:43.041706 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 741/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 19:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:15:43.047652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b7bf3-61ba-42a9-bcd6-5f751615f7ef None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:15:43.048158 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b7bf3-61ba-42a9-bcd6-5f751615f7ef None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:15:43.048637 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b7bf3-61ba-42a9-bcd6-5f751615f7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:15:43.130121 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-274b7bf3-61ba-42a9-bcd6-5f751615f7ef None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:15:43.131310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-274b7bf3-61ba-42a9-bcd6-5f751615f7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:15:43.236283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 771/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 19:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:15:43.390164 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c8ae2-78f6-4eed-b059-77daafd84b3d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:15:43.392287 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ce3c8ae2-78f6-4eed-b059-77daafd84b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:15:43.510903 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c8ae2-78f6-4eed-b059-77daafd84b3d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:15:43.517343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb3dbe-319b-4481-9116-b4359f7ee352 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:15:43.517981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb3dbe-319b-4481-9116-b4359f7ee352 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:15:43.518259 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb3dbe-319b-4481-9116-b4359f7ee352 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:15:43.518533 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb3dbe-319b-4481-9116-b4359f7ee352 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:15:43.527025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb3dbe-319b-4481-9116-b4359f7ee352 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:15:43.532239 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb3dbe-319b-4481-9116-b4359f7ee352 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:15:43.538075 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 742/1513] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:15:44.370548 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681306a1-5194-4d3a-a7da-21d736e4aa7b None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:15:44.371621 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681306a1-5194-4d3a-a7da-21d736e4aa7b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:15:44.371760 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681306a1-5194-4d3a-a7da-21d736e4aa7b None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:15:44.373145 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 772/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 19:15:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:15:44.377963 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29231516-d732-41d3-95a2-0194ef8d36e5 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:15:44.378392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29231516-d732-41d3-95a2-0194ef8d36e5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:15:44.378521 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29231516-d732-41d3-95a2-0194ef8d36e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:15:44.398150 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-29231516-d732-41d3-95a2-0194ef8d36e5 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:15:44.399346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-29231516-d732-41d3-95a2-0194ef8d36e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:15:44.407294 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 743/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 19:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:15:44.558965 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681306a1-5194-4d3a-a7da-21d736e4aa7b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:15:44.573195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681306a1-5194-4d3a-a7da-21d736e4aa7b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:15:44.579596 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f74d1-d131-4f55-a882-cd7549a81e4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:15:44.580191 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f74d1-d131-4f55-a882-cd7549a81e4d service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:15:44.580468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f74d1-d131-4f55-a882-cd7549a81e4d service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:15:44.580740 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f74d1-d131-4f55-a882-cd7549a81e4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:15:44.588750 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f74d1-d131-4f55-a882-cd7549a81e4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:15:44.590410 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f74d1-d131-4f55-a882-cd7549a81e4d service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:15:44.599619 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 773/1516] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:15:45.384318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edba30b-6346-4516-99fa-cf469c0e9d2e None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:15:45.384892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edba30b-6346-4516-99fa-cf469c0e9d2e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:15:45.384892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edba30b-6346-4516-99fa-cf469c0e9d2e None None] PATH_INFO: `/v3` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:15:45.386191 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 744/1517] 10.222.0.47 () {54 vars in 925 bytes} [Tue Aug 9 19:15:45 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:15:45.393258 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568fcf8-79b3-4423-a9e8-0fbab1a6392a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:15:45.393739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568fcf8-79b3-4423-a9e8-0fbab1a6392a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:15:45.393843 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568fcf8-79b3-4423-a9e8-0fbab1a6392a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:15:45.451895 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4568fcf8-79b3-4423-a9e8-0fbab1a6392a None None] MFA Rules not processed for user `c6172f0733384291992624ef6a527ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:15:45.453101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4568fcf8-79b3-4423-a9e8-0fbab1a6392a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:15:45.469396 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:45.523716 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 774/1518] 10.222.0.47 () {58 vars in 1015 bytes} [Tue Aug 9 19:15:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:15:54.393358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=56 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:55.253279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd8038-d6f6-4350-8646-ef8d30081096 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:15:55.253519 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd8038-d6f6-4350-8646-ef8d30081096 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:15:55.253765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd8038-d6f6-4350-8646-ef8d30081096 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:15:55.255169 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 745/1519] 10.222.0.65 () {54 vars in 961 bytes} [Tue Aug 9 19:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:15:55.260206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77ffd9-45fb-4eb6-b9ab-263334e32bca None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:15:55.260707 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77ffd9-45fb-4eb6-b9ab-263334e32bca None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:15:55.260822 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77ffd9-45fb-4eb6-b9ab-263334e32bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:15:55.280115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8b77ffd9-45fb-4eb6-b9ab-263334e32bca None None] MFA Rules not processed for user `c6172f0733384291992624ef6a527ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:15:55.281475 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8b77ffd9-45fb-4eb6-b9ab-263334e32bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:15:55.290081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 775/1520] 10.222.0.65 () {58 vars in 1058 bytes} [Tue Aug 9 19:15:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:15:55.298192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd8038-d6f6-4350-8646-ef8d30081096 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:15:55.312034 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd8038-d6f6-4350-8646-ef8d30081096 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:15:55.317038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1169d-2803-474b-bf5b-762b590b6b56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6172f0733384291992624ef6a527ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:15:55.317658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1169d-2803-474b-bf5b-762b590b6b56 service placement] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:15:55.317936 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1169d-2803-474b-bf5b-762b590b6b56 service placement] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:15:55.318206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1169d-2803-474b-bf5b-762b590b6b56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:15:55.326590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1169d-2803-474b-bf5b-762b590b6b56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:15:55.328155 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1169d-2803-474b-bf5b-762b590b6b56 service placement] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:15:55.337559 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 746/1521] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:15:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:15:55.865392 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8534ac6-fd6d-49fd-a696-3c8477a62f3d None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:15:55.865713 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8534ac6-fd6d-49fd-a696-3c8477a62f3d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:15:55.865987 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8534ac6-fd6d-49fd-a696-3c8477a62f3d None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:15:55.867362 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 776/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 19:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:15:55.873014 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b5f3a-49e6-4bae-b515-148eed75d267 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:15:55.873534 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b5f3a-49e6-4bae-b515-148eed75d267 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:15:55.873637 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b5f3a-49e6-4bae-b515-148eed75d267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:15:55.893893 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-025b5f3a-49e6-4bae-b515-148eed75d267 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:15:55.895100 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-025b5f3a-49e6-4bae-b515-148eed75d267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:15:55.903414 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 747/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 19:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:15:56.057304 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8534ac6-fd6d-49fd-a696-3c8477a62f3d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:15:56.072284 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8534ac6-fd6d-49fd-a696-3c8477a62f3d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:15:56.077771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e44374-7386-4220-ba32-61cf08bb87cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:15:56.078469 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e44374-7386-4220-ba32-61cf08bb87cc service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:15:56.084062 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e44374-7386-4220-ba32-61cf08bb87cc service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:15:56.084062 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e44374-7386-4220-ba32-61cf08bb87cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:15:56.087115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e44374-7386-4220-ba32-61cf08bb87cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:15:56.088725 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e44374-7386-4220-ba32-61cf08bb87cc service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:15:56.097997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 777/1524] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:15:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:15:56.934109 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01d2ce-6120-420f-a3f4-dfb7fd8b6f2f None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:15:56.934693 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01d2ce-6120-420f-a3f4-dfb7fd8b6f2f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:15:56.934693 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01d2ce-6120-420f-a3f4-dfb7fd8b6f2f None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:15:56.936073 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 748/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 19:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:15:56.940903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51411539-ab9a-4017-a02f-0c0939866769 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:15:56.941336 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51411539-ab9a-4017-a02f-0c0939866769 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:15:56.941492 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51411539-ab9a-4017-a02f-0c0939866769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:15:56.960658 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-51411539-ab9a-4017-a02f-0c0939866769 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:15:56.961878 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-51411539-ab9a-4017-a02f-0c0939866769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:15:56.970442 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 778/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 19:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:15:57.122112 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01d2ce-6120-420f-a3f4-dfb7fd8b6f2f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:15:57.136909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01d2ce-6120-420f-a3f4-dfb7fd8b6f2f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:15:57.142413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcf094-e742-4183-9202-0d7583862e00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:15:57.143007 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcf094-e742-4183-9202-0d7583862e00 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:15:57.143282 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcf094-e742-4183-9202-0d7583862e00 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:15:57.143560 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcf094-e742-4183-9202-0d7583862e00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:15:57.151545 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcf094-e742-4183-9202-0d7583862e00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:15:57.153119 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcf094-e742-4183-9202-0d7583862e00 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:15:57.162395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 749/1527] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:16:01.110162 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170160ef-113f-4e65-8bff-2818f2740672 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:16:01.110790 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170160ef-113f-4e65-8bff-2818f2740672 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:16:01.111073 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170160ef-113f-4e65-8bff-2818f2740672 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:16:01.112423 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 779/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 19:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:16:01.117681 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e902fe-97de-4e18-bb44-06660004f111 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:16:01.118113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e902fe-97de-4e18-bb44-06660004f111 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:16:01.118223 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e902fe-97de-4e18-bb44-06660004f111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:16:01.138949 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-22e902fe-97de-4e18-bb44-06660004f111 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:16:01.140133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-22e902fe-97de-4e18-bb44-06660004f111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:16:01.148162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 750/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 19:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:16:01.221375 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170160ef-113f-4e65-8bff-2818f2740672 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:16:01.223504 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-170160ef-113f-4e65-8bff-2818f2740672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:16:01.302952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170160ef-113f-4e65-8bff-2818f2740672 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:16:01.306529 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcef1c-f150-490f-8755-8cbf5b350075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:16:01.307687 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcef1c-f150-490f-8755-8cbf5b350075 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:16:01.307994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcef1c-f150-490f-8755-8cbf5b350075 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:16:01.308472 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcef1c-f150-490f-8755-8cbf5b350075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:16:01.317210 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fcef1c-f150-490f-8755-8cbf5b350075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:16:01.318741 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fcef1c-f150-490f-8755-8cbf5b350075 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:16:01.328629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 780/1530] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:16:03.327863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547795d8-b52c-429f-b1b6-8df8187fa4d3 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:16:03.328434 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547795d8-b52c-429f-b1b6-8df8187fa4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:16:03.328434 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547795d8-b52c-429f-b1b6-8df8187fa4d3 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:16:03.329801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 751/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 19:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:16:03.334988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b4e00-4996-4ce2-b9b4-ffc0a26cfe3f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:16:03.335405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b4e00-4996-4ce2-b9b4-ffc0a26cfe3f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:16:03.335516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b4e00-4996-4ce2-b9b4-ffc0a26cfe3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:16:03.356753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b65b4e00-4996-4ce2-b9b4-ffc0a26cfe3f None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:16:03.357976 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b65b4e00-4996-4ce2-b9b4-ffc0a26cfe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:16:03.365607 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 781/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 19:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:16:03.401378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547795d8-b52c-429f-b1b6-8df8187fa4d3 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:16:03.412113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547795d8-b52c-429f-b1b6-8df8187fa4d3 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:16:03.415628 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ecff72-666b-477b-91f1-65dd95e0ff54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:16:03.416308 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecff72-666b-477b-91f1-65dd95e0ff54 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:16:03.416572 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecff72-666b-477b-91f1-65dd95e0ff54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:16:03.416950 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ecff72-666b-477b-91f1-65dd95e0ff54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:16:03.425825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ecff72-666b-477b-91f1-65dd95e0ff54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:16:03.427244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ecff72-666b-477b-91f1-65dd95e0ff54 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:16:03.436520 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 752/1533] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:16:07.102599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eab974-301e-4348-8bfd-d60e3116bacf None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:16:07.103166 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eab974-301e-4348-8bfd-d60e3116bacf None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:16:07.103290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eab974-301e-4348-8bfd-d60e3116bacf None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:16:07.104888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 782/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 19:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:16:07.110148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee8b1c-17c6-4066-9419-b726edef0499 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:16:07.110600 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee8b1c-17c6-4066-9419-b726edef0499 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:16:07.110698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee8b1c-17c6-4066-9419-b726edef0499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:16:07.130268 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-d8ee8b1c-17c6-4066-9419-b726edef0499 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:16:07.131450 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d8ee8b1c-17c6-4066-9419-b726edef0499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:16:07.139818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 753/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 19:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:16:07.444815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eab974-301e-4348-8bfd-d60e3116bacf None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:16:07.446514 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-53eab974-301e-4348-8bfd-d60e3116bacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:16:07.514321 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:16:07.527541 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eab974-301e-4348-8bfd-d60e3116bacf None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:16:07.531138 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c989dd-b4b5-4ed0-a185-4c56d549c0cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:16:07.531741 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c989dd-b4b5-4ed0-a185-4c56d549c0cd service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:16:07.532024 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c989dd-b4b5-4ed0-a185-4c56d549c0cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:16:07.532294 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c989dd-b4b5-4ed0-a185-4c56d549c0cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:16:07.541692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c989dd-b4b5-4ed0-a185-4c56d549c0cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:16:07.543131 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c989dd-b4b5-4ed0-a185-4c56d549c0cd service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:16:07.552340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 783/1536] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:16:09.549988 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab6d2c-99f8-4988-90fa-2d033ef2aaf5 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:16:09.550491 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab6d2c-99f8-4988-90fa-2d033ef2aaf5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:16:09.550619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab6d2c-99f8-4988-90fa-2d033ef2aaf5 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:16:09.551963 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 754/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 19:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:16:09.557176 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b7dad-d936-4a60-93fa-da44ac186d6e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:16:09.557628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b7dad-d936-4a60-93fa-da44ac186d6e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:16:09.557741 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b7dad-d936-4a60-93fa-da44ac186d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:16:09.577197 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-eb1b7dad-d936-4a60-93fa-da44ac186d6e None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:16:09.578436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-eb1b7dad-d936-4a60-93fa-da44ac186d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:16:09.586183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 784/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 19:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:16:09.891261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab6d2c-99f8-4988-90fa-2d033ef2aaf5 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:16:09.892953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-45ab6d2c-99f8-4988-90fa-2d033ef2aaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:16:09.911782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab6d2c-99f8-4988-90fa-2d033ef2aaf5 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:16:09.915331 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5c0fe-0ab0-4cd8-b725-14d5420d733e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:16:09.916835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5c0fe-0ab0-4cd8-b725-14d5420d733e service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:16:09.917143 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5c0fe-0ab0-4cd8-b725-14d5420d733e service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:16:09.917418 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5c0fe-0ab0-4cd8-b725-14d5420d733e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:16:09.926426 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5c0fe-0ab0-4cd8-b725-14d5420d733e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:16:09.927884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5c0fe-0ab0-4cd8-b725-14d5420d733e service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:16:09.937903 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 755/1539] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:16:19.571932 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=11 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:16:19.933691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=33 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:42.144261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d54c80-7ab3-41b4-ae07-cefe87eda54c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:42.146033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d54c80-7ab3-41b4-ae07-cefe87eda54c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:42.146033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d54c80-7ab3-41b4-ae07-cefe87eda54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:42.171803 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-16d54c80-7ab3-41b4-ae07-cefe87eda54c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:42.173012 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-16d54c80-7ab3-41b4-ae07-cefe87eda54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:42.184682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 785/1540] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:42.193619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ac5ea-5ad9-4c26-8d36-519f4f090fd4 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:42.194649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ac5ea-5ad9-4c26-8d36-519f4f090fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:42.195148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ac5ea-5ad9-4c26-8d36-519f4f090fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:42.256509 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-322ac5ea-5ad9-4c26-8d36-519f4f090fd4 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:42.257801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-322ac5ea-5ad9-4c26-8d36-519f4f090fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:42.282924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 756/1541] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:42.288234 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d54c80-7ab3-41b4-ae07-cefe87eda54c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:42.310764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d54c80-7ab3-41b4-ae07-cefe87eda54c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:42.318792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003424f4-cc96-4f78-ae8c-f1f1743a9f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:42.322839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003424f4-cc96-4f78-ae8c-f1f1743a9f89 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:42.322839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003424f4-cc96-4f78-ae8c-f1f1743a9f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:42.322839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003424f4-cc96-4f78-ae8c-f1f1743a9f89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:42.322839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003424f4-cc96-4f78-ae8c-f1f1743a9f89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:17:42.322839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003424f4-cc96-4f78-ae8c-f1f1743a9f89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:42.323394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003424f4-cc96-4f78-ae8c-f1f1743a9f89 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:42.354157 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 786/1542] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:17:42.362277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ac5ea-5ad9-4c26-8d36-519f4f090fd4 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:42.388963 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ac5ea-5ad9-4c26-8d36-519f4f090fd4 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:42.420130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752c85f-fbbc-483b-96e2-b2ad9bcd4cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:42.420130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752c85f-fbbc-483b-96e2-b2ad9bcd4cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:42.420130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752c85f-fbbc-483b-96e2-b2ad9bcd4cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:42.420130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752c85f-fbbc-483b-96e2-b2ad9bcd4cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:42.420583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752c85f-fbbc-483b-96e2-b2ad9bcd4cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:42.420583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752c85f-fbbc-483b-96e2-b2ad9bcd4cf0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:42.531358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cc705-544d-4b5f-89de-9e101d33a724 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:42.531628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cc705-544d-4b5f-89de-9e101d33a724 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:42.531885 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cc705-544d-4b5f-89de-9e101d33a724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:42.568829 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 757/1543] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:17:42 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:42.570298 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da308b53-d330-491d-9193-f8d074922e9b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:42.575330 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da308b53-d330-491d-9193-f8d074922e9b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:42.575330 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da308b53-d330-491d-9193-f8d074922e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:42.575580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ad0cc705-544d-4b5f-89de-9e101d33a724 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:42.575930 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ad0cc705-544d-4b5f-89de-9e101d33a724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:42.604172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-da308b53-d330-491d-9193-f8d074922e9b None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:42.605615 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-da308b53-d330-491d-9193-f8d074922e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:42.700962 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 787/1544] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:42.701742 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cc705-544d-4b5f-89de-9e101d33a724 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:42.722025 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cc705-544d-4b5f-89de-9e101d33a724 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:42.736847 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce231201-3797-414e-835d-c7c2233c8ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:42.737488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce231201-3797-414e-835d-c7c2233c8ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:42.737778 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce231201-3797-414e-835d-c7c2233c8ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:42.738055 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce231201-3797-414e-835d-c7c2233c8ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:42.738696 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce231201-3797-414e-835d-c7c2233c8ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:42.744831 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce231201-3797-414e-835d-c7c2233c8ac4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:42.750122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 758/1545] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:42.751460 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b4a86-373a-41e3-b829-8de524978f93 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:42.751748 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b4a86-373a-41e3-b829-8de524978f93 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:42.752025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b4a86-373a-41e3-b829-8de524978f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:42.783173 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-aa2b4a86-373a-41e3-b829-8de524978f93 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:42.784375 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-aa2b4a86-373a-41e3-b829-8de524978f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:42.792973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 759/1546] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:42.798630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c441d92-ee1b-4480-bea4-c8b65ce68fcb None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:42.798630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c441d92-ee1b-4480-bea4-c8b65ce68fcb None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:42.798630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c441d92-ee1b-4480-bea4-c8b65ce68fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:42.816069 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1c441d92-ee1b-4480-bea4-c8b65ce68fcb None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:42.817326 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1c441d92-ee1b-4480-bea4-c8b65ce68fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:42.825497 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 760/1547] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:42.829367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827548f-a5e5-4553-8113-85e96e05d307 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:42.829367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827548f-a5e5-4553-8113-85e96e05d307 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:42.829367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827548f-a5e5-4553-8113-85e96e05d307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:42.846901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1827548f-a5e5-4553-8113-85e96e05d307 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:42.848094 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1827548f-a5e5-4553-8113-85e96e05d307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:42.855208 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 788/1548] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:17:42 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:42.858099 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d56e32-eac3-4543-9e34-8f7fc338cecb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:42.858099 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d56e32-eac3-4543-9e34-8f7fc338cecb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:42.858099 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d56e32-eac3-4543-9e34-8f7fc338cecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:42.862177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 761/1549] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:42.863466 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9693e-b68c-4bd6-a8f2-5fe282103168 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:42.863757 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9693e-b68c-4bd6-a8f2-5fe282103168 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:42.864088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9693e-b68c-4bd6-a8f2-5fe282103168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:42.878776 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-00d56e32-eac3-4543-9e34-8f7fc338cecb None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:42.881102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-00d56e32-eac3-4543-9e34-8f7fc338cecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:42.883131 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-65f9693e-b68c-4bd6-a8f2-5fe282103168 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:42.884295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-65f9693e-b68c-4bd6-a8f2-5fe282103168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:42.888296 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 789/1550] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:42.892281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 762/1551] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:42.893354 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264cca3-9044-43a4-a397-268f9de38698 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:42.893499 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342dec2-abef-4fbc-91e3-ebc323af96cf None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:42.893704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264cca3-9044-43a4-a397-268f9de38698 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:42.893818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342dec2-abef-4fbc-91e3-ebc323af96cf None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:42.893986 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264cca3-9044-43a4-a397-268f9de38698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:42.894098 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342dec2-abef-4fbc-91e3-ebc323af96cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:42.913642 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9264cca3-9044-43a4-a397-268f9de38698 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:42.913840 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f342dec2-abef-4fbc-91e3-ebc323af96cf None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:42.914836 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9264cca3-9044-43a4-a397-268f9de38698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:42.914968 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f342dec2-abef-4fbc-91e3-ebc323af96cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:42.922613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 790/1552] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:42.922750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 763/1553] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:42.929513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbf4a5-620e-4dd2-ad43-280f7bed7cef None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:42.929692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ee193-31a7-4971-b9fe-91d0132bc1de None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:42.929783 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbf4a5-620e-4dd2-ad43-280f7bed7cef None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:42.929878 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ee193-31a7-4971-b9fe-91d0132bc1de None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:42.929978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbf4a5-620e-4dd2-ad43-280f7bed7cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:42.930064 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ee193-31a7-4971-b9fe-91d0132bc1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:42.944306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f00ee193-31a7-4971-b9fe-91d0132bc1de None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:42.944532 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-aebbf4a5-620e-4dd2-ad43-280f7bed7cef None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:42.945523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f00ee193-31a7-4971-b9fe-91d0132bc1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:42.945739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-aebbf4a5-620e-4dd2-ad43-280f7bed7cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:42.953282 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 791/1554] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:42.954080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 764/1555] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:42.954190 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ee193-31a7-4971-b9fe-91d0132bc1de None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:42.954905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbf4a5-620e-4dd2-ad43-280f7bed7cef None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:42.967251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ee193-31a7-4971-b9fe-91d0132bc1de None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:42.968312 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbf4a5-620e-4dd2-ad43-280f7bed7cef None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:42.971943 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8f8e1-6017-47a7-8672-bae098377dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:42.972760 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8f8e1-6017-47a7-8672-bae098377dab admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:42.973113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8d1ca-15bd-4687-aafb-5299cb08346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:42.973285 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8f8e1-6017-47a7-8672-bae098377dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:42.974048 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8f8e1-6017-47a7-8672-bae098377dab admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:42.974413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8d1ca-15bd-4687-aafb-5299cb08346c admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:42.974675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8f8e1-6017-47a7-8672-bae098377dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:42.974856 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8d1ca-15bd-4687-aafb-5299cb08346c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:42.974955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8d1ca-15bd-4687-aafb-5299cb08346c admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:42.975570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8d1ca-15bd-4687-aafb-5299cb08346c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:17:42.976135 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8d1ca-15bd-4687-aafb-5299cb08346c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:42.976556 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8f8e1-6017-47a7-8672-bae098377dab admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:42.977139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: WARNING py.warnings [None req-bbd8d1ca-15bd-4687-aafb-5299cb08346c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:17:42.977139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: warnings.warn(msg) Aug 09 19:17:42.977139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: Aug 09 19:17:42.978048 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8d1ca-15bd-4687-aafb-5299cb08346c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:42.986468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 792/1556] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:42.987265 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8f8e1-6017-47a7-8672-bae098377dab admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:42.990623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 765/1557] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:17:42.991879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7383a1-2d46-4ca9-94ea-74b7872af97b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:42.992362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7383a1-2d46-4ca9-94ea-74b7872af97b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:42.992773 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7383a1-2d46-4ca9-94ea-74b7872af97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:42.997061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8f8e1-6017-47a7-8672-bae098377dab admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:43.001716 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10deb0f7-e3bc-44f7-8490-7f3fe0058ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:43.002307 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10deb0f7-e3bc-44f7-8490-7f3fe0058ebe admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:43.002586 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10deb0f7-e3bc-44f7-8490-7f3fe0058ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:43.002857 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10deb0f7-e3bc-44f7-8490-7f3fe0058ebe admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:43.003489 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10deb0f7-e3bc-44f7-8490-7f3fe0058ebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:17:43.003791 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10deb0f7-e3bc-44f7-8490-7f3fe0058ebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:43.005497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10deb0f7-e3bc-44f7-8490-7f3fe0058ebe admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:43.013604 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-cc7383a1-2d46-4ca9-94ea-74b7872af97b None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:43.014818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cc7383a1-2d46-4ca9-94ea-74b7872af97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:43.017154 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 793/1558] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:17:43.017979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10deb0f7-e3bc-44f7-8490-7f3fe0058ebe admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:43.027416 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 766/1559] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:43.028665 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810f925-f0c9-47be-8599-0eeb37a79b9c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:43.028955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810f925-f0c9-47be-8599-0eeb37a79b9c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:43.029252 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810f925-f0c9-47be-8599-0eeb37a79b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:43.031775 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10deb0f7-e3bc-44f7-8490-7f3fe0058ebe admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:43.036822 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe8160-957a-4ad9-baa6-86ec2932ad1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:43.037404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe8160-957a-4ad9-baa6-86ec2932ad1f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:43.038566 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe8160-957a-4ad9-baa6-86ec2932ad1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:43.038843 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe8160-957a-4ad9-baa6-86ec2932ad1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:43.039515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe8160-957a-4ad9-baa6-86ec2932ad1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:17:43.039820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe8160-957a-4ad9-baa6-86ec2932ad1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:43.041530 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe8160-957a-4ad9-baa6-86ec2932ad1f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:43.048188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-d810f925-f0c9-47be-8599-0eeb37a79b9c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:43.051313 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d810f925-f0c9-47be-8599-0eeb37a79b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:43.054962 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 794/1560] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:17:43.055937 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe8160-957a-4ad9-baa6-86ec2932ad1f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:43.061633 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 767/1561] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:43.061633 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22c7a4-ce31-4898-93c1-356dfe418ed7 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:43.061633 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22c7a4-ce31-4898-93c1-356dfe418ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:43.061633 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22c7a4-ce31-4898-93c1-356dfe418ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:43.068113 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe8160-957a-4ad9-baa6-86ec2932ad1f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:43.073108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5657c2-ed95-414c-8a87-2e0c2e542252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:43.073738 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5657c2-ed95-414c-8a87-2e0c2e542252 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:43.074055 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5657c2-ed95-414c-8a87-2e0c2e542252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:43.074686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5657c2-ed95-414c-8a87-2e0c2e542252 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:43.074993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5657c2-ed95-414c-8a87-2e0c2e542252 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:17:43.075276 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5657c2-ed95-414c-8a87-2e0c2e542252 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:43.076879 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5657c2-ed95-414c-8a87-2e0c2e542252 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:43.079951 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1a22c7a4-ce31-4898-93c1-356dfe418ed7 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:43.081393 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1a22c7a4-ce31-4898-93c1-356dfe418ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:43.089008 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 795/1562] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:17:43.089877 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 768/1563] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:43.090537 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22c7a4-ce31-4898-93c1-356dfe418ed7 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:43.093649 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5657c2-ed95-414c-8a87-2e0c2e542252 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:43.101115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22c7a4-ce31-4898-93c1-356dfe418ed7 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:43.104416 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5657c2-ed95-414c-8a87-2e0c2e542252 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:43.105797 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a9a03-d629-491e-a9d6-37765abef93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:43.106385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a9a03-d629-491e-a9d6-37765abef93a admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:43.106661 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a9a03-d629-491e-a9d6-37765abef93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:43.107064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a9a03-d629-491e-a9d6-37765abef93a admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:43.107675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a9a03-d629-491e-a9d6-37765abef93a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:43.109157 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca0d7a-eba7-40b8-abb9-401c5ae9d2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:43.109613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a9a03-d629-491e-a9d6-37765abef93a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:43.109780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca0d7a-eba7-40b8-abb9-401c5ae9d2ba admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:43.110062 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca0d7a-eba7-40b8-abb9-401c5ae9d2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:43.110337 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca0d7a-eba7-40b8-abb9-401c5ae9d2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:43.110972 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca0d7a-eba7-40b8-abb9-401c5ae9d2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:43.112648 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca0d7a-eba7-40b8-abb9-401c5ae9d2ba admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:43.122567 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 796/1564] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:43.123427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca0d7a-eba7-40b8-abb9-401c5ae9d2ba admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:43.134045 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca0d7a-eba7-40b8-abb9-401c5ae9d2ba admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:43.144513 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdeedf-c810-40db-a85e-2a241b38add3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:43.144513 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdeedf-c810-40db-a85e-2a241b38add3 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:43.144513 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdeedf-c810-40db-a85e-2a241b38add3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:43.144513 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdeedf-c810-40db-a85e-2a241b38add3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:43.146326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdeedf-c810-40db-a85e-2a241b38add3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:43.146326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-eccdeedf-c810-40db-a85e-2a241b38add3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:17:43.146326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: warnings.warn(msg) Aug 09 19:17:43.146326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: Aug 09 19:17:43.146326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdeedf-c810-40db-a85e-2a241b38add3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:43.228878 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 769/1565] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:17:43 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:43.229805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a9a03-d629-491e-a9d6-37765abef93a admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:43.259816 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:43.285847 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 797/1566] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:17:43 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:43.286877 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdeedf-c810-40db-a85e-2a241b38add3 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:43.290816 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a9a03-d629-491e-a9d6-37765abef93a admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:43.307585 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:43.347042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdeedf-c810-40db-a85e-2a241b38add3 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:43.347258 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08196dd-e8bd-4cf8-a551-08ef7d942909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:43.347807 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08196dd-e8bd-4cf8-a551-08ef7d942909 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:43.348081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08196dd-e8bd-4cf8-a551-08ef7d942909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:43.348401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08196dd-e8bd-4cf8-a551-08ef7d942909 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:43.349107 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08196dd-e8bd-4cf8-a551-08ef7d942909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:17:43.349408 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08196dd-e8bd-4cf8-a551-08ef7d942909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:43.351289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08196dd-e8bd-4cf8-a551-08ef7d942909 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:43.353306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823aab6-84a1-4909-a95a-cd030503bf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:43.353954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823aab6-84a1-4909-a95a-cd030503bf3c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:43.354236 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823aab6-84a1-4909-a95a-cd030503bf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:43.354509 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823aab6-84a1-4909-a95a-cd030503bf3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:43.355153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823aab6-84a1-4909-a95a-cd030503bf3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:17:43.355458 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823aab6-84a1-4909-a95a-cd030503bf3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:43.357054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823aab6-84a1-4909-a95a-cd030503bf3c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:43.362702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 770/1567] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:17:43.363489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08196dd-e8bd-4cf8-a551-08ef7d942909 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:43.375032 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 798/1568] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:17:43.375032 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823aab6-84a1-4909-a95a-cd030503bf3c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:43.380412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823aab6-84a1-4909-a95a-cd030503bf3c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:43.381041 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08196dd-e8bd-4cf8-a551-08ef7d942909 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:43.385168 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19405ea-89c8-4d14-8894-7f758699fe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:43.385787 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19405ea-89c8-4d14-8894-7f758699fe77 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:43.386117 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19405ea-89c8-4d14-8894-7f758699fe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:43.386383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19405ea-89c8-4d14-8894-7f758699fe77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:43.386627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02090f29-8bc7-4c7f-aea3-bd2a4940f285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:43.387020 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19405ea-89c8-4d14-8894-7f758699fe77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:17:43.387231 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02090f29-8bc7-4c7f-aea3-bd2a4940f285 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:43.387338 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19405ea-89c8-4d14-8894-7f758699fe77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:43.387511 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02090f29-8bc7-4c7f-aea3-bd2a4940f285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:43.387784 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02090f29-8bc7-4c7f-aea3-bd2a4940f285 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:43.388402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02090f29-8bc7-4c7f-aea3-bd2a4940f285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:43.388910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19405ea-89c8-4d14-8894-7f758699fe77 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:43.390360 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02090f29-8bc7-4c7f-aea3-bd2a4940f285 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:43.401476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 799/1569] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:17:43.402342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19405ea-89c8-4d14-8894-7f758699fe77 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:43.412472 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19405ea-89c8-4d14-8894-7f758699fe77 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:43.417166 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc9e0a-3298-4fe6-a065-bd1bfebaea25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:43.419480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc9e0a-3298-4fe6-a065-bd1bfebaea25 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:43.419480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc9e0a-3298-4fe6-a065-bd1bfebaea25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:43.419480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc9e0a-3298-4fe6-a065-bd1bfebaea25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:43.419480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc9e0a-3298-4fe6-a065-bd1bfebaea25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:43.420834 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc9e0a-3298-4fe6-a065-bd1bfebaea25 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:43.474805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 771/1570] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:17:43 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:43.476293 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02090f29-8bc7-4c7f-aea3-bd2a4940f285 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:43.537151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02090f29-8bc7-4c7f-aea3-bd2a4940f285 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:43.537666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 800/1571] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:17:43 2022] POST /identity/v3/projects => generated 391 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:43.538949 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc9e0a-3298-4fe6-a065-bd1bfebaea25 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:43.591718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:43.598551 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df184d7-8c88-4525-a7dd-c34ec4427339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:43.604828 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df184d7-8c88-4525-a7dd-c34ec4427339 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:43.604828 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df184d7-8c88-4525-a7dd-c34ec4427339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:43.604828 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df184d7-8c88-4525-a7dd-c34ec4427339 admin admin] PATH_INFO: `/v3/projects/2b4fb7ea1ff949678ecb538b7c84dd6d/users/8c91c4fcf6a8477a94c5760c9140bce9/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:43.605151 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc9e0a-3298-4fe6-a065-bd1bfebaea25 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:43.606536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8506c4-086c-4344-9d6f-c82d3e720a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:43.607136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8506c4-086c-4344-9d6f-c82d3e720a1d admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:43.607418 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8506c4-086c-4344-9d6f-c82d3e720a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:43.607691 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8506c4-086c-4344-9d6f-c82d3e720a1d admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:43.608317 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8506c4-086c-4344-9d6f-c82d3e720a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:43.610405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8506c4-086c-4344-9d6f-c82d3e720a1d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:43.614781 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df184d7-8c88-4525-a7dd-c34ec4427339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4fb7ea1ff949678ecb538b7c84dd6d, user_id=8c91c4fcf6a8477a94c5760c9140bce9, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:43.617467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df184d7-8c88-4525-a7dd-c34ec4427339 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:43.706289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 772/1572] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:17:43 2022] PUT /identity/v3/projects/2b4fb7ea1ff949678ecb538b7c84dd6d/users/8c91c4fcf6a8477a94c5760c9140bce9/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:43.707232 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df184d7-8c88-4525-a7dd-c34ec4427339 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:43.735733 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 801/1573] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:17:43 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:43.736561 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8506c4-086c-4344-9d6f-c82d3e720a1d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:43.748251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8506c4-086c-4344-9d6f-c82d3e720a1d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:43.772179 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df184d7-8c88-4525-a7dd-c34ec4427339 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:43.776809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b9aa0-9026-4998-b592-bf42dd485a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:43.777420 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b9aa0-9026-4998-b592-bf42dd485a77 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:43.777729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b9aa0-9026-4998-b592-bf42dd485a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:43.778002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b9aa0-9026-4998-b592-bf42dd485a77 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:43.778679 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b9aa0-9026-4998-b592-bf42dd485a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:43.779698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: WARNING py.warnings [None req-0a7b9aa0-9026-4998-b592-bf42dd485a77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:17:43.779698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: warnings.warn(msg) Aug 09 19:17:43.779698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: Aug 09 19:17:43.780980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b9aa0-9026-4998-b592-bf42dd485a77 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:43.806399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26614b18-ab0c-4dd1-b44b-20150dd3cf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:43.807010 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26614b18-ab0c-4dd1-b44b-20150dd3cf14 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:43.807289 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26614b18-ab0c-4dd1-b44b-20150dd3cf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:43.807562 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26614b18-ab0c-4dd1-b44b-20150dd3cf14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:43.808206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26614b18-ab0c-4dd1-b44b-20150dd3cf14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:43.810133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26614b18-ab0c-4dd1-b44b-20150dd3cf14 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:43.824992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:43.873104 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 773/1574] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:17:43 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:43.873750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b9aa0-9026-4998-b592-bf42dd485a77 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:43.883455 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b9aa0-9026-4998-b592-bf42dd485a77 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:43.888018 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfeff2b-01fa-483b-a4fb-f7d10265b26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:43.888585 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfeff2b-01fa-483b-a4fb-f7d10265b26c admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:43.888863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfeff2b-01fa-483b-a4fb-f7d10265b26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:43.889132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfeff2b-01fa-483b-a4fb-f7d10265b26c admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:43.889787 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfeff2b-01fa-483b-a4fb-f7d10265b26c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:43.891656 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfeff2b-01fa-483b-a4fb-f7d10265b26c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:43.906504 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 802/1575] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:17:43 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:43.906504 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26614b18-ab0c-4dd1-b44b-20150dd3cf14 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:43.963743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26614b18-ab0c-4dd1-b44b-20150dd3cf14 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:43.968336 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5136c-da3b-49d5-a5d1-73ad31d21a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:43.968928 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5136c-da3b-49d5-a5d1-73ad31d21a50 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:43.969206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5136c-da3b-49d5-a5d1-73ad31d21a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:43.969500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5136c-da3b-49d5-a5d1-73ad31d21a50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:43.970118 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5136c-da3b-49d5-a5d1-73ad31d21a50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:43.972003 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5136c-da3b-49d5-a5d1-73ad31d21a50 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.011241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 774/1576] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:17:43 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:44.012051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfeff2b-01fa-483b-a4fb-f7d10265b26c admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.073916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 803/1577] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:17:43 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:44.074096 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfeff2b-01fa-483b-a4fb-f7d10265b26c admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.078043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5136c-da3b-49d5-a5d1-73ad31d21a50 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.124669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:44.133532 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494b8c7-b6bb-40b1-ab80-11d4c91e2c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.134128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494b8c7-b6bb-40b1-ab80-11d4c91e2c03 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.134407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494b8c7-b6bb-40b1-ab80-11d4c91e2c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.134679 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494b8c7-b6bb-40b1-ab80-11d4c91e2c03 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.135355 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494b8c7-b6bb-40b1-ab80-11d4c91e2c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.137346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494b8c7-b6bb-40b1-ab80-11d4c91e2c03 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.142284 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5136c-da3b-49d5-a5d1-73ad31d21a50 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.147582 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c2c96-e560-428e-8ba5-eefc69d523c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.148218 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c2c96-e560-428e-8ba5-eefc69d523c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.148504 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c2c96-e560-428e-8ba5-eefc69d523c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.148778 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c2c96-e560-428e-8ba5-eefc69d523c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.149405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c2c96-e560-428e-8ba5-eefc69d523c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.151474 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c2c96-e560-428e-8ba5-eefc69d523c1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.249328 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 775/1578] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:17:44 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:44.251616 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cb37a-6cc8-4915-b8c9-56cf83a8d4fd None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.251880 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cb37a-6cc8-4915-b8c9-56cf83a8d4fd None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.252186 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cb37a-6cc8-4915-b8c9-56cf83a8d4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.261531 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 804/1579] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:17:44 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:44.265565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c2c96-e560-428e-8ba5-eefc69d523c1 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.272753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c2c96-e560-428e-8ba5-eefc69d523c1 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.277488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa6bf8-d6a9-41a7-a621-d8e62e97b937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.278092 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa6bf8-d6a9-41a7-a621-d8e62e97b937 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.278372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa6bf8-d6a9-41a7-a621-d8e62e97b937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.278645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa6bf8-d6a9-41a7-a621-d8e62e97b937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.279283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa6bf8-d6a9-41a7-a621-d8e62e97b937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.280878 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa6bf8-d6a9-41a7-a621-d8e62e97b937 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.282638 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-765cb37a-6cc8-4915-b8c9-56cf83a8d4fd None None] MFA Rules not processed for user `8c91c4fcf6a8477a94c5760c9140bce9`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:44.283852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-765cb37a-6cc8-4915-b8c9-56cf83a8d4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:44.292263 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 805/1580] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:44.293074 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa6bf8-d6a9-41a7-a621-d8e62e97b937 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.302794 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa6bf8-d6a9-41a7-a621-d8e62e97b937 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.307593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68593edf-07b0-4c28-b0ae-710b9192a359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.308191 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68593edf-07b0-4c28-b0ae-710b9192a359 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.308473 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68593edf-07b0-4c28-b0ae-710b9192a359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.308749 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68593edf-07b0-4c28-b0ae-710b9192a359 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.309376 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68593edf-07b0-4c28-b0ae-710b9192a359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.311028 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68593edf-07b0-4c28-b0ae-710b9192a359 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.321869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 806/1581] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:44.322653 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68593edf-07b0-4c28-b0ae-710b9192a359 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.333182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68593edf-07b0-4c28-b0ae-710b9192a359 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.337753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557b8f1-bbcd-4dee-a84f-028b4d5a5897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.338327 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557b8f1-bbcd-4dee-a84f-028b4d5a5897 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.338641 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557b8f1-bbcd-4dee-a84f-028b4d5a5897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.338916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557b8f1-bbcd-4dee-a84f-028b4d5a5897 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.339531 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557b8f1-bbcd-4dee-a84f-028b4d5a5897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.341438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557b8f1-bbcd-4dee-a84f-028b4d5a5897 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.353955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 776/1582] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:44.353955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cb37a-6cc8-4915-b8c9-56cf83a8d4fd None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.363438 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cb37a-6cc8-4915-b8c9-56cf83a8d4fd None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.368348 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577409a-9f9d-42a5-b244-81cf35755654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.368950 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577409a-9f9d-42a5-b244-81cf35755654 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.369235 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577409a-9f9d-42a5-b244-81cf35755654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.369549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577409a-9f9d-42a5-b244-81cf35755654 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.370179 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577409a-9f9d-42a5-b244-81cf35755654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.372202 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577409a-9f9d-42a5-b244-81cf35755654 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.456370 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 807/1583] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:17:44 2022] POST /identity/v3/users => generated 294 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:44.457183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557b8f1-bbcd-4dee-a84f-028b4d5a5897 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.467233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557b8f1-bbcd-4dee-a84f-028b4d5a5897 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.471792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13623461-9d36-4a76-98d9-1c4bb5736c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.481990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13623461-9d36-4a76-98d9-1c4bb5736c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.481990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13623461-9d36-4a76-98d9-1c4bb5736c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.481990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13623461-9d36-4a76-98d9-1c4bb5736c0a admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.481990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13623461-9d36-4a76-98d9-1c4bb5736c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.481990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13623461-9d36-4a76-98d9-1c4bb5736c0a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.507610 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 777/1584] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:17:44 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:44.510417 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577409a-9f9d-42a5-b244-81cf35755654 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.519564 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577409a-9f9d-42a5-b244-81cf35755654 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.525206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa96d2-5063-4ab1-affb-ea73a6c7e4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.525846 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa96d2-5063-4ab1-affb-ea73a6c7e4dd admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.526129 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa96d2-5063-4ab1-affb-ea73a6c7e4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.526403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa96d2-5063-4ab1-affb-ea73a6c7e4dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.527047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa96d2-5063-4ab1-affb-ea73a6c7e4dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.528776 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa96d2-5063-4ab1-affb-ea73a6c7e4dd admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.540236 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 778/1585] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:44.541036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa96d2-5063-4ab1-affb-ea73a6c7e4dd admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.550412 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa96d2-5063-4ab1-affb-ea73a6c7e4dd admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.555314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13a652-0309-4165-a711-eec2cbbb7058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.555878 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13a652-0309-4165-a711-eec2cbbb7058 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.556160 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13a652-0309-4165-a711-eec2cbbb7058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.556630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13a652-0309-4165-a711-eec2cbbb7058 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.557104 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13a652-0309-4165-a711-eec2cbbb7058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.558713 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13a652-0309-4165-a711-eec2cbbb7058 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.564855 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 808/1586] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:17:44 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:44.570279 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13623461-9d36-4a76-98d9-1c4bb5736c0a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.570408 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 779/1587] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:44.573097 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13a652-0309-4165-a711-eec2cbbb7058 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.576451 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13623461-9d36-4a76-98d9-1c4bb5736c0a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.581180 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114da0e-1ac0-4e81-9d37-b94d2a6be21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.581807 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114da0e-1ac0-4e81-9d37-b94d2a6be21f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.582085 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114da0e-1ac0-4e81-9d37-b94d2a6be21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.582353 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114da0e-1ac0-4e81-9d37-b94d2a6be21f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.583685 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114da0e-1ac0-4e81-9d37-b94d2a6be21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.583811 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13a652-0309-4165-a711-eec2cbbb7058 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.585339 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114da0e-1ac0-4e81-9d37-b94d2a6be21f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.588596 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daf1c3-e5d7-48c5-8824-2bedd4a59dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.589194 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daf1c3-e5d7-48c5-8824-2bedd4a59dae admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.589495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daf1c3-e5d7-48c5-8824-2bedd4a59dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.589774 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daf1c3-e5d7-48c5-8824-2bedd4a59dae admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.590412 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71daf1c3-e5d7-48c5-8824-2bedd4a59dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.590912 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:INSERT=11,keystone:SELECT=89 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:44.592025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71daf1c3-e5d7-48c5-8824-2bedd4a59dae admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.596332 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 809/1588] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:44.597650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114da0e-1ac0-4e81-9d37-b94d2a6be21f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.602723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 780/1589] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:44.603540 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daf1c3-e5d7-48c5-8824-2bedd4a59dae admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.610528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114da0e-1ac0-4e81-9d37-b94d2a6be21f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.613983 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daf1c3-e5d7-48c5-8824-2bedd4a59dae admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.615423 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907f829-6ed2-407c-aca0-384372fe60ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.616011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907f829-6ed2-407c-aca0-384372fe60ad admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.616286 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907f829-6ed2-407c-aca0-384372fe60ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.616556 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907f829-6ed2-407c-aca0-384372fe60ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.617222 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907f829-6ed2-407c-aca0-384372fe60ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.618130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b3a3e-ef04-4b0b-ac9c-aadfe25f79b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.618712 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b3a3e-ef04-4b0b-ac9c-aadfe25f79b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.619007 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b3a3e-ef04-4b0b-ac9c-aadfe25f79b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.619187 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1907f829-6ed2-407c-aca0-384372fe60ad admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.619288 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b3a3e-ef04-4b0b-ac9c-aadfe25f79b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.619939 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b3a3e-ef04-4b0b-ac9c-aadfe25f79b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.621580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b3a3e-ef04-4b0b-ac9c-aadfe25f79b9 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.632746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 781/1590] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:44.633758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b3a3e-ef04-4b0b-ac9c-aadfe25f79b9 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.643583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b3a3e-ef04-4b0b-ac9c-aadfe25f79b9 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.648550 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf642719-d31d-4626-9eaa-13013fee2b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.649119 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf642719-d31d-4626-9eaa-13013fee2b01 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.649396 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf642719-d31d-4626-9eaa-13013fee2b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.649727 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf642719-d31d-4626-9eaa-13013fee2b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.650346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf642719-d31d-4626-9eaa-13013fee2b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.651919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf642719-d31d-4626-9eaa-13013fee2b01 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.662138 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 782/1591] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:44.665620 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf642719-d31d-4626-9eaa-13013fee2b01 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.672559 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf642719-d31d-4626-9eaa-13013fee2b01 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.677773 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168bc61-ad3d-4748-b7b1-ca4ba510edd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.678327 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168bc61-ad3d-4748-b7b1-ca4ba510edd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.678605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168bc61-ad3d-4748-b7b1-ca4ba510edd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.678875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168bc61-ad3d-4748-b7b1-ca4ba510edd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.679487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168bc61-ad3d-4748-b7b1-ca4ba510edd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.681037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168bc61-ad3d-4748-b7b1-ca4ba510edd6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.690564 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 783/1592] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:44.691387 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168bc61-ad3d-4748-b7b1-ca4ba510edd6 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.700849 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168bc61-ad3d-4748-b7b1-ca4ba510edd6 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.705584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f5a93-9225-4572-a62f-016320849375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.706179 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f5a93-9225-4572-a62f-016320849375 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.706462 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f5a93-9225-4572-a62f-016320849375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.706738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f5a93-9225-4572-a62f-016320849375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.707354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f5a93-9225-4572-a62f-016320849375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.709176 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f5a93-9225-4572-a62f-016320849375 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.719375 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 784/1593] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:44.720158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f5a93-9225-4572-a62f-016320849375 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.724691 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 810/1594] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:17:44 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:44.729629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907f829-6ed2-407c-aca0-384372fe60ad admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.731408 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f5a93-9225-4572-a62f-016320849375 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.765549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:44.788847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaaaf08-865c-45fe-9bf4-6c9f2ec11863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.789446 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaaaf08-865c-45fe-9bf4-6c9f2ec11863 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.789745 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaaaf08-865c-45fe-9bf4-6c9f2ec11863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.790015 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaaaf08-865c-45fe-9bf4-6c9f2ec11863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.790640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaaaf08-865c-45fe-9bf4-6c9f2ec11863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.790743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907f829-6ed2-407c-aca0-384372fe60ad admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.792240 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaaaf08-865c-45fe-9bf4-6c9f2ec11863 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.795455 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0b4da-0da8-4962-96dd-66f0917bde45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.796107 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0b4da-0da8-4962-96dd-66f0917bde45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.796385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0b4da-0da8-4962-96dd-66f0917bde45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.796653 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0b4da-0da8-4962-96dd-66f0917bde45 admin admin] PATH_INFO: `/v3/projects/9cae34ac16df4323910d01d3094b1169/users/29ca644f7ec444f49ed59970b2337cb3/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.804047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 785/1595] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:44.806480 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaaaf08-865c-45fe-9bf4-6c9f2ec11863 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.812636 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0b4da-0da8-4962-96dd-66f0917bde45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cae34ac16df4323910d01d3094b1169, user_id=29ca644f7ec444f49ed59970b2337cb3, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.813909 dv-cinder-852654-1-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-ecc0b4da-0da8-4962-96dd-66f0917bde45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:17:44.813909 dv-cinder-852654-1-smb devstack@keystone.service[80524]: warnings.warn(msg) Aug 09 19:17:44.813909 dv-cinder-852654-1-smb devstack@keystone.service[80524]: Aug 09 19:17:44.814725 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaaaf08-865c-45fe-9bf4-6c9f2ec11863 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.816158 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0b4da-0da8-4962-96dd-66f0917bde45 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.819504 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8571f1a-ed25-4720-8969-350203161b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.820181 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8571f1a-ed25-4720-8969-350203161b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.820415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8571f1a-ed25-4720-8969-350203161b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.820684 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8571f1a-ed25-4720-8969-350203161b51 admin admin] PATH_INFO: `/v3/projects/1e0ed081fca4438f9fc2f9c1164ae93c/users/217925e91ea74413b2cb2052bbb523fa/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.835323 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8571f1a-ed25-4720-8969-350203161b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0ed081fca4438f9fc2f9c1164ae93c, user_id=217925e91ea74413b2cb2052bbb523fa, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.837950 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8571f1a-ed25-4720-8969-350203161b51 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.876888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 811/1596] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:17:44 2022] PUT /identity/v3/projects/9cae34ac16df4323910d01d3094b1169/users/29ca644f7ec444f49ed59970b2337cb3/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:44.878231 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0b4da-0da8-4962-96dd-66f0917bde45 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.900202 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 786/1597] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:17:44 2022] PUT /identity/v3/projects/1e0ed081fca4438f9fc2f9c1164ae93c/users/217925e91ea74413b2cb2052bbb523fa/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:44.901252 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8571f1a-ed25-4720-8969-350203161b51 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.942238 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0b4da-0da8-4962-96dd-66f0917bde45 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.964882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8571f1a-ed25-4720-8969-350203161b51 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.969528 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c7d86-2557-4412-b152-213dd9594236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:44.970142 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c7d86-2557-4412-b152-213dd9594236 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:44.970418 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c7d86-2557-4412-b152-213dd9594236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:44.970691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c7d86-2557-4412-b152-213dd9594236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:44.971332 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c7d86-2557-4412-b152-213dd9594236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:44.972932 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c7d86-2557-4412-b152-213dd9594236 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:44.983738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 787/1598] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:44.984524 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c7d86-2557-4412-b152-213dd9594236 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:44.996591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c7d86-2557-4412-b152-213dd9594236 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:44.999524 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdf292-608c-4d6a-b6e0-0bdf4a26513b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:45.000132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdf292-608c-4d6a-b6e0-0bdf4a26513b admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.000411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdf292-608c-4d6a-b6e0-0bdf4a26513b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.000686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdf292-608c-4d6a-b6e0-0bdf4a26513b admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.001276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d1695-a130-4d1c-ac30-77933b0b0f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:45.001422 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdf292-608c-4d6a-b6e0-0bdf4a26513b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:45.001950 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d1695-a130-4d1c-ac30-77933b0b0f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.002235 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d1695-a130-4d1c-ac30-77933b0b0f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.002513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d1695-a130-4d1c-ac30-77933b0b0f3b admin admin] PATH_INFO: `/v3/projects/dee867efbca142908e7c8ad5d0e0f04b/users/91e509cdd69843fe8efc7fbc64ede013/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.002936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdf292-608c-4d6a-b6e0-0bdf4a26513b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:45.012651 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 812/1599] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:45.013472 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdf292-608c-4d6a-b6e0-0bdf4a26513b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:45.017683 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d1695-a130-4d1c-ac30-77933b0b0f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dee867efbca142908e7c8ad5d0e0f04b, user_id=91e509cdd69843fe8efc7fbc64ede013, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:45.019301 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:45.020929 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421d1695-a130-4d1c-ac30-77933b0b0f3b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:45.024600 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdf292-608c-4d6a-b6e0-0bdf4a26513b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:45.029304 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59e55e-ac4f-474b-ad0a-ebb9a6995576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:45.029935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59e55e-ac4f-474b-ad0a-ebb9a6995576 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.030215 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59e55e-ac4f-474b-ad0a-ebb9a6995576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.030488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59e55e-ac4f-474b-ad0a-ebb9a6995576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.031149 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59e55e-ac4f-474b-ad0a-ebb9a6995576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:45.032780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59e55e-ac4f-474b-ad0a-ebb9a6995576 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:45.042513 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 813/1600] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:45.043272 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59e55e-ac4f-474b-ad0a-ebb9a6995576 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:45.053192 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59e55e-ac4f-474b-ad0a-ebb9a6995576 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:45.057779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59a7a5-3135-467e-a426-4e2011de9080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:45.063754 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59a7a5-3135-467e-a426-4e2011de9080 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.063754 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59a7a5-3135-467e-a426-4e2011de9080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.063754 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59a7a5-3135-467e-a426-4e2011de9080 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.063754 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59a7a5-3135-467e-a426-4e2011de9080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:45.063754 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e59a7a5-3135-467e-a426-4e2011de9080 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:45.088548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 788/1601] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:17:44 2022] PUT /identity/v3/projects/dee867efbca142908e7c8ad5d0e0f04b/users/91e509cdd69843fe8efc7fbc64ede013/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:45.089484 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d1695-a130-4d1c-ac30-77933b0b0f3b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:45.150347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421d1695-a130-4d1c-ac30-77933b0b0f3b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:45.154921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b8325-b02c-48c4-be1d-32c6dbd4e99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:45.155629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b8325-b02c-48c4-be1d-32c6dbd4e99c admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.155906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b8325-b02c-48c4-be1d-32c6dbd4e99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.156176 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b8325-b02c-48c4-be1d-32c6dbd4e99c admin admin] PATH_INFO: `/v3/projects/54848519ff4c47f693fffde3e80f33b1/users/d5f9fe48bb8f44f997e36e0e320bfc5f/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.163871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 814/1602] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:17:45 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:45.165114 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5a66a-30b6-4833-a40e-18f7f720e8aa None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.165425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5a66a-30b6-4833-a40e-18f7f720e8aa None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.165684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5a66a-30b6-4833-a40e-18f7f720e8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.172627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b8325-b02c-48c4-be1d-32c6dbd4e99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=54848519ff4c47f693fffde3e80f33b1, user_id=d5f9fe48bb8f44f997e36e0e320bfc5f, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:45.175319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b8325-b02c-48c4-be1d-32c6dbd4e99c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:45.195371 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-29b5a66a-30b6-4833-a40e-18f7f720e8aa None None] MFA Rules not processed for user `29ca644f7ec444f49ed59970b2337cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:45.196688 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-29b5a66a-30b6-4833-a40e-18f7f720e8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:45.256116 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 789/1603] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:17:45 2022] PUT /identity/v3/projects/54848519ff4c47f693fffde3e80f33b1/users/d5f9fe48bb8f44f997e36e0e320bfc5f/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:45.257374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08b025-1077-4423-97d5-8dafe8513bf8 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.257814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08b025-1077-4423-97d5-8dafe8513bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.257976 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08b025-1077-4423-97d5-8dafe8513bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.261081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 815/1604] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:45.261915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5a66a-30b6-4833-a40e-18f7f720e8aa None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:45.266054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:45.276204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5a66a-30b6-4833-a40e-18f7f720e8aa None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:45.277394 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-0d08b025-1077-4423-97d5-8dafe8513bf8 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:45.278622 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0d08b025-1077-4423-97d5-8dafe8513bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:45.336595 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e214ff-b81e-435f-bae9-f5403e058bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:45.337265 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e214ff-b81e-435f-bae9-f5403e058bec admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.337575 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e214ff-b81e-435f-bae9-f5403e058bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.337849 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e214ff-b81e-435f-bae9-f5403e058bec admin admin] PATH_INFO: `/v3/projects/778981bde4274a32b38c9dbfe96f8677/users/e04dc79ee0b4413e9532fb1aa0b9bfb9/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.350828 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 790/1605] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:45.350828 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08b025-1077-4423-97d5-8dafe8513bf8 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:45.353894 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e214ff-b81e-435f-bae9-f5403e058bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=778981bde4274a32b38c9dbfe96f8677, user_id=e04dc79ee0b4413e9532fb1aa0b9bfb9, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:45.356783 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e214ff-b81e-435f-bae9-f5403e058bec admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:45.365898 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08b025-1077-4423-97d5-8dafe8513bf8 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:45.370529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffc7c1-3f79-4457-a226-bece08479d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:45.373562 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffc7c1-3f79-4457-a226-bece08479d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.373562 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffc7c1-3f79-4457-a226-bece08479d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.373562 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffc7c1-3f79-4457-a226-bece08479d9d admin admin] PATH_INFO: `/v3/projects/1413436acbb4483d95cab0406a3baae7/users/57a4a9f362d948ebaac0cae4a51dbf1d/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.385897 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffc7c1-3f79-4457-a226-bece08479d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1413436acbb4483d95cab0406a3baae7, user_id=57a4a9f362d948ebaac0cae4a51dbf1d, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:45.388562 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffc7c1-3f79-4457-a226-bece08479d9d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:45.456231 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 816/1606] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:17:45 2022] PUT /identity/v3/projects/778981bde4274a32b38c9dbfe96f8677/users/e04dc79ee0b4413e9532fb1aa0b9bfb9/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:45.457166 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e214ff-b81e-435f-bae9-f5403e058bec admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:45.484957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 791/1607] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:17:45 2022] PUT /identity/v3/projects/1413436acbb4483d95cab0406a3baae7/users/57a4a9f362d948ebaac0cae4a51dbf1d/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:45.488270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275ff8a-9559-40df-b7a0-5cf820c2b4e7 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.488270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275ff8a-9559-40df-b7a0-5cf820c2b4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.488270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275ff8a-9559-40df-b7a0-5cf820c2b4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.512131 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:45.516484 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a275ff8a-9559-40df-b7a0-5cf820c2b4e7 None None] MFA Rules not processed for user `91e509cdd69843fe8efc7fbc64ede013`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:45.517854 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a275ff8a-9559-40df-b7a0-5cf820c2b4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:45.526948 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e214ff-b81e-435f-bae9-f5403e058bec admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:45.587600 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 792/1608] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:45.588458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275ff8a-9559-40df-b7a0-5cf820c2b4e7 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:45.592815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49ab0d-ec55-4e0c-9482-f002c8c6270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:45.593610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49ab0d-ec55-4e0c-9482-f002c8c6270a admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.593962 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49ab0d-ec55-4e0c-9482-f002c8c6270a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.594306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49ab0d-ec55-4e0c-9482-f002c8c6270a admin admin] PATH_INFO: `/v3/projects/6da993fa80884dc990ca1a1cf9c7906e/users/c4ccff24eb2b43dcafecdef4956d628c/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.602925 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275ff8a-9559-40df-b7a0-5cf820c2b4e7 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:45.609686 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe342102-ad6f-43f8-a754-760cf3ce45f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:45.614850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe342102-ad6f-43f8-a754-760cf3ce45f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.614850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe342102-ad6f-43f8-a754-760cf3ce45f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.614850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe342102-ad6f-43f8-a754-760cf3ce45f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.615177 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49ab0d-ec55-4e0c-9482-f002c8c6270a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da993fa80884dc990ca1a1cf9c7906e, user_id=c4ccff24eb2b43dcafecdef4956d628c, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:45.615340 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe342102-ad6f-43f8-a754-760cf3ce45f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:45.615340 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe342102-ad6f-43f8-a754-760cf3ce45f2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:45.615549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49ab0d-ec55-4e0c-9482-f002c8c6270a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:45.628297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 793/1609] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:45.628297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955ec9e-7520-45be-9116-922ec6557cc1 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.628297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955ec9e-7520-45be-9116-922ec6557cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.628297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955ec9e-7520-45be-9116-922ec6557cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.652823 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-0955ec9e-7520-45be-9116-922ec6557cc1 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:45.654123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0955ec9e-7520-45be-9116-922ec6557cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:45.662212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 794/1610] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:45.663374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbafea-2fd6-4f9d-8b18-83f012bb2997 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.663657 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbafea-2fd6-4f9d-8b18-83f012bb2997 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.663926 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbafea-2fd6-4f9d-8b18-83f012bb2997 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.665297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 795/1611] 10.222.0.65 () {54 vars in 962 bytes} [Tue Aug 9 19:17:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:17:45.665872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbafea-2fd6-4f9d-8b18-83f012bb2997 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:45.667409 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6bbbafea-2fd6-4f9d-8b18-83f012bb2997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:45.705001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 817/1612] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:17:45 2022] PUT /identity/v3/projects/6da993fa80884dc990ca1a1cf9c7906e/users/c4ccff24eb2b43dcafecdef4956d628c/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:45.706316 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f267e19-a49b-4986-bd6c-652de53979a8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.706600 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f267e19-a49b-4986-bd6c-652de53979a8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.706988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f267e19-a49b-4986-bd6c-652de53979a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.727057 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbafea-2fd6-4f9d-8b18-83f012bb2997 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:45.732630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:45.743196 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7f267e19-a49b-4986-bd6c-652de53979a8 None None] MFA Rules not processed for user `e04dc79ee0b4413e9532fb1aa0b9bfb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:45.744559 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7f267e19-a49b-4986-bd6c-652de53979a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:45.779735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed26d31-aff5-4136-ac99-f934edd56716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:45.780418 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed26d31-aff5-4136-ac99-f934edd56716 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.780777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed26d31-aff5-4136-ac99-f934edd56716 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.781044 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed26d31-aff5-4136-ac99-f934edd56716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.809935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 818/1613] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:45.811312 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c864bc-4c2b-4606-889a-036a7c161141 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.811597 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c864bc-4c2b-4606-889a-036a7c161141 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.811878 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c864bc-4c2b-4606-889a-036a7c161141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.830285 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-17c864bc-4c2b-4606-889a-036a7c161141 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:45.831503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-17c864bc-4c2b-4606-889a-036a7c161141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:45.842203 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed26d31-aff5-4136-ac99-f934edd56716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:45.846460 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed26d31-aff5-4136-ac99-f934edd56716 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:45.854501 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 796/1614] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:17:45.855810 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f90791-52be-437d-8b43-befae4c49c01 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.856265 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f90791-52be-437d-8b43-befae4c49c01 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.856619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f90791-52be-437d-8b43-befae4c49c01 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.858245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 797/1615] 10.222.0.65 () {54 vars in 962 bytes} [Tue Aug 9 19:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:17:45.859104 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f90791-52be-437d-8b43-befae4c49c01 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:45.873372 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f90791-52be-437d-8b43-befae4c49c01 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:45.878265 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fdebe-86c5-4b05-968a-59cb2c21615b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:45.878922 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fdebe-86c5-4b05-968a-59cb2c21615b admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.879200 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fdebe-86c5-4b05-968a-59cb2c21615b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.879521 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fdebe-86c5-4b05-968a-59cb2c21615b admin admin] PATH_INFO: `/v3/projects/e37f9cb00b2e4b3490b4353f601312b1/users/a6a787b1c4cf418d83d8a923b011d6ae/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.894946 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36fdebe-86c5-4b05-968a-59cb2c21615b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37f9cb00b2e4b3490b4353f601312b1, user_id=a6a787b1c4cf418d83d8a923b011d6ae, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:45.895653 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 819/1616] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:45.897050 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3345b-e080-4a67-99b8-2514456de756 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:45.897337 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3345b-e080-4a67-99b8-2514456de756 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:45.897645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3345b-e080-4a67-99b8-2514456de756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:45.898658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36fdebe-86c5-4b05-968a-59cb2c21615b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:45.916803 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:45.938390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-08c3345b-e080-4a67-99b8-2514456de756 None None] MFA Rules not processed for user `2cfda1bec35145f3bbcc13fae0b7af2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:45.943922 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-08c3345b-e080-4a67-99b8-2514456de756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:45.971744 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 798/1617] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:17:45 2022] PUT /identity/v3/projects/e37f9cb00b2e4b3490b4353f601312b1/users/a6a787b1c4cf418d83d8a923b011d6ae/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:45.972645 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fdebe-86c5-4b05-968a-59cb2c21615b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:46.014550 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 820/1618] 10.222.0.65 () {58 vars in 1059 bytes} [Tue Aug 9 19:17:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:46.016007 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacf66a-94af-4ef8-9e92-3702ad6e7436 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:46.016428 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacf66a-94af-4ef8-9e92-3702ad6e7436 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:46.016822 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacf66a-94af-4ef8-9e92-3702ad6e7436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:46.035797 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fdebe-86c5-4b05-968a-59cb2c21615b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:46.039912 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237de3e-951b-4e49-8a37-5c19b28318c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:46.040526 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237de3e-951b-4e49-8a37-5c19b28318c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:46.040833 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237de3e-951b-4e49-8a37-5c19b28318c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:46.041131 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237de3e-951b-4e49-8a37-5c19b28318c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:46.045958 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4cacf66a-94af-4ef8-9e92-3702ad6e7436 None None] MFA Rules not processed for user `c4ccff24eb2b43dcafecdef4956d628c`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:46.049633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4cacf66a-94af-4ef8-9e92-3702ad6e7436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:46.104021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237de3e-951b-4e49-8a37-5c19b28318c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:46.105726 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237de3e-951b-4e49-8a37-5c19b28318c1 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:46.116015 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 799/1619] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:17:46.117273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c577b-303d-454a-b0a7-3bc33b8ea686 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:46.117590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c577b-303d-454a-b0a7-3bc33b8ea686 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:46.117861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c577b-303d-454a-b0a7-3bc33b8ea686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:46.122020 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 821/1620] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:46.122020 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacf66a-94af-4ef8-9e92-3702ad6e7436 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:46.134475 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacf66a-94af-4ef8-9e92-3702ad6e7436 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:46.136977 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-484c577b-303d-454a-b0a7-3bc33b8ea686 None None] MFA Rules not processed for user `2cfda1bec35145f3bbcc13fae0b7af2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:46.138222 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-484c577b-303d-454a-b0a7-3bc33b8ea686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:46.139108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1a9b2-03a6-4e0e-b9b3-4d0e764adee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:46.140087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1a9b2-03a6-4e0e-b9b3-4d0e764adee6 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:46.140565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1a9b2-03a6-4e0e-b9b3-4d0e764adee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:46.141035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1a9b2-03a6-4e0e-b9b3-4d0e764adee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:46.150036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:46.153381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1a9b2-03a6-4e0e-b9b3-4d0e764adee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:46.155376 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1a9b2-03a6-4e0e-b9b3-4d0e764adee6 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:46.167983 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 822/1621] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:17:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:17:46.169152 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1a9b2-03a6-4e0e-b9b3-4d0e764adee6 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:46.180479 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1a9b2-03a6-4e0e-b9b3-4d0e764adee6 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:46.186257 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12224d34-0965-437c-9c75-ce9754b92316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:46.186938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12224d34-0965-437c-9c75-ce9754b92316 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:46.187284 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12224d34-0965-437c-9c75-ce9754b92316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:46.187617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12224d34-0965-437c-9c75-ce9754b92316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:46.188393 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12224d34-0965-437c-9c75-ce9754b92316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:46.190143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12224d34-0965-437c-9c75-ce9754b92316 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:46.201962 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 823/1622] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:46.202823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12224d34-0965-437c-9c75-ce9754b92316 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:46.230826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 800/1623] 10.222.0.65 () {58 vars in 1059 bytes} [Tue Aug 9 19:17:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:46.231872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c577b-303d-454a-b0a7-3bc33b8ea686 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:46.243916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c577b-303d-454a-b0a7-3bc33b8ea686 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:46.250676 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b439b-d236-486d-8f7a-844c64c4d43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:46.251394 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b439b-d236-486d-8f7a-844c64c4d43d admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:46.251580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b439b-d236-486d-8f7a-844c64c4d43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:46.251877 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b439b-d236-486d-8f7a-844c64c4d43d admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:46.252523 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b439b-d236-486d-8f7a-844c64c4d43d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:46.254519 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b439b-d236-486d-8f7a-844c64c4d43d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:46.288686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12224d34-0965-437c-9c75-ce9754b92316 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:46.290789 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:46.296440 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f58c1-4d38-4a9d-946c-2b17ec7293de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:46.297048 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f58c1-4d38-4a9d-946c-2b17ec7293de service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:46.297324 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f58c1-4d38-4a9d-946c-2b17ec7293de service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:46.297656 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f58c1-4d38-4a9d-946c-2b17ec7293de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:46.357946 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f58c1-4d38-4a9d-946c-2b17ec7293de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:46.359476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f58c1-4d38-4a9d-946c-2b17ec7293de service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:46.375141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 801/1624] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:17:46 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:46.376035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b439b-d236-486d-8f7a-844c64c4d43d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:46.378538 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 824/1625] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:17:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:17:46.379948 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f58c1-4d38-4a9d-946c-2b17ec7293de service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:46.390903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f58c1-4d38-4a9d-946c-2b17ec7293de service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:46.535949 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d1305-a6e9-4ded-ae0d-10a8d85d155e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:46.540119 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d1305-a6e9-4ded-ae0d-10a8d85d155e service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:46.540511 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d1305-a6e9-4ded-ae0d-10a8d85d155e service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:46.540895 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d1305-a6e9-4ded-ae0d-10a8d85d155e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:46.565147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b439b-d236-486d-8f7a-844c64c4d43d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:46.572017 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b1f78-b490-4ea7-889b-7108e570c8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:46.572698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b1f78-b490-4ea7-889b-7108e570c8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:46.572977 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b1f78-b490-4ea7-889b-7108e570c8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:46.573249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b1f78-b490-4ea7-889b-7108e570c8f5 admin admin] PATH_INFO: `/v3/projects/e37f9cb00b2e4b3490b4353f601312b1/users/a6a787b1c4cf418d83d8a923b011d6ae/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:46.575226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b1f78-b490-4ea7-889b-7108e570c8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37f9cb00b2e4b3490b4353f601312b1, user_id=a6a787b1c4cf418d83d8a923b011d6ae, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:46.578099 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b1f78-b490-4ea7-889b-7108e570c8f5 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:46.594469 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 802/1626] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:17:46 2022] PUT /identity/v3/projects/e37f9cb00b2e4b3490b4353f601312b1/users/a6a787b1c4cf418d83d8a923b011d6ae/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:46.601575 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b1f78-b490-4ea7-889b-7108e570c8f5 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:46.629821 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d1305-a6e9-4ded-ae0d-10a8d85d155e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:46.632653 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d1305-a6e9-4ded-ae0d-10a8d85d155e service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:46.644704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 825/1627] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:17:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:17:46.647623 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848549d-0f7a-4424-9c8e-bc00b7e0251e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:46.647888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848549d-0f7a-4424-9c8e-bc00b7e0251e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:46.648162 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848549d-0f7a-4424-9c8e-bc00b7e0251e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:46.670185 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:46.681993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1848549d-0f7a-4424-9c8e-bc00b7e0251e None None] MFA Rules not processed for user `a6a787b1c4cf418d83d8a923b011d6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:46.684404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1848549d-0f7a-4424-9c8e-bc00b7e0251e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:46.694171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b1f78-b490-4ea7-889b-7108e570c8f5 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:46.700931 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:46.703147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893551d8-09a4-4c3f-af4f-f97f934d9fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:46.704032 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893551d8-09a4-4c3f-af4f-f97f934d9fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:46.704576 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893551d8-09a4-4c3f-af4f-f97f934d9fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:46.711978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893551d8-09a4-4c3f-af4f-f97f934d9fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:46.713234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893551d8-09a4-4c3f-af4f-f97f934d9fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:46.715500 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893551d8-09a4-4c3f-af4f-f97f934d9fe6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:46.777210 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 826/1628] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:46.777210 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848549d-0f7a-4424-9c8e-bc00b7e0251e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:46.796546 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 803/1629] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:17:46 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:46.797744 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893551d8-09a4-4c3f-af4f-f97f934d9fe6 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:46.925404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848549d-0f7a-4424-9c8e-bc00b7e0251e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:46.945473 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d07a0f-656f-4e49-af5e-db6773a537af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:46.946589 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d07a0f-656f-4e49-af5e-db6773a537af service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:46.946870 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d07a0f-656f-4e49-af5e-db6773a537af service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:46.947236 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d07a0f-656f-4e49-af5e-db6773a537af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:46.986358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893551d8-09a4-4c3f-af4f-f97f934d9fe6 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:46.991344 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328af2f-b8d1-4d6c-aa45-94d64872948f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:46.995256 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328af2f-b8d1-4d6c-aa45-94d64872948f service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:46.995256 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328af2f-b8d1-4d6c-aa45-94d64872948f service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:46.995256 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328af2f-b8d1-4d6c-aa45-94d64872948f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:47.005128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328af2f-b8d1-4d6c-aa45-94d64872948f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:47.009741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328af2f-b8d1-4d6c-aa45-94d64872948f service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:47.022520 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 804/1630] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:17:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:17:47.023504 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328af2f-b8d1-4d6c-aa45-94d64872948f service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:47.037445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328af2f-b8d1-4d6c-aa45-94d64872948f service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:47.044130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87442173-dfa3-420a-a61c-c4b35784db82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:47.045237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87442173-dfa3-420a-a61c-c4b35784db82 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:47.045879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87442173-dfa3-420a-a61c-c4b35784db82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:47.046357 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87442173-dfa3-420a-a61c-c4b35784db82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:47.047562 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87442173-dfa3-420a-a61c-c4b35784db82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:47.050656 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87442173-dfa3-420a-a61c-c4b35784db82 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:47.070637 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d07a0f-656f-4e49-af5e-db6773a537af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:47.071668 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 805/1631] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:47.072802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d07a0f-656f-4e49-af5e-db6773a537af service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:47.073436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d09c7a-d977-43e9-8a9c-aae52f0363cb None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:47.074045 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d09c7a-d977-43e9-8a9c-aae52f0363cb None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:47.074413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d09c7a-d977-43e9-8a9c-aae52f0363cb None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:47.083705 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 806/1632] 10.222.0.65 () {54 vars in 912 bytes} [Tue Aug 9 19:17:47 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:17:47.084727 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d09c7a-d977-43e9-8a9c-aae52f0363cb None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:47.088740 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 827/1633] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:17:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:17:47.090868 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bd58b-e51f-4ddf-bbb8-b7c1c2bcf831 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:47.091334 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bd58b-e51f-4ddf-bbb8-b7c1c2bcf831 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:47.091769 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bd58b-e51f-4ddf-bbb8-b7c1c2bcf831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:47.123929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-058bd58b-e51f-4ddf-bbb8-b7c1c2bcf831 None None] MFA Rules not processed for user `2cfda1bec35145f3bbcc13fae0b7af2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:47.125574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-058bd58b-e51f-4ddf-bbb8-b7c1c2bcf831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:47.128386 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d09c7a-d977-43e9-8a9c-aae52f0363cb None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:47.138449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 828/1634] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Aug 9 19:17:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:47.159229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf712b8-8144-4a06-99b4-1cb894416d35 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:47.159719 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf712b8-8144-4a06-99b4-1cb894416d35 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:47.160103 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf712b8-8144-4a06-99b4-1cb894416d35 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:47.162229 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a1b10-732a-4875-a4bc-2fd103f29d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:47.162930 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a1b10-732a-4875-a4bc-2fd103f29d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:47.163205 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a1b10-732a-4875-a4bc-2fd103f29d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:47.164576 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a1b10-732a-4875-a4bc-2fd103f29d97 admin admin] PATH_INFO: `/v3/projects/e6d182877ebd4757aaa7b8c7325c71b8/users/c3e77a79f4114001b70f48af0d420aa4/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:47.168392 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 829/1635] 10.222.0.65 () {54 vars in 912 bytes} [Tue Aug 9 19:17:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:17:47.169391 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf712b8-8144-4a06-99b4-1cb894416d35 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:47.185196 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf712b8-8144-4a06-99b4-1cb894416d35 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:47.191840 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd95800-cd45-4b90-aee4-b31e2bf5ef36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:47.192710 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd95800-cd45-4b90-aee4-b31e2bf5ef36 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:47.193479 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd95800-cd45-4b90-aee4-b31e2bf5ef36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:47.193773 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd95800-cd45-4b90-aee4-b31e2bf5ef36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:47.198450 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a1b10-732a-4875-a4bc-2fd103f29d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6d182877ebd4757aaa7b8c7325c71b8, user_id=c3e77a79f4114001b70f48af0d420aa4, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:47.201140 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a1b10-732a-4875-a4bc-2fd103f29d97 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:47.207353 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd95800-cd45-4b90-aee4-b31e2bf5ef36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:47.210018 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd95800-cd45-4b90-aee4-b31e2bf5ef36 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:47.223842 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 830/1636] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:17:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:17:47.228970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539a7c3-5df6-4772-a320-50a90688d76a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:47.228970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539a7c3-5df6-4772-a320-50a90688d76a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:47.228970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539a7c3-5df6-4772-a320-50a90688d76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:47.254460 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2539a7c3-5df6-4772-a320-50a90688d76a None None] MFA Rules not processed for user `2cfda1bec35145f3bbcc13fae0b7af2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:47.255794 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2539a7c3-5df6-4772-a320-50a90688d76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:47.278002 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 831/1637] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Aug 9 19:17:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:47.318520 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 807/1638] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:17:47 2022] PUT /identity/v3/projects/e6d182877ebd4757aaa7b8c7325c71b8/users/c3e77a79f4114001b70f48af0d420aa4/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:47.322644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539a7c3-5df6-4772-a320-50a90688d76a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:47.358164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539a7c3-5df6-4772-a320-50a90688d76a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:47.363420 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a1b10-732a-4875-a4bc-2fd103f29d97 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:47.405486 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:47.447089 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a1b10-732a-4875-a4bc-2fd103f29d97 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:47.452448 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf8ec5-2625-4d14-ace4-2e98052f395b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:47.453483 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf8ec5-2625-4d14-ace4-2e98052f395b service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:47.453836 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf8ec5-2625-4d14-ace4-2e98052f395b service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:47.454186 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf8ec5-2625-4d14-ace4-2e98052f395b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:47.462412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba0112-0b0c-489d-b62e-51db5d8e38b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:47.464634 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba0112-0b0c-489d-b62e-51db5d8e38b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:47.464634 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba0112-0b0c-489d-b62e-51db5d8e38b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:47.464634 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba0112-0b0c-489d-b62e-51db5d8e38b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:47.464980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba0112-0b0c-489d-b62e-51db5d8e38b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:47.467471 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba0112-0b0c-489d-b62e-51db5d8e38b6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:47.480965 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 832/1639] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:47.485350 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba0112-0b0c-489d-b62e-51db5d8e38b6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:47.499027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba0112-0b0c-489d-b62e-51db5d8e38b6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:47.504658 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d61c18-77c8-4183-a255-029c43ad5ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:47.505490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d61c18-77c8-4183-a255-029c43ad5ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:47.505883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d61c18-77c8-4183-a255-029c43ad5ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:47.506261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d61c18-77c8-4183-a255-029c43ad5ae8 admin admin] PATH_INFO: `/v3/projects/e6d182877ebd4757aaa7b8c7325c71b8/users/c3e77a79f4114001b70f48af0d420aa4/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:47.508504 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d61c18-77c8-4183-a255-029c43ad5ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6d182877ebd4757aaa7b8c7325c71b8, user_id=c3e77a79f4114001b70f48af0d420aa4, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:47.512010 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d61c18-77c8-4183-a255-029c43ad5ae8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:47.535326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 833/1640] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:17:47 2022] PUT /identity/v3/projects/e6d182877ebd4757aaa7b8c7325c71b8/users/c3e77a79f4114001b70f48af0d420aa4/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:47.537079 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7fd11-1d02-41d7-8fbe-42ac75732e42 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:47.537489 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7fd11-1d02-41d7-8fbe-42ac75732e42 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:47.537895 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7fd11-1d02-41d7-8fbe-42ac75732e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:47.575730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-24e7fd11-1d02-41d7-8fbe-42ac75732e42 None None] MFA Rules not processed for user `c3e77a79f4114001b70f48af0d420aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:47.577260 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:47.578145 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-24e7fd11-1d02-41d7-8fbe-42ac75732e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:47.617806 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf8ec5-2625-4d14-ace4-2e98052f395b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:47.619635 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf8ec5-2625-4d14-ace4-2e98052f395b service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:47.633018 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 808/1641] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:17:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:17:47.687617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 834/1642] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:48.202029 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf8ec5-2625-4d14-ace4-2e98052f395b service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:48.214140 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf8ec5-2625-4d14-ace4-2e98052f395b service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:48.282914 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9958a13-f65a-4531-9ffc-eb216afe84c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:48.283564 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9958a13-f65a-4531-9ffc-eb216afe84c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:48.283855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9958a13-f65a-4531-9ffc-eb216afe84c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:48.284143 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9958a13-f65a-4531-9ffc-eb216afe84c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:48.400806 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9958a13-f65a-4531-9ffc-eb216afe84c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:48.402432 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9958a13-f65a-4531-9ffc-eb216afe84c7 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:48.414680 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 809/1643] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:17:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:17:48.622877 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7fd11-1d02-41d7-8fbe-42ac75732e42 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:48.633137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7fd11-1d02-41d7-8fbe-42ac75732e42 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:48.636737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bbd334-935b-4289-8acf-a048c8a4413d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:48.637385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbd334-935b-4289-8acf-a048c8a4413d service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:48.637704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbd334-935b-4289-8acf-a048c8a4413d service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:48.637980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbd334-935b-4289-8acf-a048c8a4413d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:48.647786 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbd334-935b-4289-8acf-a048c8a4413d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:48.649347 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bbd334-935b-4289-8acf-a048c8a4413d service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:48.673298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 835/1644] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:17:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:17:49.409996 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9958a13-f65a-4531-9ffc-eb216afe84c7 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:49.492100 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9958a13-f65a-4531-9ffc-eb216afe84c7 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:49.497934 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352ba6e-ad8b-4a47-a55c-5e83cfbddea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:49.498596 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352ba6e-ad8b-4a47-a55c-5e83cfbddea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:49.498988 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352ba6e-ad8b-4a47-a55c-5e83cfbddea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:49.499315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352ba6e-ad8b-4a47-a55c-5e83cfbddea3 admin admin] PATH_INFO: `/v3/users/29ca644f7ec444f49ed59970b2337cb3` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:49.500428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352ba6e-ad8b-4a47-a55c-5e83cfbddea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29ca644f7ec444f49ed59970b2337cb3)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:49.502627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352ba6e-ad8b-4a47-a55c-5e83cfbddea3 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:49.779241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:49.782423 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5352ba6e-ad8b-4a47-a55c-5e83cfbddea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ca644f7ec444f49ed59970b2337cb3'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:49.789740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5352ba6e-ad8b-4a47-a55c-5e83cfbddea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ca644f7ec444f49ed59970b2337cb3'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:49.790515 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5352ba6e-ad8b-4a47-a55c-5e83cfbddea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ca644f7ec444f49ed59970b2337cb3'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:49.791187 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5352ba6e-ad8b-4a47-a55c-5e83cfbddea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ca644f7ec444f49ed59970b2337cb3'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:49.922157 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5352ba6e-ad8b-4a47-a55c-5e83cfbddea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ca644f7ec444f49ed59970b2337cb3'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:49.971177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 810/1645] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:17:49 2022] DELETE /identity/v3/users/29ca644f7ec444f49ed59970b2337cb3 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:49.977561 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c56be-c26d-40f4-9cd1-b8a48baa81d8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:49.978422 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c56be-c26d-40f4-9cd1-b8a48baa81d8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:49.979040 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c56be-c26d-40f4-9cd1-b8a48baa81d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:50.006781 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f22c56be-c26d-40f4-9cd1-b8a48baa81d8 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:50.008522 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f22c56be-c26d-40f4-9cd1-b8a48baa81d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:50.139844 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 836/1646] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:17:50.232779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352ba6e-ad8b-4a47-a55c-5e83cfbddea3 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:50.235575 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5352ba6e-ad8b-4a47-a55c-5e83cfbddea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:50.263202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c56be-c26d-40f4-9cd1-b8a48baa81d8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:50.268094 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f22c56be-c26d-40f4-9cd1-b8a48baa81d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:50.323227 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c56be-c26d-40f4-9cd1-b8a48baa81d8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:50.369974 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be2f9b-c8ac-43bd-8196-9aa2b2c568df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:50.373954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2f9b-c8ac-43bd-8196-9aa2b2c568df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:50.373954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2f9b-c8ac-43bd-8196-9aa2b2c568df admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:50.373954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2f9b-c8ac-43bd-8196-9aa2b2c568df admin admin] PATH_INFO: `/v3/users/c4ccff24eb2b43dcafecdef4956d628c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:50.375223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be2f9b-c8ac-43bd-8196-9aa2b2c568df admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ccff24eb2b43dcafecdef4956d628c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:50.393375 dv-cinder-852654-1-smb devstack@keystone.service[80524]: WARNING py.warnings [None req-53be2f9b-c8ac-43bd-8196-9aa2b2c568df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:17:50.393375 dv-cinder-852654-1-smb devstack@keystone.service[80524]: warnings.warn(msg) Aug 09 19:17:50.393375 dv-cinder-852654-1-smb devstack@keystone.service[80524]: Aug 09 19:17:50.399788 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be2f9b-c8ac-43bd-8196-9aa2b2c568df admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:50.446719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352ba6e-ad8b-4a47-a55c-5e83cfbddea3 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:50.465249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2a64e-d9e8-4e78-90ef-0a85df7644a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:50.466145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2a64e-d9e8-4e78-90ef-0a85df7644a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:50.466554 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2a64e-d9e8-4e78-90ef-0a85df7644a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:50.466942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2a64e-d9e8-4e78-90ef-0a85df7644a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:50.491276 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:50.496058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2a64e-d9e8-4e78-90ef-0a85df7644a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:50.502374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2a64e-d9e8-4e78-90ef-0a85df7644a3 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:50.552978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 811/1647] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:17:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:17:50.766349 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-53be2f9b-c8ac-43bd-8196-9aa2b2c568df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ccff24eb2b43dcafecdef4956d628c'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:50.850731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-53be2f9b-c8ac-43bd-8196-9aa2b2c568df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ccff24eb2b43dcafecdef4956d628c'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:50.851727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-53be2f9b-c8ac-43bd-8196-9aa2b2c568df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ccff24eb2b43dcafecdef4956d628c'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:50.852580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-53be2f9b-c8ac-43bd-8196-9aa2b2c568df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ccff24eb2b43dcafecdef4956d628c'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:50.874580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-53be2f9b-c8ac-43bd-8196-9aa2b2c568df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ccff24eb2b43dcafecdef4956d628c'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:50.947426 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 837/1648] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:17:50 2022] DELETE /identity/v3/users/c4ccff24eb2b43dcafecdef4956d628c => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:50.952073 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350402a-29b2-47ef-9a8f-8c7cee0807cd None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:50.952300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350402a-29b2-47ef-9a8f-8c7cee0807cd None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:50.952565 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350402a-29b2-47ef-9a8f-8c7cee0807cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:50.986496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1350402a-29b2-47ef-9a8f-8c7cee0807cd None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:50.987715 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1350402a-29b2-47ef-9a8f-8c7cee0807cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:51.085611 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 812/1649] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:51.103219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be2f9b-c8ac-43bd-8196-9aa2b2c568df admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:51.104858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-53be2f9b-c8ac-43bd-8196-9aa2b2c568df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:51.177176 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be2f9b-c8ac-43bd-8196-9aa2b2c568df admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:51.187185 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eead4-254f-4a7c-8d42-e7b417904952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:51.188057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eead4-254f-4a7c-8d42-e7b417904952 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:51.188575 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eead4-254f-4a7c-8d42-e7b417904952 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:51.201298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eead4-254f-4a7c-8d42-e7b417904952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:51.221515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125eead4-254f-4a7c-8d42-e7b417904952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:51.233767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125eead4-254f-4a7c-8d42-e7b417904952 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:51.262515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 838/1650] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:17:52.878948 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350402a-29b2-47ef-9a8f-8c7cee0807cd None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:52.881971 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1350402a-29b2-47ef-9a8f-8c7cee0807cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:52.927977 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350402a-29b2-47ef-9a8f-8c7cee0807cd None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:52.935921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607a5d8-9339-4930-b5f5-d6d03f2f0f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:52.936860 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607a5d8-9339-4930-b5f5-d6d03f2f0f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:52.937284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607a5d8-9339-4930-b5f5-d6d03f2f0f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:52.937728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607a5d8-9339-4930-b5f5-d6d03f2f0f17 admin admin] PATH_INFO: `/v3/projects/9cae34ac16df4323910d01d3094b1169` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:52.954108 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607a5d8-9339-4930-b5f5-d6d03f2f0f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cae34ac16df4323910d01d3094b1169)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:52.969271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: WARNING py.warnings [None req-2607a5d8-9339-4930-b5f5-d6d03f2f0f17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:17:52.969271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: warnings.warn(msg) Aug 09 19:17:52.969271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: Aug 09 19:17:52.969271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607a5d8-9339-4930-b5f5-d6d03f2f0f17 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:53.005835 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eead4-254f-4a7c-8d42-e7b417904952 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:53.007732 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-125eead4-254f-4a7c-8d42-e7b417904952 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:53.033853 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eead4-254f-4a7c-8d42-e7b417904952 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:53.049006 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8e64b-1d17-4789-a7c8-b07bd2b2c395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:53.050239 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8e64b-1d17-4789-a7c8-b07bd2b2c395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:53.052525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8e64b-1d17-4789-a7c8-b07bd2b2c395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:53.052968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8e64b-1d17-4789-a7c8-b07bd2b2c395 admin admin] PATH_INFO: `/v3/users/e04dc79ee0b4413e9532fb1aa0b9bfb9` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:53.055826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8e64b-1d17-4789-a7c8-b07bd2b2c395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04dc79ee0b4413e9532fb1aa0b9bfb9)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:53.061617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8e64b-1d17-4789-a7c8-b07bd2b2c395 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:53.186003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2607a5d8-9339-4930-b5f5-d6d03f2f0f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cae34ac16df4323910d01d3094b1169', 'request_id': 'req-2607a5d8-9339-4930-b5f5-d6d03f2f0f17'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:53.197160 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2607a5d8-9339-4930-b5f5-d6d03f2f0f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cae34ac16df4323910d01d3094b1169', 'request_id': 'req-2607a5d8-9339-4930-b5f5-d6d03f2f0f17'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:53.209250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:53.341271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2607a5d8-9339-4930-b5f5-d6d03f2f0f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cae34ac16df4323910d01d3094b1169', 'request_id': 'req-2607a5d8-9339-4930-b5f5-d6d03f2f0f17'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:53.395852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2607a5d8-9339-4930-b5f5-d6d03f2f0f17 admin admin] The token cache is being invalidate because project 9cae34ac16df4323910d01d3094b1169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:17:53.396175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2607a5d8-9339-4930-b5f5-d6d03f2f0f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:53.401872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2607a5d8-9339-4930-b5f5-d6d03f2f0f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:53.430564 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 813/1651] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:17:52 2022] DELETE /identity/v3/projects/9cae34ac16df4323910d01d3094b1169 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:53.431812 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607a5d8-9339-4930-b5f5-d6d03f2f0f17 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:53.434267 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2607a5d8-9339-4930-b5f5-d6d03f2f0f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:53.493063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-57c8e64b-1d17-4789-a7c8-b07bd2b2c395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04dc79ee0b4413e9532fb1aa0b9bfb9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:53.592487 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-57c8e64b-1d17-4789-a7c8-b07bd2b2c395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04dc79ee0b4413e9532fb1aa0b9bfb9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:53.596823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-57c8e64b-1d17-4789-a7c8-b07bd2b2c395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04dc79ee0b4413e9532fb1aa0b9bfb9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:53.596823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-57c8e64b-1d17-4789-a7c8-b07bd2b2c395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04dc79ee0b4413e9532fb1aa0b9bfb9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:53.609769 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-57c8e64b-1d17-4789-a7c8-b07bd2b2c395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04dc79ee0b4413e9532fb1aa0b9bfb9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:53.695005 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607a5d8-9339-4930-b5f5-d6d03f2f0f17 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:53.703051 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 839/1652] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:17:53 2022] DELETE /identity/v3/users/e04dc79ee0b4413e9532fb1aa0b9bfb9 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:17:53.708335 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ffb9d-dc07-4871-9c3d-d1ef9f790734 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:53.708920 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ffb9d-dc07-4871-9c3d-d1ef9f790734 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:53.709478 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ffb9d-dc07-4871-9c3d-d1ef9f790734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:53.749233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:53.774507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-961ffb9d-dc07-4871-9c3d-d1ef9f790734 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:53.775746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-961ffb9d-dc07-4871-9c3d-d1ef9f790734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:53.806876 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216956b3-5e60-4f5d-896f-a47ab6430dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:53.807531 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216956b3-5e60-4f5d-896f-a47ab6430dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:53.807818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216956b3-5e60-4f5d-896f-a47ab6430dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:53.808095 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216956b3-5e60-4f5d-896f-a47ab6430dae admin admin] PATH_INFO: `/v3/projects/6da993fa80884dc990ca1a1cf9c7906e` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:53.829316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216956b3-5e60-4f5d-896f-a47ab6430dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da993fa80884dc990ca1a1cf9c7906e)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:53.841282 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216956b3-5e60-4f5d-896f-a47ab6430dae admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:53.901041 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 840/1653] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:53.902549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5aaee-9fca-4227-ad31-800427c07a61 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:53.902899 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5aaee-9fca-4227-ad31-800427c07a61 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:53.903541 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5aaee-9fca-4227-ad31-800427c07a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:53.938416 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e6c5aaee-9fca-4227-ad31-800427c07a61 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:53.948723 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e6c5aaee-9fca-4227-ad31-800427c07a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:53.960399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 841/1654] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:53.961294 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354913b3-84b8-4c77-b871-dda98a0a6cc3 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:53.961804 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354913b3-84b8-4c77-b871-dda98a0a6cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:53.962300 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354913b3-84b8-4c77-b871-dda98a0a6cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:54.055109 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-354913b3-84b8-4c77-b871-dda98a0a6cc3 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:54.060708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-216956b3-5e60-4f5d-896f-a47ab6430dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da993fa80884dc990ca1a1cf9c7906e', 'request_id': 'req-216956b3-5e60-4f5d-896f-a47ab6430dae'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:54.067225 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-354913b3-84b8-4c77-b871-dda98a0a6cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:54.068910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-216956b3-5e60-4f5d-896f-a47ab6430dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da993fa80884dc990ca1a1cf9c7906e', 'request_id': 'req-216956b3-5e60-4f5d-896f-a47ab6430dae'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:54.179034 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-216956b3-5e60-4f5d-896f-a47ab6430dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da993fa80884dc990ca1a1cf9c7906e', 'request_id': 'req-216956b3-5e60-4f5d-896f-a47ab6430dae'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:54.197042 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-216956b3-5e60-4f5d-896f-a47ab6430dae admin admin] The token cache is being invalidate because project 6da993fa80884dc990ca1a1cf9c7906e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:17:54.197637 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-216956b3-5e60-4f5d-896f-a47ab6430dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:54.198448 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-216956b3-5e60-4f5d-896f-a47ab6430dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:54.203213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 814/1655] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:17:53 2022] DELETE /identity/v3/projects/6da993fa80884dc990ca1a1cf9c7906e => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:54.204756 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216956b3-5e60-4f5d-896f-a47ab6430dae admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:54.213786 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-216956b3-5e60-4f5d-896f-a47ab6430dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:54.222951 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 842/1656] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:54.224129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354913b3-84b8-4c77-b871-dda98a0a6cc3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:54.229402 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-354913b3-84b8-4c77-b871-dda98a0a6cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:54.268220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354913b3-84b8-4c77-b871-dda98a0a6cc3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:54.278361 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91373f04-0210-4774-9f23-ffb4334f252c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:54.279379 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91373f04-0210-4774-9f23-ffb4334f252c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:54.279801 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91373f04-0210-4774-9f23-ffb4334f252c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:54.280240 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91373f04-0210-4774-9f23-ffb4334f252c admin admin] PATH_INFO: `/v3/users/c3e77a79f4114001b70f48af0d420aa4` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:54.283382 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91373f04-0210-4774-9f23-ffb4334f252c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3e77a79f4114001b70f48af0d420aa4)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:54.288225 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91373f04-0210-4774-9f23-ffb4334f252c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:54.345250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216956b3-5e60-4f5d-896f-a47ab6430dae admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:54.368400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d91b86-f065-4435-804f-a29c8a396fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:54.369473 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d91b86-f065-4435-804f-a29c8a396fbb service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:54.369909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d91b86-f065-4435-804f-a29c8a396fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:54.370398 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d91b86-f065-4435-804f-a29c8a396fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:54.376663 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b4d91b86-f065-4435-804f-a29c8a396fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:54.428098 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d91b86-f065-4435-804f-a29c8a396fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:54.430909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d91b86-f065-4435-804f-a29c8a396fbb service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:54.451786 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 815/1657] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:17:54.453104 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d91b86-f065-4435-804f-a29c8a396fbb service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:54.501578 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d91b86-f065-4435-804f-a29c8a396fbb service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:54.521870 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c1298-1f81-4942-b048-6b48dd910a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:54.522768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c1298-1f81-4942-b048-6b48dd910a54 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:54.523163 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c1298-1f81-4942-b048-6b48dd910a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:54.523541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c1298-1f81-4942-b048-6b48dd910a54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:54.524296 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c1298-1f81-4942-b048-6b48dd910a54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:17:54.524823 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c1298-1f81-4942-b048-6b48dd910a54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:54.529540 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c1298-1f81-4942-b048-6b48dd910a54 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:54.558323 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 816/1658] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:17:54.562543 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c1298-1f81-4942-b048-6b48dd910a54 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:54.586291 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c1298-1f81-4942-b048-6b48dd910a54 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:54.602619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae558f4-0df2-4cb9-9b44-248b109ff306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:54.603060 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-91373f04-0210-4774-9f23-ffb4334f252c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3e77a79f4114001b70f48af0d420aa4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:54.603845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae558f4-0df2-4cb9-9b44-248b109ff306 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:54.604334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae558f4-0df2-4cb9-9b44-248b109ff306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:54.604765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae558f4-0df2-4cb9-9b44-248b109ff306 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:54.610993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae558f4-0df2-4cb9-9b44-248b109ff306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:54.610993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae558f4-0df2-4cb9-9b44-248b109ff306 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:54.718712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-91373f04-0210-4774-9f23-ffb4334f252c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3e77a79f4114001b70f48af0d420aa4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:54.719357 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-91373f04-0210-4774-9f23-ffb4334f252c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3e77a79f4114001b70f48af0d420aa4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:54.720129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-91373f04-0210-4774-9f23-ffb4334f252c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3e77a79f4114001b70f48af0d420aa4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:54.731710 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 817/1659] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:17:54 2022] POST /identity/v3/projects => generated 403 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:17:54.735994 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae558f4-0df2-4cb9-9b44-248b109ff306 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:54.739287 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5ae558f4-0df2-4cb9-9b44-248b109ff306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:54.757906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-91373f04-0210-4774-9f23-ffb4334f252c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3e77a79f4114001b70f48af0d420aa4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:54.824378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 843/1660] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:17:54 2022] DELETE /identity/v3/users/c3e77a79f4114001b70f48af0d420aa4 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:54.996215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae558f4-0df2-4cb9-9b44-248b109ff306 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:55.198382 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:55.235740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a919d-8aca-437a-9e7b-6e7f8f87e865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:55.236634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a919d-8aca-437a-9e7b-6e7f8f87e865 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:55.243054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a919d-8aca-437a-9e7b-6e7f8f87e865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:55.243054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a919d-8aca-437a-9e7b-6e7f8f87e865 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:55.243054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a919d-8aca-437a-9e7b-6e7f8f87e865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:55.247084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a919d-8aca-437a-9e7b-6e7f8f87e865 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:55.348422 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 818/1661] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:17:54 2022] POST /identity/v3/users => generated 302 bytes in 613 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:17:55.352768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91373f04-0210-4774-9f23-ffb4334f252c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:55.364366 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91373f04-0210-4774-9f23-ffb4334f252c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:55.375711 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d8ae3-a750-43ea-98e0-d4609cf727ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:55.376565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d8ae3-a750-43ea-98e0-d4609cf727ee admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:55.376988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d8ae3-a750-43ea-98e0-d4609cf727ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:55.377429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d8ae3-a750-43ea-98e0-d4609cf727ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:55.378269 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d8ae3-a750-43ea-98e0-d4609cf727ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:55.380144 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d8ae3-a750-43ea-98e0-d4609cf727ee admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:55.402072 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 844/1662] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:55.408185 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a919d-8aca-437a-9e7b-6e7f8f87e865 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:55.423994 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a919d-8aca-437a-9e7b-6e7f8f87e865 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:55.461740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116509b-f6cc-4eb9-8029-772e8184a998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:55.464622 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116509b-f6cc-4eb9-8029-772e8184a998 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:55.465018 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116509b-f6cc-4eb9-8029-772e8184a998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:55.465302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116509b-f6cc-4eb9-8029-772e8184a998 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:55.471776 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116509b-f6cc-4eb9-8029-772e8184a998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:55.476644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116509b-f6cc-4eb9-8029-772e8184a998 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:55.536788 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d8ae3-a750-43ea-98e0-d4609cf727ee admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:55.561070 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 819/1663] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:55.561890 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d8ae3-a750-43ea-98e0-d4609cf727ee admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:55.564254 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:55.600623 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c0945-9ce7-43f6-9316-1338640e731d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:55.605042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c0945-9ce7-43f6-9316-1338640e731d admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:55.610407 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c0945-9ce7-43f6-9316-1338640e731d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:55.610739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c0945-9ce7-43f6-9316-1338640e731d admin admin] PATH_INFO: `/v3/projects/c0cb859b8fc44a0e85bb5a3fe9cac86d/users/3aeccb0f5a164e329ff85625a921cc7f/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:55.680184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c0945-9ce7-43f6-9316-1338640e731d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0cb859b8fc44a0e85bb5a3fe9cac86d, user_id=3aeccb0f5a164e329ff85625a921cc7f, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:55.691102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c0945-9ce7-43f6-9316-1338640e731d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:55.710664 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcbfd5-f1c9-4047-b1ab-aed2515f7ab1 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:55.711312 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcbfd5-f1c9-4047-b1ab-aed2515f7ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:55.711995 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcbfd5-f1c9-4047-b1ab-aed2515f7ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:55.765154 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 845/1664] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:17:55 2022] PUT /identity/v3/projects/c0cb859b8fc44a0e85bb5a3fe9cac86d/users/3aeccb0f5a164e329ff85625a921cc7f/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:55.776063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b09128-fa70-442b-835a-b3840c446fd8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:55.776527 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b09128-fa70-442b-835a-b3840c446fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:55.777163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b09128-fa70-442b-835a-b3840c446fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:55.803864 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a7fcbfd5-f1c9-4047-b1ab-aed2515f7ab1 None None] MFA Rules not processed for user `d5f9fe48bb8f44f997e36e0e320bfc5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:55.805152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a7fcbfd5-f1c9-4047-b1ab-aed2515f7ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:55.859356 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-26b09128-fa70-442b-835a-b3840c446fd8 None None] MFA Rules not processed for user `3aeccb0f5a164e329ff85625a921cc7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:55.860552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-26b09128-fa70-442b-835a-b3840c446fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:55.987056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 820/1665] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:17:55.999517 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9222f9-b41e-47f7-b92f-5c6ae8bd3159 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:56.000015 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9222f9-b41e-47f7-b92f-5c6ae8bd3159 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:56.001706 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9222f9-b41e-47f7-b92f-5c6ae8bd3159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:56.037337 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 846/1666] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:55 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:17:56.038432 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b09128-fa70-442b-835a-b3840c446fd8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:56.056355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-26b09128-fa70-442b-835a-b3840c446fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:56.059321 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-de9222f9-b41e-47f7-b92f-5c6ae8bd3159 None None] MFA Rules not processed for user `d5f9fe48bb8f44f997e36e0e320bfc5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:56.060520 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-de9222f9-b41e-47f7-b92f-5c6ae8bd3159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:56.077777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 821/1667] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:56.080460 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9222f9-b41e-47f7-b92f-5c6ae8bd3159 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:56.233387 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b09128-fa70-442b-835a-b3840c446fd8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:56.247991 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9222f9-b41e-47f7-b92f-5c6ae8bd3159 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:56.249261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6cc592-c7c3-4d6d-a4bb-9f484394a33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:56.250013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cc592-c7c3-4d6d-a4bb-9f484394a33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:56.250344 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cc592-c7c3-4d6d-a4bb-9f484394a33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:56.250568 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cc592-c7c3-4d6d-a4bb-9f484394a33d admin admin] PATH_INFO: `/v3/projects/e6d182877ebd4757aaa7b8c7325c71b8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:56.253407 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6cc592-c7c3-4d6d-a4bb-9f484394a33d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6d182877ebd4757aaa7b8c7325c71b8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:56.255565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6cc592-c7c3-4d6d-a4bb-9f484394a33d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:56.281064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba5cd2-291f-4b82-8cbd-75528cc84154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:56.281599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba5cd2-291f-4b82-8cbd-75528cc84154 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:56.281902 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba5cd2-291f-4b82-8cbd-75528cc84154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:56.282142 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba5cd2-291f-4b82-8cbd-75528cc84154 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:56.283013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba5cd2-291f-4b82-8cbd-75528cc84154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:56.285037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba5cd2-291f-4b82-8cbd-75528cc84154 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:56.493971 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 822/1668] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:17:56 2022] POST /identity/v3/projects => generated 403 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:56.493971 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba5cd2-291f-4b82-8cbd-75528cc84154 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:56.497642 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0bba5cd2-291f-4b82-8cbd-75528cc84154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:56.501570 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9d6cc592-c7c3-4d6d-a4bb-9f484394a33d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6d182877ebd4757aaa7b8c7325c71b8', 'request_id': 'req-9d6cc592-c7c3-4d6d-a4bb-9f484394a33d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:56.512089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9d6cc592-c7c3-4d6d-a4bb-9f484394a33d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6d182877ebd4757aaa7b8c7325c71b8', 'request_id': 'req-9d6cc592-c7c3-4d6d-a4bb-9f484394a33d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:56.604903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9d6cc592-c7c3-4d6d-a4bb-9f484394a33d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6d182877ebd4757aaa7b8c7325c71b8', 'request_id': 'req-9d6cc592-c7c3-4d6d-a4bb-9f484394a33d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:56.635953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9d6cc592-c7c3-4d6d-a4bb-9f484394a33d admin admin] The token cache is being invalidate because project e6d182877ebd4757aaa7b8c7325c71b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:17:56.637433 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9d6cc592-c7c3-4d6d-a4bb-9f484394a33d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:56.638588 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9d6cc592-c7c3-4d6d-a4bb-9f484394a33d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:56.641397 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 847/1669] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:17:56 2022] DELETE /identity/v3/projects/e6d182877ebd4757aaa7b8c7325c71b8 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:56.644854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6cc592-c7c3-4d6d-a4bb-9f484394a33d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:56.647029 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9d6cc592-c7c3-4d6d-a4bb-9f484394a33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:56.679184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba5cd2-291f-4b82-8cbd-75528cc84154 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:56.687273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a39e3-99c0-414e-a22e-fbf3e0808a8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:56.688279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a39e3-99c0-414e-a22e-fbf3e0808a8a service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:56.689023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a39e3-99c0-414e-a22e-fbf3e0808a8a service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:56.689590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a39e3-99c0-414e-a22e-fbf3e0808a8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:56.692104 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-db0a39e3-99c0-414e-a22e-fbf3e0808a8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:56.765977 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6cc592-c7c3-4d6d-a4bb-9f484394a33d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:56.837485 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a39e3-99c0-414e-a22e-fbf3e0808a8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:56.839838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a39e3-99c0-414e-a22e-fbf3e0808a8a service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:56.851323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65f34f-0b48-4f2f-9d37-b5e8d54f143b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:56.851989 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65f34f-0b48-4f2f-9d37-b5e8d54f143b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:56.852329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65f34f-0b48-4f2f-9d37-b5e8d54f143b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:56.852787 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65f34f-0b48-4f2f-9d37-b5e8d54f143b admin admin] PATH_INFO: `/v3/users/91e509cdd69843fe8efc7fbc64ede013` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:56.854427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65f34f-0b48-4f2f-9d37-b5e8d54f143b admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e509cdd69843fe8efc7fbc64ede013)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:56.856585 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65f34f-0b48-4f2f-9d37-b5e8d54f143b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:56.869921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 823/1670] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:17:56 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:17:56.871048 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a39e3-99c0-414e-a22e-fbf3e0808a8a service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:56.877716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:56.879640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-db0a39e3-99c0-414e-a22e-fbf3e0808a8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:56.906477 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a39e3-99c0-414e-a22e-fbf3e0808a8a service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:56.913659 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7b022-87bd-46d8-a050-f4ff39107afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:56.914156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7b022-87bd-46d8-a050-f4ff39107afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:56.914567 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7b022-87bd-46d8-a050-f4ff39107afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:56.914945 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7b022-87bd-46d8-a050-f4ff39107afd admin admin] PATH_INFO: `/v3/projects/778981bde4274a32b38c9dbfe96f8677` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:56.917729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7b022-87bd-46d8-a050-f4ff39107afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=778981bde4274a32b38c9dbfe96f8677)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:56.921613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7b022-87bd-46d8-a050-f4ff39107afd admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:57.061133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3a65f34f-0b48-4f2f-9d37-b5e8d54f143b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e509cdd69843fe8efc7fbc64ede013'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:57.100584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fda7b022-87bd-46d8-a050-f4ff39107afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '778981bde4274a32b38c9dbfe96f8677', 'request_id': 'req-fda7b022-87bd-46d8-a050-f4ff39107afd'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:57.110287 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fda7b022-87bd-46d8-a050-f4ff39107afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '778981bde4274a32b38c9dbfe96f8677', 'request_id': 'req-fda7b022-87bd-46d8-a050-f4ff39107afd'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:57.159160 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3a65f34f-0b48-4f2f-9d37-b5e8d54f143b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e509cdd69843fe8efc7fbc64ede013'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:57.160413 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3a65f34f-0b48-4f2f-9d37-b5e8d54f143b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e509cdd69843fe8efc7fbc64ede013'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:57.161962 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3a65f34f-0b48-4f2f-9d37-b5e8d54f143b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e509cdd69843fe8efc7fbc64ede013'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:57.174563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3a65f34f-0b48-4f2f-9d37-b5e8d54f143b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e509cdd69843fe8efc7fbc64ede013'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:57.220650 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fda7b022-87bd-46d8-a050-f4ff39107afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '778981bde4274a32b38c9dbfe96f8677', 'request_id': 'req-fda7b022-87bd-46d8-a050-f4ff39107afd'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:57.248120 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fda7b022-87bd-46d8-a050-f4ff39107afd admin admin] The token cache is being invalidate because project 778981bde4274a32b38c9dbfe96f8677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:17:57.251611 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fda7b022-87bd-46d8-a050-f4ff39107afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:57.253001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fda7b022-87bd-46d8-a050-f4ff39107afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:57.259224 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 824/1671] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:17:56 2022] DELETE /identity/v3/projects/778981bde4274a32b38c9dbfe96f8677 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:57.264213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7b022-87bd-46d8-a050-f4ff39107afd admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:57.265361 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 848/1672] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:17:56 2022] DELETE /identity/v3/users/91e509cdd69843fe8efc7fbc64ede013 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:57.267268 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99de3ed-921e-49cb-b597-732ec22eb7d3 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:57.268683 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99de3ed-921e-49cb-b597-732ec22eb7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:57.269843 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fda7b022-87bd-46d8-a050-f4ff39107afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:57.271381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99de3ed-921e-49cb-b597-732ec22eb7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:57.324086 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:57.375342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e99de3ed-921e-49cb-b597-732ec22eb7d3 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:57.376891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e99de3ed-921e-49cb-b597-732ec22eb7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:57.519424 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 849/1673] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:57.521656 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51017d-e9ca-44ae-a4dd-4926d9358468 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:57.521945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51017d-e9ca-44ae-a4dd-4926d9358468 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:57.524269 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51017d-e9ca-44ae-a4dd-4926d9358468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:57.544293 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7b022-87bd-46d8-a050-f4ff39107afd admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:57.552619 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2f51017d-e9ca-44ae-a4dd-4926d9358468 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:57.552619 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2f51017d-e9ca-44ae-a4dd-4926d9358468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:57.556173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 850/1674] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:57.556870 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3614ac-93a6-4621-86bd-7755b3cedcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:57.557941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ceef47-249c-4f0e-a29c-d1ebdf1d5a22 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:57.558734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3614ac-93a6-4621-86bd-7755b3cedcde admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:57.559160 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ceef47-249c-4f0e-a29c-d1ebdf1d5a22 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:57.559577 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3614ac-93a6-4621-86bd-7755b3cedcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:57.560005 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ceef47-249c-4f0e-a29c-d1ebdf1d5a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:57.560413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3614ac-93a6-4621-86bd-7755b3cedcde admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:57.562553 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3614ac-93a6-4621-86bd-7755b3cedcde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:57.564678 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3614ac-93a6-4621-86bd-7755b3cedcde admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:57.599019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-01ceef47-249c-4f0e-a29c-d1ebdf1d5a22 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:57.600806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-01ceef47-249c-4f0e-a29c-d1ebdf1d5a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:57.635197 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 851/1675] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:57.636963 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712e2fa-27bc-412d-b41b-21a1fc542ac8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:57.637617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712e2fa-27bc-412d-b41b-21a1fc542ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:57.638121 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712e2fa-27bc-412d-b41b-21a1fc542ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:57.688858 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 825/1676] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:17:57 2022] POST /identity/v3/users => generated 308 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:57.690523 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf626d-0dbd-4cb4-9857-a9f6e4deb3b1 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:57.691140 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf626d-0dbd-4cb4-9857-a9f6e4deb3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:57.691674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf626d-0dbd-4cb4-9857-a9f6e4deb3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:57.692903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3712e2fa-27bc-412d-b41b-21a1fc542ac8 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:57.697567 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3712e2fa-27bc-412d-b41b-21a1fc542ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:57.733494 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 852/1677] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:57.734484 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712e2fa-27bc-412d-b41b-21a1fc542ac8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:57.741327 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3712e2fa-27bc-412d-b41b-21a1fc542ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:57.769811 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:57.770029 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3aaf626d-0dbd-4cb4-9857-a9f6e4deb3b1 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:57.771221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3aaf626d-0dbd-4cb4-9857-a9f6e4deb3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:57.804863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 826/1678] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:57.805849 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf626d-0dbd-4cb4-9857-a9f6e4deb3b1 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:57.838626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf626d-0dbd-4cb4-9857-a9f6e4deb3b1 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:57.856355 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854303bb-df0d-4d40-8fe1-952bf5474b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:57.856996 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854303bb-df0d-4d40-8fe1-952bf5474b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:57.857282 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854303bb-df0d-4d40-8fe1-952bf5474b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:57.858602 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854303bb-df0d-4d40-8fe1-952bf5474b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:57.858602 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854303bb-df0d-4d40-8fe1-952bf5474b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:57.860267 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854303bb-df0d-4d40-8fe1-952bf5474b0d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:57.883857 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 827/1679] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:57.884825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854303bb-df0d-4d40-8fe1-952bf5474b0d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:57.901194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712e2fa-27bc-412d-b41b-21a1fc542ac8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:57.915404 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854303bb-df0d-4d40-8fe1-952bf5474b0d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:57.916769 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480d816-878f-4d5a-b20c-9bf6079b09be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:57.917479 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480d816-878f-4d5a-b20c-9bf6079b09be service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:57.917774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480d816-878f-4d5a-b20c-9bf6079b09be service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:57.918182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480d816-878f-4d5a-b20c-9bf6079b09be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:57.932213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a463272-128d-4a3b-9586-a97e49aa3361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:57.933376 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a463272-128d-4a3b-9586-a97e49aa3361 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:57.933940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a463272-128d-4a3b-9586-a97e49aa3361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:57.934433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a463272-128d-4a3b-9586-a97e49aa3361 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:57.935338 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a463272-128d-4a3b-9586-a97e49aa3361 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:17:57.935841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a463272-128d-4a3b-9586-a97e49aa3361 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:57.938211 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480d816-878f-4d5a-b20c-9bf6079b09be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:57.942355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480d816-878f-4d5a-b20c-9bf6079b09be service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:57.944594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a463272-128d-4a3b-9586-a97e49aa3361 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:57.969516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 853/1680] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:17:57.971589 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480d816-878f-4d5a-b20c-9bf6079b09be service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:57.999501 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 828/1681] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:17:58.000462 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a463272-128d-4a3b-9586-a97e49aa3361 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:58.011163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480d816-878f-4d5a-b20c-9bf6079b09be service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:58.023637 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1f1ca-516b-466b-bc8b-488f09443357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:58.025837 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1f1ca-516b-466b-bc8b-488f09443357 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:58.026156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1f1ca-516b-466b-bc8b-488f09443357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:58.026483 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1f1ca-516b-466b-bc8b-488f09443357 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:58.029152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a463272-128d-4a3b-9586-a97e49aa3361 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:58.030239 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1f1ca-516b-466b-bc8b-488f09443357 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:17:58.030764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1f1ca-516b-466b-bc8b-488f09443357 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:58.032780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1f1ca-516b-466b-bc8b-488f09443357 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:58.046703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec7e01-650a-441d-acf8-6fe2d65635e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:58.047429 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec7e01-650a-441d-acf8-6fe2d65635e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:58.047708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec7e01-650a-441d-acf8-6fe2d65635e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:58.047985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec7e01-650a-441d-acf8-6fe2d65635e2 admin admin] PATH_INFO: `/v3/projects/56c1d63584f34b3e882b2a3bdc1e47b2/users/8af309cb343b40e6834fca247f2d50f0/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:58.078065 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 854/1682] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:17:58.078065 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1f1ca-516b-466b-bc8b-488f09443357 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:58.098417 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1f1ca-516b-466b-bc8b-488f09443357 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:58.099968 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec7e01-650a-441d-acf8-6fe2d65635e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c1d63584f34b3e882b2a3bdc1e47b2, user_id=8af309cb343b40e6834fca247f2d50f0, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:58.103475 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec7e01-650a-441d-acf8-6fe2d65635e2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:58.112722 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dba94a-db6e-432e-b98b-6bd2bb62db4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:58.113988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dba94a-db6e-432e-b98b-6bd2bb62db4c admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:58.114319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dba94a-db6e-432e-b98b-6bd2bb62db4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:58.114659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dba94a-db6e-432e-b98b-6bd2bb62db4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:58.122799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dba94a-db6e-432e-b98b-6bd2bb62db4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:58.122799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dba94a-db6e-432e-b98b-6bd2bb62db4c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:58.183518 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 829/1683] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:17:57 2022] PUT /identity/v3/projects/56c1d63584f34b3e882b2a3bdc1e47b2/users/8af309cb343b40e6834fca247f2d50f0/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:58.187354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec7e01-650a-441d-acf8-6fe2d65635e2 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:58.236098 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 855/1684] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:17:58 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:58.238172 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b0fa3-08c5-4db9-b107-b0e00836b395 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:58.238468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b0fa3-08c5-4db9-b107-b0e00836b395 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:58.238747 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b0fa3-08c5-4db9-b107-b0e00836b395 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:58.247128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 856/1685] 10.222.0.65 () {54 vars in 912 bytes} [Tue Aug 9 19:17:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:17:58.248176 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b0fa3-08c5-4db9-b107-b0e00836b395 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:58.317736 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec7e01-650a-441d-acf8-6fe2d65635e2 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:58.442056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b0fa3-08c5-4db9-b107-b0e00836b395 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:58.461099 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dbcf2-f64f-4209-99ce-987baf718ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:58.461966 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dbcf2-f64f-4209-99ce-987baf718ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:58.462247 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dbcf2-f64f-4209-99ce-987baf718ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:58.463108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dbcf2-f64f-4209-99ce-987baf718ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:58.463988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37dbcf2-f64f-4209-99ce-987baf718ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:58.467528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37dbcf2-f64f-4209-99ce-987baf718ca9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:58.487147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28355f95-8728-4c0e-9607-af318356c0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:58.487147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28355f95-8728-4c0e-9607-af318356c0cf admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:58.487147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28355f95-8728-4c0e-9607-af318356c0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:58.487147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28355f95-8728-4c0e-9607-af318356c0cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:58.489011 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28355f95-8728-4c0e-9607-af318356c0cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:58.492849 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28355f95-8728-4c0e-9607-af318356c0cf admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:58.503737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 857/1686] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:58.504631 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dbcf2-f64f-4209-99ce-987baf718ca9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:58.540029 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37dbcf2-f64f-4209-99ce-987baf718ca9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:58.545168 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdafc7-053a-4261-9283-4e8ebd71bb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:58.546888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdafc7-053a-4261-9283-4e8ebd71bb9f admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:58.546888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdafc7-053a-4261-9283-4e8ebd71bb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:58.546888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdafc7-053a-4261-9283-4e8ebd71bb9f admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:58.547504 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdafc7-053a-4261-9283-4e8ebd71bb9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:58.549717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdafc7-053a-4261-9283-4e8ebd71bb9f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:58.578767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:58.632685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 830/1687] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:17:58 2022] POST /identity/v3/projects => generated 379 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:58.635488 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d7383-62c7-4553-aa98-4e2f7c948cf6 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:58.636899 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d7383-62c7-4553-aa98-4e2f7c948cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:58.637501 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d7383-62c7-4553-aa98-4e2f7c948cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:58.655733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:58.698824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-908d7383-62c7-4553-aa98-4e2f7c948cf6 None None] MFA Rules not processed for user `a62d954163ca4bf298f461b4d253269e`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:58.700515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 858/1688] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:17:58 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:58.702003 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdafc7-053a-4261-9283-4e8ebd71bb9f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:58.708720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-908d7383-62c7-4553-aa98-4e2f7c948cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:58.751789 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdafc7-053a-4261-9283-4e8ebd71bb9f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:58.807174 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 831/1689] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Aug 9 19:17:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:58.808223 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d7383-62c7-4553-aa98-4e2f7c948cf6 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:58.871861 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbc444-776f-4e68-a60f-6d271bc44a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:58.873043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbc444-776f-4e68-a60f-6d271bc44a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:58.873534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbc444-776f-4e68-a60f-6d271bc44a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:58.874002 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbc444-776f-4e68-a60f-6d271bc44a23 admin admin] PATH_INFO: `/v3/projects/56c1d63584f34b3e882b2a3bdc1e47b2/users/8af309cb343b40e6834fca247f2d50f0/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:58.877977 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbc444-776f-4e68-a60f-6d271bc44a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c1d63584f34b3e882b2a3bdc1e47b2, user_id=8af309cb343b40e6834fca247f2d50f0, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:58.901599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbc444-776f-4e68-a60f-6d271bc44a23 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:58.904946 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d7383-62c7-4553-aa98-4e2f7c948cf6 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:58.914024 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46c166-0450-47ea-9229-62596edee215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:58.914811 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46c166-0450-47ea-9229-62596edee215 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:58.915132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46c166-0450-47ea-9229-62596edee215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:58.915412 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46c166-0450-47ea-9229-62596edee215 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:58.916059 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46c166-0450-47ea-9229-62596edee215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:58.921031 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46c166-0450-47ea-9229-62596edee215 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:58.926521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 859/1690] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:17:58 2022] PUT /identity/v3/projects/56c1d63584f34b3e882b2a3bdc1e47b2/users/8af309cb343b40e6834fca247f2d50f0/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:58.927809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbc444-776f-4e68-a60f-6d271bc44a23 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:59.019012 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 832/1691] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:17:58 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:17:59.020125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46c166-0450-47ea-9229-62596edee215 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:59.047134 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46c166-0450-47ea-9229-62596edee215 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:59.076885 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbc444-776f-4e68-a60f-6d271bc44a23 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:59.089047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc64c9-3dcf-43f8-b356-7cd1a1032504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:59.091891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc64c9-3dcf-43f8-b356-7cd1a1032504 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:59.091891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc64c9-3dcf-43f8-b356-7cd1a1032504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:59.091891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc64c9-3dcf-43f8-b356-7cd1a1032504 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:59.091891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc64c9-3dcf-43f8-b356-7cd1a1032504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:59.094429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc64c9-3dcf-43f8-b356-7cd1a1032504 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:59.134978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 860/1692] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:59.137153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987bc3f-ea5d-424e-a172-5fcffbd44eda None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:59.137153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987bc3f-ea5d-424e-a172-5fcffbd44eda None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:59.137153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987bc3f-ea5d-424e-a172-5fcffbd44eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:59.199216 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4987bc3f-ea5d-424e-a172-5fcffbd44eda None None] MFA Rules not processed for user `8af309cb343b40e6834fca247f2d50f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:17:59.200785 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4987bc3f-ea5d-424e-a172-5fcffbd44eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:59.213137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7b30b-64c7-4407-b0d2-148578527bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:59.213876 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7b30b-64c7-4407-b0d2-148578527bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:59.214097 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7b30b-64c7-4407-b0d2-148578527bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:59.214365 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7b30b-64c7-4407-b0d2-148578527bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:59.223697 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7b30b-64c7-4407-b0d2-148578527bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:59.227487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7b30b-64c7-4407-b0d2-148578527bf3 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:59.240978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 833/1693] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:17:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:17:59.241971 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7b30b-64c7-4407-b0d2-148578527bf3 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:59.267516 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7b30b-64c7-4407-b0d2-148578527bf3 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:59.273929 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f4447-100f-4353-ae86-819f16e1fe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:59.274890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f4447-100f-4353-ae86-819f16e1fe66 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:59.275500 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f4447-100f-4353-ae86-819f16e1fe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:59.276140 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f4447-100f-4353-ae86-819f16e1fe66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:59.276986 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f4447-100f-4353-ae86-819f16e1fe66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:59.279415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f4447-100f-4353-ae86-819f16e1fe66 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:59.300961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 834/1694] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:59.302682 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f4447-100f-4353-ae86-819f16e1fe66 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:59.305875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3f1f4447-100f-4353-ae86-819f16e1fe66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:59.328356 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f4447-100f-4353-ae86-819f16e1fe66 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:59.346678 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3f236-2694-4047-9129-7fe02f73d346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:59.348407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3f236-2694-4047-9129-7fe02f73d346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:59.348694 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3f236-2694-4047-9129-7fe02f73d346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:59.348969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3f236-2694-4047-9129-7fe02f73d346 admin admin] PATH_INFO: `/v3/projects/dee867efbca142908e7c8ad5d0e0f04b` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:59.351006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3f236-2694-4047-9129-7fe02f73d346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dee867efbca142908e7c8ad5d0e0f04b)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:59.353203 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3f236-2694-4047-9129-7fe02f73d346 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:59.398571 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 861/1695] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:17:59 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:17:59.409855 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987bc3f-ea5d-424e-a172-5fcffbd44eda None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:59.413287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:59.444613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987bc3f-ea5d-424e-a172-5fcffbd44eda None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:59.456507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08599b-8d21-476a-85ca-6f45253cf0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:59.459851 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08599b-8d21-476a-85ca-6f45253cf0fd admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:59.460793 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08599b-8d21-476a-85ca-6f45253cf0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:59.461220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08599b-8d21-476a-85ca-6f45253cf0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:59.462736 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08599b-8d21-476a-85ca-6f45253cf0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:59.467563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08599b-8d21-476a-85ca-6f45253cf0fd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:59.510821 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 862/1696] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:59.515233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08599b-8d21-476a-85ca-6f45253cf0fd admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:59.547334 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08599b-8d21-476a-85ca-6f45253cf0fd admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:59.581139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-20d3f236-2694-4047-9129-7fe02f73d346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dee867efbca142908e7c8ad5d0e0f04b', 'request_id': 'req-20d3f236-2694-4047-9129-7fe02f73d346'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:59.599742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-20d3f236-2694-4047-9129-7fe02f73d346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dee867efbca142908e7c8ad5d0e0f04b', 'request_id': 'req-20d3f236-2694-4047-9129-7fe02f73d346'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:59.607871 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:59.688938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042be6e-9c75-4ca9-b492-d6ecbd4c6115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:59.689596 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042be6e-9c75-4ca9-b492-d6ecbd4c6115 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:59.690544 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042be6e-9c75-4ca9-b492-d6ecbd4c6115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:59.691339 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042be6e-9c75-4ca9-b492-d6ecbd4c6115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:59.692206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042be6e-9c75-4ca9-b492-d6ecbd4c6115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:59.694386 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042be6e-9c75-4ca9-b492-d6ecbd4c6115 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:59.712872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-20d3f236-2694-4047-9129-7fe02f73d346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dee867efbca142908e7c8ad5d0e0f04b', 'request_id': 'req-20d3f236-2694-4047-9129-7fe02f73d346'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:59.720056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 863/1697] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:17:59.721427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042be6e-9c75-4ca9-b492-d6ecbd4c6115 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:59.725786 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7042be6e-9c75-4ca9-b492-d6ecbd4c6115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:59.741235 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-20d3f236-2694-4047-9129-7fe02f73d346 admin admin] The token cache is being invalidate because project dee867efbca142908e7c8ad5d0e0f04b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:17:59.741883 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-20d3f236-2694-4047-9129-7fe02f73d346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:59.743420 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-20d3f236-2694-4047-9129-7fe02f73d346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:17:59.751137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 835/1698] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:17:59 2022] DELETE /identity/v3/projects/dee867efbca142908e7c8ad5d0e0f04b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:59.752306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3f236-2694-4047-9129-7fe02f73d346 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:59.756745 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-20d3f236-2694-4047-9129-7fe02f73d346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:59.788944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3f236-2694-4047-9129-7fe02f73d346 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:59.801757 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef81ac-cc96-4557-82e5-cecf991b0c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:59.802677 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef81ac-cc96-4557-82e5-cecf991b0c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:59.803222 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef81ac-cc96-4557-82e5-cecf991b0c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:59.804259 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef81ac-cc96-4557-82e5-cecf991b0c36 admin admin] PATH_INFO: `/v3/projects/222808ef895d48f99d1ffceb9ff9f3f4/users/a6c3a6581b774a54ba42c37f81d33bf5/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:59.837564 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef81ac-cc96-4557-82e5-cecf991b0c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=222808ef895d48f99d1ffceb9ff9f3f4, user_id=a6c3a6581b774a54ba42c37f81d33bf5, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:59.840345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef81ac-cc96-4557-82e5-cecf991b0c36 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:17:59.857117 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042be6e-9c75-4ca9-b492-d6ecbd4c6115 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:17:59.861024 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301632d-aa3a-47bc-9344-6e0cd8a0ee20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:17:59.861725 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301632d-aa3a-47bc-9344-6e0cd8a0ee20 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:17:59.862367 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301632d-aa3a-47bc-9344-6e0cd8a0ee20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:17:59.862643 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301632d-aa3a-47bc-9344-6e0cd8a0ee20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:17:59.865081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0301632d-aa3a-47bc-9344-6e0cd8a0ee20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:59.922093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 836/1699] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:17:59 2022] PUT /identity/v3/projects/222808ef895d48f99d1ffceb9ff9f3f4/users/a6c3a6581b774a54ba42c37f81d33bf5/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:17:59.923236 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef81ac-cc96-4557-82e5-cecf991b0c36 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:17:59.925860 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7eef81ac-cc96-4557-82e5-cecf991b0c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:17:59.976466 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301632d-aa3a-47bc-9344-6e0cd8a0ee20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:17:59.981823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301632d-aa3a-47bc-9344-6e0cd8a0ee20 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:00.001335 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 864/1700] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:17:59 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:00.003519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90de03d-1d97-416e-95b9-e0aa2cfeabb5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:00.003817 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90de03d-1d97-416e-95b9-e0aa2cfeabb5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:00.004095 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90de03d-1d97-416e-95b9-e0aa2cfeabb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:00.027015 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef81ac-cc96-4557-82e5-cecf991b0c36 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:00.046891 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31e8c2-2f46-418b-a3ea-239a111954f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:00.047935 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31e8c2-2f46-418b-a3ea-239a111954f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:00.047935 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31e8c2-2f46-418b-a3ea-239a111954f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:00.048173 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31e8c2-2f46-418b-a3ea-239a111954f0 admin admin] PATH_INFO: `/v3/projects/e83ddf5e7d8f4cef8efd07f4b8342610/users/1ba27aee523b4aeda3d6f081ba2f6545/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:00.057125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d90de03d-1d97-416e-95b9-e0aa2cfeabb5 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:00.059684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d90de03d-1d97-416e-95b9-e0aa2cfeabb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:00.073186 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:00.083295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31e8c2-2f46-418b-a3ea-239a111954f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83ddf5e7d8f4cef8efd07f4b8342610, user_id=1ba27aee523b4aeda3d6f081ba2f6545, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:00.086471 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 865/1701] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:00.087349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31e8c2-2f46-418b-a3ea-239a111954f0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:00.092008 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50a532-3cc4-4ebe-b105-6861b7c207b8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:00.092920 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50a532-3cc4-4ebe-b105-6861b7c207b8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:00.094180 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50a532-3cc4-4ebe-b105-6861b7c207b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:00.166329 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 837/1702] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:17:59 2022] PUT /identity/v3/projects/e83ddf5e7d8f4cef8efd07f4b8342610/users/1ba27aee523b4aeda3d6f081ba2f6545/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:00.167656 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa5035-3c96-4353-806f-abbea61a30da None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:00.167949 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa5035-3c96-4353-806f-abbea61a30da None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:00.168349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa5035-3c96-4353-806f-abbea61a30da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:00.205870 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8e50a532-3cc4-4ebe-b105-6861b7c207b8 None None] MFA Rules not processed for user `57a4a9f362d948ebaac0cae4a51dbf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:00.207429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8e50a532-3cc4-4ebe-b105-6861b7c207b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:00.256942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-feaa5035-3c96-4353-806f-abbea61a30da None None] MFA Rules not processed for user `217925e91ea74413b2cb2052bbb523fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:00.258365 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-feaa5035-3c96-4353-806f-abbea61a30da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:00.273394 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:00.393048 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 866/1703] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:00.393048 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cf3b3-b4f8-4fe2-9743-b20c30af2f1e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:00.393048 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cf3b3-b4f8-4fe2-9743-b20c30af2f1e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:00.393048 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cf3b3-b4f8-4fe2-9743-b20c30af2f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:00.431725 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 838/1704] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:00.436803 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e83cf3b3-b4f8-4fe2-9743-b20c30af2f1e None None] MFA Rules not processed for user `a6c3a6581b774a54ba42c37f81d33bf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:00.438281 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e83cf3b3-b4f8-4fe2-9743-b20c30af2f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:00.439360 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719baf7-e5cc-44ff-b04b-0df7c6a21bb5 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:00.439962 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719baf7-e5cc-44ff-b04b-0df7c6a21bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:00.440382 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719baf7-e5cc-44ff-b04b-0df7c6a21bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:00.466064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-d719baf7-e5cc-44ff-b04b-0df7c6a21bb5 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:00.467737 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d719baf7-e5cc-44ff-b04b-0df7c6a21bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:00.556790 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 867/1705] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:00.557874 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 839/1706] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:00.559995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f0455-f217-4d9c-9416-d1d50b0db145 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:00.560433 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f0455-f217-4d9c-9416-d1d50b0db145 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:00.560719 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f0455-f217-4d9c-9416-d1d50b0db145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:00.561311 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84371846-9b96-4f80-84e2-0fe3b9e0a023 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:00.562686 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84371846-9b96-4f80-84e2-0fe3b9e0a023 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:00.563423 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84371846-9b96-4f80-84e2-0fe3b9e0a023 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:00.565393 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 840/1707] 10.222.0.65 () {54 vars in 961 bytes} [Tue Aug 9 19:18:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:18:00.567209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84371846-9b96-4f80-84e2-0fe3b9e0a023 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:00.578315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-84371846-9b96-4f80-84e2-0fe3b9e0a023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:00.601032 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84371846-9b96-4f80-84e2-0fe3b9e0a023 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:00.606636 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3f5f0455-f217-4d9c-9416-d1d50b0db145 None None] MFA Rules not processed for user `1ba27aee523b4aeda3d6f081ba2f6545`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:00.608336 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3f5f0455-f217-4d9c-9416-d1d50b0db145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:00.610238 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cee7a-4c3a-4d8b-bdbb-4e1b61434895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:00.611143 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cee7a-4c3a-4d8b-bdbb-4e1b61434895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:00.616190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cee7a-4c3a-4d8b-bdbb-4e1b61434895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:00.616190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cee7a-4c3a-4d8b-bdbb-4e1b61434895 admin admin] PATH_INFO: `/v3/users/3aeccb0f5a164e329ff85625a921cc7f` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:00.616190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cee7a-4c3a-4d8b-bdbb-4e1b61434895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aeccb0f5a164e329ff85625a921cc7f)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:00.616190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cee7a-4c3a-4d8b-bdbb-4e1b61434895 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:00.719911 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 868/1708] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:00.721448 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61c9c1-8abd-4a18-bb7c-0fcb37806bf1 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:00.722117 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61c9c1-8abd-4a18-bb7c-0fcb37806bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:00.722699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61c9c1-8abd-4a18-bb7c-0fcb37806bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:00.745086 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-cb61c9c1-8abd-4a18-bb7c-0fcb37806bf1 None None] MFA Rules not processed for user `d5f9fe48bb8f44f997e36e0e320bfc5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:00.746783 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cb61c9c1-8abd-4a18-bb7c-0fcb37806bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:00.814502 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:00.854289 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 869/1709] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:00.855174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61c9c1-8abd-4a18-bb7c-0fcb37806bf1 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:00.856678 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cb61c9c1-8abd-4a18-bb7c-0fcb37806bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:00.905127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-903cee7a-4c3a-4d8b-bdbb-4e1b61434895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aeccb0f5a164e329ff85625a921cc7f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:00.920748 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-903cee7a-4c3a-4d8b-bdbb-4e1b61434895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aeccb0f5a164e329ff85625a921cc7f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:00.922765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-903cee7a-4c3a-4d8b-bdbb-4e1b61434895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aeccb0f5a164e329ff85625a921cc7f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:00.924947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-903cee7a-4c3a-4d8b-bdbb-4e1b61434895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aeccb0f5a164e329ff85625a921cc7f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:01.037799 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-903cee7a-4c3a-4d8b-bdbb-4e1b61434895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aeccb0f5a164e329ff85625a921cc7f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:01.054864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61c9c1-8abd-4a18-bb7c-0fcb37806bf1 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:01.062374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecbee1-b1a8-4d57-9324-70ca616929d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:01.063222 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecbee1-b1a8-4d57-9324-70ca616929d3 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:01.063742 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecbee1-b1a8-4d57-9324-70ca616929d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:01.064249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecbee1-b1a8-4d57-9324-70ca616929d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:01.067056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:01.080265 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c9ecbee1-b1a8-4d57-9324-70ca616929d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:01.098437 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecbee1-b1a8-4d57-9324-70ca616929d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:01.100516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecbee1-b1a8-4d57-9324-70ca616929d3 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:01.124463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 841/1710] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:00 2022] DELETE /identity/v3/users/3aeccb0f5a164e329ff85625a921cc7f => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:01.147159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98bd8c-c4ea-4c37-8f4c-090d90a42fc7 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:01.147771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:01.150086 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98bd8c-c4ea-4c37-8f4c-090d90a42fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:01.150427 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98bd8c-c4ea-4c37-8f4c-090d90a42fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:01.156748 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 870/1711] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:01.167888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecbee1-b1a8-4d57-9324-70ca616929d3 service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:01.170408 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c9ecbee1-b1a8-4d57-9324-70ca616929d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:01.203216 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecbee1-b1a8-4d57-9324-70ca616929d3 service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:01.252092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9b98bd8c-c4ea-4c37-8f4c-090d90a42fc7 None None] MFA Rules not processed for user `217925e91ea74413b2cb2052bbb523fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:01.254716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9b98bd8c-c4ea-4c37-8f4c-090d90a42fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:01.370680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05779b10-a336-4f30-a432-37472a03ce18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:01.371720 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05779b10-a336-4f30-a432-37472a03ce18 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:01.372234 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05779b10-a336-4f30-a432-37472a03ce18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:01.372704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05779b10-a336-4f30-a432-37472a03ce18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:01.373593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05779b10-a336-4f30-a432-37472a03ce18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:01.376539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05779b10-a336-4f30-a432-37472a03ce18 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:01.448027 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 842/1712] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:01.473284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98bd8c-c4ea-4c37-8f4c-090d90a42fc7 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:01.474989 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9b98bd8c-c4ea-4c37-8f4c-090d90a42fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:01.503439 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98bd8c-c4ea-4c37-8f4c-090d90a42fc7 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:01.504881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ee4d2-5dae-42e8-b348-689e06e2d39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:01.506139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ee4d2-5dae-42e8-b348-689e06e2d39f admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:01.506139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ee4d2-5dae-42e8-b348-689e06e2d39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:01.506139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ee4d2-5dae-42e8-b348-689e06e2d39f admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:01.506751 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ee4d2-5dae-42e8-b348-689e06e2d39f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:18:01.507505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ee4d2-5dae-42e8-b348-689e06e2d39f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:01.508818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ee4d2-5dae-42e8-b348-689e06e2d39f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:01.526549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 843/1713] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:18:01.527530 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dbadf-dd5f-478c-9d2a-ccdada952902 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:01.527775 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dbadf-dd5f-478c-9d2a-ccdada952902 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:01.528121 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572dbadf-dd5f-478c-9d2a-ccdada952902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:01.561579 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 871/1714] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:01 2022] POST /identity/v3/projects => generated 385 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:01.564671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05779b10-a336-4f30-a432-37472a03ce18 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:01.570459 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-05779b10-a336-4f30-a432-37472a03ce18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:01.585367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-572dbadf-dd5f-478c-9d2a-ccdada952902 None None] MFA Rules not processed for user `c6172f0733384291992624ef6a527ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:01.586625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-572dbadf-dd5f-478c-9d2a-ccdada952902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:01.719207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:01.726223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05779b10-a336-4f30-a432-37472a03ce18 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:01.744903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2e449-a669-4fe3-a45b-6802bfade148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:01.746215 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2e449-a669-4fe3-a45b-6802bfade148 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:01.746610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2e449-a669-4fe3-a45b-6802bfade148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:01.746988 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 844/1715] 10.222.0.65 () {58 vars in 1058 bytes} [Tue Aug 9 19:18:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:01.749085 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2e449-a669-4fe3-a45b-6802bfade148 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:01.750600 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2e449-a669-4fe3-a45b-6802bfade148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:01.751023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46f5a0-de31-4417-80e0-1ba67d8c31b8 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:01.752189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46f5a0-de31-4417-80e0-1ba67d8c31b8 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:01.754295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46f5a0-de31-4417-80e0-1ba67d8c31b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:01.758194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2e449-a669-4fe3-a45b-6802bfade148 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:01.793291 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4c46f5a0-de31-4417-80e0-1ba67d8c31b8 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:01.794589 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4c46f5a0-de31-4417-80e0-1ba67d8c31b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:01.808110 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 845/1716] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:01.809353 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46f5a0-de31-4417-80e0-1ba67d8c31b8 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:01.810788 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4c46f5a0-de31-4417-80e0-1ba67d8c31b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:01.925656 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 872/1717] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:01 2022] POST /identity/v3/projects => generated 379 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:01.926860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2e449-a669-4fe3-a45b-6802bfade148 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:01.933897 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:01.939195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46f5a0-de31-4417-80e0-1ba67d8c31b8 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:02.046423 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a046b8-273a-4817-92fd-99eb6dfd12d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:02.047374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a046b8-273a-4817-92fd-99eb6dfd12d7 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:02.047760 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a046b8-273a-4817-92fd-99eb6dfd12d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:02.048063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a046b8-273a-4817-92fd-99eb6dfd12d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:02.050738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-57a046b8-273a-4817-92fd-99eb6dfd12d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:02.072325 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2e449-a669-4fe3-a45b-6802bfade148 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:02.084177 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10147ee2-cf80-404a-8b31-3d0fc1c7d0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:02.084955 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10147ee2-cf80-404a-8b31-3d0fc1c7d0ab admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:02.085348 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10147ee2-cf80-404a-8b31-3d0fc1c7d0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:02.085720 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10147ee2-cf80-404a-8b31-3d0fc1c7d0ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:02.086627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10147ee2-cf80-404a-8b31-3d0fc1c7d0ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:02.089246 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10147ee2-cf80-404a-8b31-3d0fc1c7d0ab admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:02.129428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a046b8-273a-4817-92fd-99eb6dfd12d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:02.131238 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a046b8-273a-4817-92fd-99eb6dfd12d7 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:02.142373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 846/1718] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:02.143792 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a046b8-273a-4817-92fd-99eb6dfd12d7 service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:02.154922 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a046b8-273a-4817-92fd-99eb6dfd12d7 service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:02.163835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38b360-e57c-43cc-9a03-f16fa809746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:02.164471 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38b360-e57c-43cc-9a03-f16fa809746e admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:02.164754 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38b360-e57c-43cc-9a03-f16fa809746e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:02.165033 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38b360-e57c-43cc-9a03-f16fa809746e admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:02.165759 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38b360-e57c-43cc-9a03-f16fa809746e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:02.167807 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38b360-e57c-43cc-9a03-f16fa809746e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:02.255437 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 873/1719] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:01 2022] POST /identity/v3/projects => generated 371 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:02.260034 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10147ee2-cf80-404a-8b31-3d0fc1c7d0ab admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:02.284018 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 847/1720] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:02 2022] POST /identity/v3/users => generated 299 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:02.285582 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38b360-e57c-43cc-9a03-f16fa809746e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:02.287930 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6d38b360-e57c-43cc-9a03-f16fa809746e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:02.364805 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10147ee2-cf80-404a-8b31-3d0fc1c7d0ab admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:02.372215 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84bae6-95ed-459b-a420-4b5a035487e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6172f0733384291992624ef6a527ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:02.373041 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84bae6-95ed-459b-a420-4b5a035487e7 service placement] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:02.373409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84bae6-95ed-459b-a420-4b5a035487e7 service placement] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:02.374400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84bae6-95ed-459b-a420-4b5a035487e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:02.376564 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1e84bae6-95ed-459b-a420-4b5a035487e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:02.394565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84bae6-95ed-459b-a420-4b5a035487e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:02.399610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84bae6-95ed-459b-a420-4b5a035487e7 service placement] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:02.399975 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38b360-e57c-43cc-9a03-f16fa809746e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:02.414019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 874/1721] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:02.415197 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84bae6-95ed-459b-a420-4b5a035487e7 service placement] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:02.499725 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863280f1-d090-4cf1-9a40-956fb742e5ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:02.508099 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863280f1-d090-4cf1-9a40-956fb742e5ea service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:02.517330 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863280f1-d090-4cf1-9a40-956fb742e5ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:02.518092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863280f1-d090-4cf1-9a40-956fb742e5ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:02.540677 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84bae6-95ed-459b-a420-4b5a035487e7 service placement] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:02.560035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf17b5-69b7-4233-9013-1952d2653833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:02.561396 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf17b5-69b7-4233-9013-1952d2653833 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:02.561869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf17b5-69b7-4233-9013-1952d2653833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:02.563043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf17b5-69b7-4233-9013-1952d2653833 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:02.563835 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf17b5-69b7-4233-9013-1952d2653833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:02.566134 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf17b5-69b7-4233-9013-1952d2653833 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:02.609162 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:02.679387 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 875/1722] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:02 2022] POST /identity/v3/users => generated 296 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:02.681213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42ef56-f983-4052-8052-990f2376b736 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:02.685473 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42ef56-f983-4052-8052-990f2376b736 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:02.685473 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42ef56-f983-4052-8052-990f2376b736 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:02.685473 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 876/1723] 10.222.0.65 () {54 vars in 912 bytes} [Tue Aug 9 19:18:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:18:02.685473 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42ef56-f983-4052-8052-990f2376b736 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:02.686341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863280f1-d090-4cf1-9a40-956fb742e5ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:02.687814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863280f1-d090-4cf1-9a40-956fb742e5ea service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:02.723632 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42ef56-f983-4052-8052-990f2376b736 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:02.725425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 848/1724] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:02.728209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863280f1-d090-4cf1-9a40-956fb742e5ea service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:02.733782 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1978c-4051-459e-9008-00a5e671cc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:02.739426 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1978c-4051-459e-9008-00a5e671cc54 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:02.739718 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1978c-4051-459e-9008-00a5e671cc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:02.739997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f1978c-4051-459e-9008-00a5e671cc54 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:02.740647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1978c-4051-459e-9008-00a5e671cc54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:02.747263 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f1978c-4051-459e-9008-00a5e671cc54 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:02.750651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863280f1-d090-4cf1-9a40-956fb742e5ea service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:02.768277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453596ab-8dfa-40ef-850b-074c15cc08ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:02.772360 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453596ab-8dfa-40ef-850b-074c15cc08ef admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:02.772360 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453596ab-8dfa-40ef-850b-074c15cc08ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:02.772360 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453596ab-8dfa-40ef-850b-074c15cc08ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:02.772360 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453596ab-8dfa-40ef-850b-074c15cc08ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:02.773887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453596ab-8dfa-40ef-850b-074c15cc08ef admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:02.797207 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 849/1725] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:02.797207 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453596ab-8dfa-40ef-850b-074c15cc08ef admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:02.817059 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453596ab-8dfa-40ef-850b-074c15cc08ef admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:02.823232 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bc1f1-484a-4e58-aa42-1820a591d639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:02.824182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bc1f1-484a-4e58-aa42-1820a591d639 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:02.824611 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bc1f1-484a-4e58-aa42-1820a591d639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:02.835587 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bc1f1-484a-4e58-aa42-1820a591d639 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:02.836119 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bc1f1-484a-4e58-aa42-1820a591d639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:02.840976 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bc1f1-484a-4e58-aa42-1820a591d639 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:02.859742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 850/1726] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:02.859742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7af91e-073f-4186-98f1-d523fd149d8e None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:02.859742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7af91e-073f-4186-98f1-d523fd149d8e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:02.860034 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7af91e-073f-4186-98f1-d523fd149d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:02.885839 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3e7af91e-073f-4186-98f1-d523fd149d8e None None] MFA Rules not processed for user `a62d954163ca4bf298f461b4d253269e`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:02.887170 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3e7af91e-073f-4186-98f1-d523fd149d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:02.891166 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 877/1727] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:02 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:02.892172 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1978c-4051-459e-9008-00a5e671cc54 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:02.901880 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 851/1728] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Aug 9 19:18:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:02.903385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7af91e-073f-4186-98f1-d523fd149d8e None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:02.913439 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f1978c-4051-459e-9008-00a5e671cc54 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:02.924037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7af91e-073f-4186-98f1-d523fd149d8e None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:02.929234 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b01738-50f8-419e-aafb-43097545c6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:02.931266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b01738-50f8-419e-aafb-43097545c6cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:02.931719 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b01738-50f8-419e-aafb-43097545c6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:02.932143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b01738-50f8-419e-aafb-43097545c6cc admin admin] PATH_INFO: `/v3/projects/7250d124bc0a41119a3c03e10640c69e/users/1be4b3d5678b47f7bf85a6958b12f8eb/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:02.951203 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65702aa-e14f-4733-a90b-5cc37846b5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:02.953664 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65702aa-e14f-4733-a90b-5cc37846b5a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:02.954846 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65702aa-e14f-4733-a90b-5cc37846b5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:02.955467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65702aa-e14f-4733-a90b-5cc37846b5a8 admin admin] PATH_INFO: `/v3/projects/f1a7f0ce873048a6a4b60c8989540a73/users/156af3d6752b4e319eadcfe4ca515145/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:02.980671 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65702aa-e14f-4733-a90b-5cc37846b5a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a7f0ce873048a6a4b60c8989540a73, user_id=156af3d6752b4e319eadcfe4ca515145, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:02.980857 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b01738-50f8-419e-aafb-43097545c6cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7250d124bc0a41119a3c03e10640c69e, user_id=1be4b3d5678b47f7bf85a6958b12f8eb, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:02.983858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b01738-50f8-419e-aafb-43097545c6cc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:02.983978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65702aa-e14f-4733-a90b-5cc37846b5a8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:03.096153 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 852/1729] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:02 2022] PUT /identity/v3/projects/f1a7f0ce873048a6a4b60c8989540a73/users/156af3d6752b4e319eadcfe4ca515145/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:03.097808 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65702aa-e14f-4733-a90b-5cc37846b5a8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:03.102213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 878/1730] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:02 2022] PUT /identity/v3/projects/7250d124bc0a41119a3c03e10640c69e/users/1be4b3d5678b47f7bf85a6958b12f8eb/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:03.103217 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b01738-50f8-419e-aafb-43097545c6cc admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:03.181002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:03.252708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b01738-50f8-419e-aafb-43097545c6cc admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:03.294490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dadb5f-3aae-4526-956e-c7dd1a05debf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:03.295126 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dadb5f-3aae-4526-956e-c7dd1a05debf service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:03.295972 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dadb5f-3aae-4526-956e-c7dd1a05debf service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:03.296247 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dadb5f-3aae-4526-956e-c7dd1a05debf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:03.326965 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65702aa-e14f-4733-a90b-5cc37846b5a8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:03.333293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dadb5f-3aae-4526-956e-c7dd1a05debf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:03.339332 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dadb5f-3aae-4526-956e-c7dd1a05debf service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:03.369301 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 879/1731] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:03.372100 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dadb5f-3aae-4526-956e-c7dd1a05debf service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:03.488509 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798e884-f5ab-4e14-bb9d-df6c658b8132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:03.489134 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798e884-f5ab-4e14-bb9d-df6c658b8132 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:03.489486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798e884-f5ab-4e14-bb9d-df6c658b8132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:03.489768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798e884-f5ab-4e14-bb9d-df6c658b8132 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:03.491264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798e884-f5ab-4e14-bb9d-df6c658b8132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:03.494459 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798e884-f5ab-4e14-bb9d-df6c658b8132 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:03.516075 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 853/1732] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:03.521492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798e884-f5ab-4e14-bb9d-df6c658b8132 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:03.530605 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dadb5f-3aae-4526-956e-c7dd1a05debf service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:03.539766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc430aa3-c751-4061-b796-21ce5c7ebe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:03.541442 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc430aa3-c751-4061-b796-21ce5c7ebe0e admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:03.541925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc430aa3-c751-4061-b796-21ce5c7ebe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:03.543513 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc430aa3-c751-4061-b796-21ce5c7ebe0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:03.544509 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc430aa3-c751-4061-b796-21ce5c7ebe0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:03.545709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798e884-f5ab-4e14-bb9d-df6c658b8132 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:03.552444 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc430aa3-c751-4061-b796-21ce5c7ebe0e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:03.562961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185648f5-4967-43bb-8c0c-983dbdca82e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:03.563866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185648f5-4967-43bb-8c0c-983dbdca82e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:03.566147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185648f5-4967-43bb-8c0c-983dbdca82e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:03.568536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185648f5-4967-43bb-8c0c-983dbdca82e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:03.568916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185648f5-4967-43bb-8c0c-983dbdca82e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:03.573065 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185648f5-4967-43bb-8c0c-983dbdca82e8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:03.584199 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 880/1733] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:03.586388 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc430aa3-c751-4061-b796-21ce5c7ebe0e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:03.617054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 854/1734] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:03.617399 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185648f5-4967-43bb-8c0c-983dbdca82e8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:03.626659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc430aa3-c751-4061-b796-21ce5c7ebe0e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:03.641614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c22c1-4a1b-441a-9441-ced39473f9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:03.646025 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c22c1-4a1b-441a-9441-ced39473f9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:03.646318 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c22c1-4a1b-441a-9441-ced39473f9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:03.646594 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c22c1-4a1b-441a-9441-ced39473f9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:03.647256 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c22c1-4a1b-441a-9441-ced39473f9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:03.648867 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c22c1-4a1b-441a-9441-ced39473f9d7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:03.654665 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185648f5-4967-43bb-8c0c-983dbdca82e8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:03.673567 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53434d29-a924-4edd-a7d8-b39d82fe0e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:03.674254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53434d29-a924-4edd-a7d8-b39d82fe0e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:03.674529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53434d29-a924-4edd-a7d8-b39d82fe0e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:03.674848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53434d29-a924-4edd-a7d8-b39d82fe0e96 admin admin] PATH_INFO: `/v3/projects/f1a7f0ce873048a6a4b60c8989540a73/users/156af3d6752b4e319eadcfe4ca515145/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:03.679172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53434d29-a924-4edd-a7d8-b39d82fe0e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a7f0ce873048a6a4b60c8989540a73, user_id=156af3d6752b4e319eadcfe4ca515145, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:03.688478 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 881/1735] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:03.690192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53434d29-a924-4edd-a7d8-b39d82fe0e96 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:03.691285 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c22c1-4a1b-441a-9441-ced39473f9d7 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:03.731727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c22c1-4a1b-441a-9441-ced39473f9d7 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:03.735260 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 855/1736] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:03 2022] PUT /identity/v3/projects/f1a7f0ce873048a6a4b60c8989540a73/users/156af3d6752b4e319eadcfe4ca515145/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:03.736156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53434d29-a924-4edd-a7d8-b39d82fe0e96 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:03.806121 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:03.839319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:03.874886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676b000-6181-4c0b-9f28-7206d0e61e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:03.876382 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676b000-6181-4c0b-9f28-7206d0e61e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:03.876647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676b000-6181-4c0b-9f28-7206d0e61e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:03.876924 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676b000-6181-4c0b-9f28-7206d0e61e58 admin admin] PATH_INFO: `/v3/projects/7250d124bc0a41119a3c03e10640c69e/users/1be4b3d5678b47f7bf85a6958b12f8eb/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:03.881924 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676b000-6181-4c0b-9f28-7206d0e61e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7250d124bc0a41119a3c03e10640c69e, user_id=1be4b3d5678b47f7bf85a6958b12f8eb, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:03.884706 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676b000-6181-4c0b-9f28-7206d0e61e58 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:03.902985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53434d29-a924-4edd-a7d8-b39d82fe0e96 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:03.913261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 882/1737] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:03 2022] PUT /identity/v3/projects/7250d124bc0a41119a3c03e10640c69e/users/1be4b3d5678b47f7bf85a6958b12f8eb/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:03.913261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790a6c1-9d46-4fd5-bee0-8698335b673f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:03.913261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790a6c1-9d46-4fd5-bee0-8698335b673f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:03.913261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790a6c1-9d46-4fd5-bee0-8698335b673f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:03.964317 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2790a6c1-9d46-4fd5-bee0-8698335b673f None None] MFA Rules not processed for user `156af3d6752b4e319eadcfe4ca515145`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:03.965581 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2790a6c1-9d46-4fd5-bee0-8698335b673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:04.034963 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1742b-8bbe-45e9-80b6-595d6d71738a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:04.037068 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1742b-8bbe-45e9-80b6-595d6d71738a admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:04.038085 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1742b-8bbe-45e9-80b6-595d6d71738a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:04.038505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1742b-8bbe-45e9-80b6-595d6d71738a admin admin] PATH_INFO: `/v3/projects/ac65772ea7514462a14672420139e9ef/users/9d67074bb53a4a64901823c6d773e279/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:04.068535 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 883/1738] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:03 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:04.070807 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790a6c1-9d46-4fd5-bee0-8698335b673f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:04.072579 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2790a6c1-9d46-4fd5-bee0-8698335b673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:04.077117 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1742b-8bbe-45e9-80b6-595d6d71738a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac65772ea7514462a14672420139e9ef, user_id=9d67074bb53a4a64901823c6d773e279, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:04.083035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1742b-8bbe-45e9-80b6-595d6d71738a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:04.088646 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790a6c1-9d46-4fd5-bee0-8698335b673f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:04.094135 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186762bf-e30e-454c-bfe5-ff48e9b397c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:04.094869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186762bf-e30e-454c-bfe5-ff48e9b397c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:04.095150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186762bf-e30e-454c-bfe5-ff48e9b397c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:04.095539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186762bf-e30e-454c-bfe5-ff48e9b397c4 admin admin] PATH_INFO: `/v3/projects/c0cb859b8fc44a0e85bb5a3fe9cac86d` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:04.096692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186762bf-e30e-454c-bfe5-ff48e9b397c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0cb859b8fc44a0e85bb5a3fe9cac86d)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:04.099356 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186762bf-e30e-454c-bfe5-ff48e9b397c4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:04.183746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 856/1739] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:03 2022] PUT /identity/v3/projects/ac65772ea7514462a14672420139e9ef/users/9d67074bb53a4a64901823c6d773e279/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:04.190234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f58e-385c-4f83-82a4-901067f93f11 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:04.190234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f58e-385c-4f83-82a4-901067f93f11 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:04.190234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f58e-385c-4f83-82a4-901067f93f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:04.219286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c918f58e-385c-4f83-82a4-901067f93f11 None None] MFA Rules not processed for user `1be4b3d5678b47f7bf85a6958b12f8eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:04.223189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c918f58e-385c-4f83-82a4-901067f93f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:04.246342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-186762bf-e30e-454c-bfe5-ff48e9b397c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0cb859b8fc44a0e85bb5a3fe9cac86d', 'request_id': 'req-186762bf-e30e-454c-bfe5-ff48e9b397c4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:04.263500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-186762bf-e30e-454c-bfe5-ff48e9b397c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0cb859b8fc44a0e85bb5a3fe9cac86d', 'request_id': 'req-186762bf-e30e-454c-bfe5-ff48e9b397c4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:04.355868 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 857/1740] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:04.356920 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918f58e-385c-4f83-82a4-901067f93f11 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:04.358852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c918f58e-385c-4f83-82a4-901067f93f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:04.401819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-186762bf-e30e-454c-bfe5-ff48e9b397c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0cb859b8fc44a0e85bb5a3fe9cac86d', 'request_id': 'req-186762bf-e30e-454c-bfe5-ff48e9b397c4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:04.422378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-186762bf-e30e-454c-bfe5-ff48e9b397c4 admin admin] The token cache is being invalidate because project c0cb859b8fc44a0e85bb5a3fe9cac86d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:04.423581 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-186762bf-e30e-454c-bfe5-ff48e9b397c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:04.423848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-186762bf-e30e-454c-bfe5-ff48e9b397c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:04.426278 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 884/1741] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:04 2022] DELETE /identity/v3/projects/c0cb859b8fc44a0e85bb5a3fe9cac86d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:04.430716 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151a2ef-f14a-4d47-bf0c-e24f1b388236 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:04.431191 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151a2ef-f14a-4d47-bf0c-e24f1b388236 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:04.431483 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151a2ef-f14a-4d47-bf0c-e24f1b388236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:04.448594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918f58e-385c-4f83-82a4-901067f93f11 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:04.452648 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d630955-c6e9-49ce-ba25-26138af18bf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:04.453301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d630955-c6e9-49ce-ba25-26138af18bf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:04.453615 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d630955-c6e9-49ce-ba25-26138af18bf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:04.453892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d630955-c6e9-49ce-ba25-26138af18bf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:04.455693 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1d630955-c6e9-49ce-ba25-26138af18bf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:04.465569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a151a2ef-f14a-4d47-bf0c-e24f1b388236 None None] MFA Rules not processed for user `9d67074bb53a4a64901823c6d773e279`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:04.466964 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a151a2ef-f14a-4d47-bf0c-e24f1b388236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:04.505174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:04.588605 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 885/1742] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:04.590240 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151a2ef-f14a-4d47-bf0c-e24f1b388236 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:04.592045 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a151a2ef-f14a-4d47-bf0c-e24f1b388236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:04.606939 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151a2ef-f14a-4d47-bf0c-e24f1b388236 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:04.620440 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fa21d-ef1b-4a6d-af0c-98e39a285b5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:04.621626 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa21d-ef1b-4a6d-af0c-98e39a285b5e service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:04.622732 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa21d-ef1b-4a6d-af0c-98e39a285b5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:04.623361 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa21d-ef1b-4a6d-af0c-98e39a285b5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:04.629355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e00fa21d-ef1b-4a6d-af0c-98e39a285b5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:04.672836 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d630955-c6e9-49ce-ba25-26138af18bf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:04.674412 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d630955-c6e9-49ce-ba25-26138af18bf3 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:04.688609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 858/1743] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:04.689540 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d630955-c6e9-49ce-ba25-26138af18bf3 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:04.691034 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1d630955-c6e9-49ce-ba25-26138af18bf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:04.703107 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fa21d-ef1b-4a6d-af0c-98e39a285b5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:04.710883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fa21d-ef1b-4a6d-af0c-98e39a285b5e service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:04.747997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:04.789569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 886/1744] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:04.807593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fa21d-ef1b-4a6d-af0c-98e39a285b5e service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:04.822683 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e00fa21d-ef1b-4a6d-af0c-98e39a285b5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:04.896220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d630955-c6e9-49ce-ba25-26138af18bf3 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:04.902873 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1e779-f563-44ec-a801-a45ab190edfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:04.903877 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1e779-f563-44ec-a801-a45ab190edfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:04.904486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1e779-f563-44ec-a801-a45ab190edfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:04.904936 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1e779-f563-44ec-a801-a45ab190edfa admin admin] PATH_INFO: `/v3/users/8af309cb343b40e6834fca247f2d50f0` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:04.906384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1e779-f563-44ec-a801-a45ab190edfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8af309cb343b40e6834fca247f2d50f0)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:04.908775 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1e779-f563-44ec-a801-a45ab190edfa admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:05.053051 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fa21d-ef1b-4a6d-af0c-98e39a285b5e service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:05.075289 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dedf0-8ea7-4393-a4af-7db664885d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:05.080082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dedf0-8ea7-4393-a4af-7db664885d07 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:05.080458 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dedf0-8ea7-4393-a4af-7db664885d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:05.081364 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dedf0-8ea7-4393-a4af-7db664885d07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:05.098268 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dedf0-8ea7-4393-a4af-7db664885d07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:05.107815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6dedf0-8ea7-4393-a4af-7db664885d07 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:05.190076 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-03b1e779-f563-44ec-a801-a45ab190edfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8af309cb343b40e6834fca247f2d50f0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:05.197443 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-03b1e779-f563-44ec-a801-a45ab190edfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8af309cb343b40e6834fca247f2d50f0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:05.198516 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-03b1e779-f563-44ec-a801-a45ab190edfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8af309cb343b40e6834fca247f2d50f0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:05.199126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-03b1e779-f563-44ec-a801-a45ab190edfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8af309cb343b40e6834fca247f2d50f0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:05.269109 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 887/1745] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:04 2022] POST /identity/v3/projects => generated 373 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:05.272573 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dedf0-8ea7-4393-a4af-7db664885d07 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:05.274982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1d6dedf0-8ea7-4393-a4af-7db664885d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:05.305341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-03b1e779-f563-44ec-a801-a45ab190edfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8af309cb343b40e6834fca247f2d50f0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:05.336334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 859/1746] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:04 2022] DELETE /identity/v3/users/8af309cb343b40e6834fca247f2d50f0 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:05.337772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1e779-f563-44ec-a801-a45ab190edfa admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:05.340809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-03b1e779-f563-44ec-a801-a45ab190edfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:05.458927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1e779-f563-44ec-a801-a45ab190edfa admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:05.459909 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6dedf0-8ea7-4393-a4af-7db664885d07 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:05.465043 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446694e5-4992-42ba-82fc-7b945fa7df41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:05.466244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446694e5-4992-42ba-82fc-7b945fa7df41 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:05.467246 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446694e5-4992-42ba-82fc-7b945fa7df41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:05.468288 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446694e5-4992-42ba-82fc-7b945fa7df41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:05.470588 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-446694e5-4992-42ba-82fc-7b945fa7df41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:05.567433 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2b776-73c3-4916-bb96-fd5209b54434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:05.568197 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2b776-73c3-4916-bb96-fd5209b54434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:05.581833 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2b776-73c3-4916-bb96-fd5209b54434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:05.582305 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2b776-73c3-4916-bb96-fd5209b54434 admin admin] PATH_INFO: `/v3/users/a6c3a6581b774a54ba42c37f81d33bf5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:05.588372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2b776-73c3-4916-bb96-fd5209b54434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c3a6581b774a54ba42c37f81d33bf5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:05.590188 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2b776-73c3-4916-bb96-fd5209b54434 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:05.622205 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446694e5-4992-42ba-82fc-7b945fa7df41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:05.623728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446694e5-4992-42ba-82fc-7b945fa7df41 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:05.635294 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 860/1747] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:05.636107 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446694e5-4992-42ba-82fc-7b945fa7df41 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:05.637783 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-446694e5-4992-42ba-82fc-7b945fa7df41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:05.655961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446694e5-4992-42ba-82fc-7b945fa7df41 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:05.661442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c687125-6dd6-4527-9560-2e610c0d5c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:05.662090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c687125-6dd6-4527-9560-2e610c0d5c93 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:05.662369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c687125-6dd6-4527-9560-2e610c0d5c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:05.662640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c687125-6dd6-4527-9560-2e610c0d5c93 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:05.663424 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c687125-6dd6-4527-9560-2e610c0d5c93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:05.665348 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c687125-6dd6-4527-9560-2e610c0d5c93 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:05.781564 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 861/1748] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:05 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:05.783060 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029818c6-8bab-4dcb-91ce-8a3a0a208ecf None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:05.783348 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029818c6-8bab-4dcb-91ce-8a3a0a208ecf None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:05.784771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029818c6-8bab-4dcb-91ce-8a3a0a208ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:05.813559 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-029818c6-8bab-4dcb-91ce-8a3a0a208ecf None None] MFA Rules not processed for user `57a4a9f362d948ebaac0cae4a51dbf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:05.813797 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-029818c6-8bab-4dcb-91ce-8a3a0a208ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:05.919122 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-7ea2b776-73c3-4916-bb96-fd5209b54434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c3a6581b774a54ba42c37f81d33bf5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:05.929425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 862/1749] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:05.930764 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029818c6-8bab-4dcb-91ce-8a3a0a208ecf None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:05.994594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029818c6-8bab-4dcb-91ce-8a3a0a208ecf None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:05.995887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:06.014167 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984d966-9ac7-48ba-a6c4-b3e47c2acc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:06.014797 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984d966-9ac7-48ba-a6c4-b3e47c2acc42 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:06.015076 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984d966-9ac7-48ba-a6c4-b3e47c2acc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:06.015344 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984d966-9ac7-48ba-a6c4-b3e47c2acc42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:06.015992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984d966-9ac7-48ba-a6c4-b3e47c2acc42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:06.024167 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984d966-9ac7-48ba-a6c4-b3e47c2acc42 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:06.047584 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-7ea2b776-73c3-4916-bb96-fd5209b54434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c3a6581b774a54ba42c37f81d33bf5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:06.048273 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-7ea2b776-73c3-4916-bb96-fd5209b54434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c3a6581b774a54ba42c37f81d33bf5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:06.049318 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-7ea2b776-73c3-4916-bb96-fd5209b54434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c3a6581b774a54ba42c37f81d33bf5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:06.055734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 863/1750] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:06.062668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-7ea2b776-73c3-4916-bb96-fd5209b54434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c3a6581b774a54ba42c37f81d33bf5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:06.063645 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984d966-9ac7-48ba-a6c4-b3e47c2acc42 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:06.065905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b984d966-9ac7-48ba-a6c4-b3e47c2acc42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:06.087711 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:06.092139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984d966-9ac7-48ba-a6c4-b3e47c2acc42 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:06.116106 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3ab91-d73b-4962-8a26-2cd4d466d2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:06.118247 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3ab91-d73b-4962-8a26-2cd4d466d2bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:06.118975 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3ab91-d73b-4962-8a26-2cd4d466d2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:06.119482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3ab91-d73b-4962-8a26-2cd4d466d2bd admin admin] PATH_INFO: `/v3/projects/9ba0567b16a245708ade0909ba8be350/users/a67a97af2f8d4f6ea9c2bd2ed9894ca5/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:06.131591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 888/1751] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:05 2022] DELETE /identity/v3/users/a6c3a6581b774a54ba42c37f81d33bf5 => generated 0 bytes in 862 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:06.136670 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8470b5-82fe-4a13-a629-bcb492a6f011 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:06.136895 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8470b5-82fe-4a13-a629-bcb492a6f011 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:06.137174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8470b5-82fe-4a13-a629-bcb492a6f011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:06.188991 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3ab91-d73b-4962-8a26-2cd4d466d2bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba0567b16a245708ade0909ba8be350, user_id=a67a97af2f8d4f6ea9c2bd2ed9894ca5, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:06.192910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3ab91-d73b-4962-8a26-2cd4d466d2bd admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:06.198641 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4d8470b5-82fe-4a13-a629-bcb492a6f011 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:06.202696 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4d8470b5-82fe-4a13-a629-bcb492a6f011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:06.321268 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 864/1752] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:06 2022] PUT /identity/v3/projects/9ba0567b16a245708ade0909ba8be350/users/a67a97af2f8d4f6ea9c2bd2ed9894ca5/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:06.322699 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3ab91-d73b-4962-8a26-2cd4d466d2bd admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:06.325838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-21c3ab91-d73b-4962-8a26-2cd4d466d2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:06.373551 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 889/1753] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:06.377166 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8470b5-82fe-4a13-a629-bcb492a6f011 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:06.391309 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8470b5-82fe-4a13-a629-bcb492a6f011 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:06.425753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3ab91-d73b-4962-8a26-2cd4d466d2bd admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:06.453534 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d77861-4fa3-44a5-86c4-4b0093834906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:06.454480 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d77861-4fa3-44a5-86c4-4b0093834906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:06.454920 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d77861-4fa3-44a5-86c4-4b0093834906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:06.455316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d77861-4fa3-44a5-86c4-4b0093834906 admin admin] PATH_INFO: `/v3/projects/56c1d63584f34b3e882b2a3bdc1e47b2` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:06.457342 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d77861-4fa3-44a5-86c4-4b0093834906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56c1d63584f34b3e882b2a3bdc1e47b2)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:06.460436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d77861-4fa3-44a5-86c4-4b0093834906 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:06.474290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59b2d2-75f9-4785-ac9f-6eb30f6c2fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:06.476403 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59b2d2-75f9-4785-ac9f-6eb30f6c2fab admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:06.477668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59b2d2-75f9-4785-ac9f-6eb30f6c2fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:06.478155 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59b2d2-75f9-4785-ac9f-6eb30f6c2fab admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:06.479129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59b2d2-75f9-4785-ac9f-6eb30f6c2fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:06.481365 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59b2d2-75f9-4785-ac9f-6eb30f6c2fab admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:06.494754 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 890/1754] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:06.495996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59b2d2-75f9-4785-ac9f-6eb30f6c2fab admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:06.499233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3b59b2d2-75f9-4785-ac9f-6eb30f6c2fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:06.571311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59b2d2-75f9-4785-ac9f-6eb30f6c2fab admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:06.583269 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78390c44-ecba-4430-bc4b-817c43aace4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:06.584162 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78390c44-ecba-4430-bc4b-817c43aace4d service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:06.585390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78390c44-ecba-4430-bc4b-817c43aace4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:06.586044 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78390c44-ecba-4430-bc4b-817c43aace4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:06.608883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78390c44-ecba-4430-bc4b-817c43aace4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:06.611759 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-74d77861-4fa3-44a5-86c4-4b0093834906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56c1d63584f34b3e882b2a3bdc1e47b2', 'request_id': 'req-74d77861-4fa3-44a5-86c4-4b0093834906'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:06.630421 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78390c44-ecba-4430-bc4b-817c43aace4d service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:06.630972 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-74d77861-4fa3-44a5-86c4-4b0093834906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56c1d63584f34b3e882b2a3bdc1e47b2', 'request_id': 'req-74d77861-4fa3-44a5-86c4-4b0093834906'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:06.655224 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 891/1755] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:06.656014 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78390c44-ecba-4430-bc4b-817c43aace4d service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:06.668022 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78390c44-ecba-4430-bc4b-817c43aace4d service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:06.701524 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-74d77861-4fa3-44a5-86c4-4b0093834906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56c1d63584f34b3e882b2a3bdc1e47b2', 'request_id': 'req-74d77861-4fa3-44a5-86c4-4b0093834906'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:06.725336 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-74d77861-4fa3-44a5-86c4-4b0093834906 admin admin] The token cache is being invalidate because project 56c1d63584f34b3e882b2a3bdc1e47b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:06.726740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-74d77861-4fa3-44a5-86c4-4b0093834906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:06.729702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-74d77861-4fa3-44a5-86c4-4b0093834906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:06.739801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 865/1756] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:06 2022] DELETE /identity/v3/projects/56c1d63584f34b3e882b2a3bdc1e47b2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:06.743395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541d989-de65-4acc-be3f-54242bed767b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:06.743851 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541d989-de65-4acc-be3f-54242bed767b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:06.744138 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541d989-de65-4acc-be3f-54242bed767b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:06.786978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7618adf-5383-4a92-bfa5-32b6c4e96526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:06.787694 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7618adf-5383-4a92-bfa5-32b6c4e96526 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:06.788107 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7618adf-5383-4a92-bfa5-32b6c4e96526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:06.788270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7618adf-5383-4a92-bfa5-32b6c4e96526 admin admin] PATH_INFO: `/v3/projects/9ba0567b16a245708ade0909ba8be350/users/a67a97af2f8d4f6ea9c2bd2ed9894ca5/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:06.790236 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7618adf-5383-4a92-bfa5-32b6c4e96526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba0567b16a245708ade0909ba8be350, user_id=a67a97af2f8d4f6ea9c2bd2ed9894ca5, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:06.792915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7618adf-5383-4a92-bfa5-32b6c4e96526 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:06.795165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a541d989-de65-4acc-be3f-54242bed767b None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:06.799527 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a541d989-de65-4acc-be3f-54242bed767b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:06.807343 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 892/1757] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:06 2022] PUT /identity/v3/projects/9ba0567b16a245708ade0909ba8be350/users/a67a97af2f8d4f6ea9c2bd2ed9894ca5/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:06.817685 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76c87a-19ec-4c01-a8d9-cbcd6864b28a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:06.818210 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76c87a-19ec-4c01-a8d9-cbcd6864b28a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:06.818764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76c87a-19ec-4c01-a8d9-cbcd6864b28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:06.859021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5f76c87a-19ec-4c01-a8d9-cbcd6864b28a None None] MFA Rules not processed for user `a67a97af2f8d4f6ea9c2bd2ed9894ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:06.860939 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5f76c87a-19ec-4c01-a8d9-cbcd6864b28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:06.930757 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 866/1758] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:06.938163 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff126344-a45c-477e-86f0-17ba7f8a9131 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:06.938745 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff126344-a45c-477e-86f0-17ba7f8a9131 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:06.939478 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff126344-a45c-477e-86f0-17ba7f8a9131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:06.968869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 893/1759] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:06.978611 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ff126344-a45c-477e-86f0-17ba7f8a9131 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:06.979890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ff126344-a45c-477e-86f0-17ba7f8a9131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:06.984356 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76c87a-19ec-4c01-a8d9-cbcd6864b28a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:06.985760 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5f76c87a-19ec-4c01-a8d9-cbcd6864b28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:07.014901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 867/1760] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:07.019644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff126344-a45c-477e-86f0-17ba7f8a9131 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:07.038860 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff126344-a45c-477e-86f0-17ba7f8a9131 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:07.045094 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f3e47-3a90-4769-8ecb-d9df97b3d3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:07.045817 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f3e47-3a90-4769-8ecb-d9df97b3d3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:07.046531 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f3e47-3a90-4769-8ecb-d9df97b3d3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:07.046531 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f3e47-3a90-4769-8ecb-d9df97b3d3e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:07.047070 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f3e47-3a90-4769-8ecb-d9df97b3d3e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:18:07.047378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f3e47-3a90-4769-8ecb-d9df97b3d3e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:07.050289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f3e47-3a90-4769-8ecb-d9df97b3d3e3 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:07.068974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:07.097334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 868/1761] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:18:07.102225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f3e47-3a90-4769-8ecb-d9df97b3d3e3 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:07.151316 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:07.156280 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f3e47-3a90-4769-8ecb-d9df97b3d3e3 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:07.158639 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76c87a-19ec-4c01-a8d9-cbcd6864b28a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:07.171668 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab33e0-a5b8-4c11-b387-a60a34911b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:07.178478 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab33e0-a5b8-4c11-b387-a60a34911b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:07.178921 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b78b6-c321-42bb-9fd5-a6ea9533cd57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:07.179572 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b78b6-c321-42bb-9fd5-a6ea9533cd57 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:07.179857 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b78b6-c321-42bb-9fd5-a6ea9533cd57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:07.180259 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab33e0-a5b8-4c11-b387-a60a34911b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:07.181986 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b78b6-c321-42bb-9fd5-a6ea9533cd57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:07.182556 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab33e0-a5b8-4c11-b387-a60a34911b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:07.183405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab33e0-a5b8-4c11-b387-a60a34911b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:07.185584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab33e0-a5b8-4c11-b387-a60a34911b7d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:07.203287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b78b6-c321-42bb-9fd5-a6ea9533cd57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:07.208077 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b78b6-c321-42bb-9fd5-a6ea9533cd57 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:07.222272 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 894/1762] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:18:07.369029 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 869/1763] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:07 2022] POST /identity/v3/projects => generated 365 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:07.369975 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b78b6-c321-42bb-9fd5-a6ea9533cd57 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:07.389714 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b78b6-c321-42bb-9fd5-a6ea9533cd57 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:07.672839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244f189-d826-4923-a00c-866ce22cfea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:07.673816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244f189-d826-4923-a00c-866ce22cfea2 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:07.674104 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244f189-d826-4923-a00c-866ce22cfea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:07.674377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244f189-d826-4923-a00c-866ce22cfea2 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:07.675193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244f189-d826-4923-a00c-866ce22cfea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:07.677167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244f189-d826-4923-a00c-866ce22cfea2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:07.811343 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 895/1764] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:07 2022] POST /identity/v3/users => generated 283 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:07.813288 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab33e0-a5b8-4c11-b387-a60a34911b7d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:07.842326 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab33e0-a5b8-4c11-b387-a60a34911b7d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:07.871568 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084aaba0-88e6-4dc5-a748-2f35e1708475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:07.874756 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aaba0-88e6-4dc5-a748-2f35e1708475 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:07.874756 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aaba0-88e6-4dc5-a748-2f35e1708475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:07.874756 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aaba0-88e6-4dc5-a748-2f35e1708475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:07.876194 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084aaba0-88e6-4dc5-a748-2f35e1708475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:07.882983 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084aaba0-88e6-4dc5-a748-2f35e1708475 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:07.916164 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 870/1765] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:07.919831 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244f189-d826-4923-a00c-866ce22cfea2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:07.942017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244f189-d826-4923-a00c-866ce22cfea2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:07.966900 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084aaba0-88e6-4dc5-a748-2f35e1708475 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:07.967763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0bbf9-654a-4caa-a9ac-b68ba34c994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:07.968390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0bbf9-654a-4caa-a9ac-b68ba34c994d admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:07.968675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0bbf9-654a-4caa-a9ac-b68ba34c994d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:07.968949 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0bbf9-654a-4caa-a9ac-b68ba34c994d admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:07.969584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-084aaba0-88e6-4dc5-a748-2f35e1708475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:07.969689 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0bbf9-654a-4caa-a9ac-b68ba34c994d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:07.971235 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0bbf9-654a-4caa-a9ac-b68ba34c994d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:07.994855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084aaba0-88e6-4dc5-a748-2f35e1708475 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:08.008861 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 896/1766] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:08.012602 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0bbf9-654a-4caa-a9ac-b68ba34c994d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:08.020514 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f744f2e-263d-4390-b509-e706fabf9c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:08.020514 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f744f2e-263d-4390-b509-e706fabf9c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:08.020514 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f744f2e-263d-4390-b509-e706fabf9c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:08.020514 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f744f2e-263d-4390-b509-e706fabf9c71 admin admin] PATH_INFO: `/v3/projects/222808ef895d48f99d1ffceb9ff9f3f4` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:08.020919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f744f2e-263d-4390-b509-e706fabf9c71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=222808ef895d48f99d1ffceb9ff9f3f4)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:08.025688 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f744f2e-263d-4390-b509-e706fabf9c71 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:08.036359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0bbf9-654a-4caa-a9ac-b68ba34c994d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:08.070201 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb159b3-abce-4892-8ac9-d720d6ab895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:08.070893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb159b3-abce-4892-8ac9-d720d6ab895a admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:08.071184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb159b3-abce-4892-8ac9-d720d6ab895a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:08.071465 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb159b3-abce-4892-8ac9-d720d6ab895a admin admin] PATH_INFO: `/v3/projects/0a79a3deb0944be19bf20839e16257c9/users/dcd8ca3d7f764cfaa97bf37cf76a0ab7/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:08.138281 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb159b3-abce-4892-8ac9-d720d6ab895a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a79a3deb0944be19bf20839e16257c9, user_id=dcd8ca3d7f764cfaa97bf37cf76a0ab7, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:08.141624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb159b3-abce-4892-8ac9-d720d6ab895a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:08.234710 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 897/1767] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:08 2022] PUT /identity/v3/projects/0a79a3deb0944be19bf20839e16257c9/users/dcd8ca3d7f764cfaa97bf37cf76a0ab7/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:08.236776 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026be949-835b-45ef-aeab-3b055c22c6ea None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:08.237211 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026be949-835b-45ef-aeab-3b055c22c6ea None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:08.237661 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026be949-835b-45ef-aeab-3b055c22c6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:08.264925 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3f744f2e-263d-4390-b509-e706fabf9c71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '222808ef895d48f99d1ffceb9ff9f3f4', 'request_id': 'req-3f744f2e-263d-4390-b509-e706fabf9c71'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:08.297556 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-026be949-835b-45ef-aeab-3b055c22c6ea None None] MFA Rules not processed for user `dcd8ca3d7f764cfaa97bf37cf76a0ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:08.298924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3f744f2e-263d-4390-b509-e706fabf9c71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '222808ef895d48f99d1ffceb9ff9f3f4', 'request_id': 'req-3f744f2e-263d-4390-b509-e706fabf9c71'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:08.299398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-026be949-835b-45ef-aeab-3b055c22c6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:08.402947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3f744f2e-263d-4390-b509-e706fabf9c71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '222808ef895d48f99d1ffceb9ff9f3f4', 'request_id': 'req-3f744f2e-263d-4390-b509-e706fabf9c71'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:08.423799 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3f744f2e-263d-4390-b509-e706fabf9c71 admin admin] The token cache is being invalidate because project 222808ef895d48f99d1ffceb9ff9f3f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:08.424175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3f744f2e-263d-4390-b509-e706fabf9c71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:08.425847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3f744f2e-263d-4390-b509-e706fabf9c71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:08.429814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 871/1768] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:07 2022] DELETE /identity/v3/projects/222808ef895d48f99d1ffceb9ff9f3f4 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:08.431578 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb718d-8336-40fb-98fd-e33344fb7573 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:08.432112 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb718d-8336-40fb-98fd-e33344fb7573 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:08.432589 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb718d-8336-40fb-98fd-e33344fb7573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:08.461578 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 898/1769] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:08.466055 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026be949-835b-45ef-aeab-3b055c22c6ea None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:08.596818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-b2fb718d-8336-40fb-98fd-e33344fb7573 None None] MFA Rules not processed for user `5c29eab582a64a8991b171766d321e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:08.599476 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b2fb718d-8336-40fb-98fd-e33344fb7573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:08.627596 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:08.725777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026be949-835b-45ef-aeab-3b055c22c6ea None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:08.752049 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb84d7-7b07-42c8-8346-2f4a583b14d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:08.753542 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb84d7-7b07-42c8-8346-2f4a583b14d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:08.753967 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb84d7-7b07-42c8-8346-2f4a583b14d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:08.754657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb84d7-7b07-42c8-8346-2f4a583b14d1 admin admin] PATH_INFO: `/v3/users/1be4b3d5678b47f7bf85a6958b12f8eb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:08.757668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb84d7-7b07-42c8-8346-2f4a583b14d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be4b3d5678b47f7bf85a6958b12f8eb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:08.762297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb84d7-7b07-42c8-8346-2f4a583b14d1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:08.767863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:08.849645 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 872/1770] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Aug 9 19:18:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:08.850466 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb718d-8336-40fb-98fd-e33344fb7573 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:08.852330 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b2fb718d-8336-40fb-98fd-e33344fb7573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:08.884800 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb718d-8336-40fb-98fd-e33344fb7573 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:08.920462 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c11b56-fbd8-4f9c-9021-8f67ad96a6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:08.921087 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c11b56-fbd8-4f9c-9021-8f67ad96a6bf admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:08.921363 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c11b56-fbd8-4f9c-9021-8f67ad96a6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:08.921676 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c11b56-fbd8-4f9c-9021-8f67ad96a6bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:08.922303 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c11b56-fbd8-4f9c-9021-8f67ad96a6bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:08.927121 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c11b56-fbd8-4f9c-9021-8f67ad96a6bf admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:09.136942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 873/1771] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:08 2022] POST /identity/v3/projects => generated 365 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:09.143116 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c11b56-fbd8-4f9c-9021-8f67ad96a6bf admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:09.185841 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c7eb84d7-7b07-42c8-8346-2f4a583b14d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be4b3d5678b47f7bf85a6958b12f8eb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:09.336538 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c7eb84d7-7b07-42c8-8346-2f4a583b14d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be4b3d5678b47f7bf85a6958b12f8eb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:09.341908 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c7eb84d7-7b07-42c8-8346-2f4a583b14d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be4b3d5678b47f7bf85a6958b12f8eb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:09.344935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c7eb84d7-7b07-42c8-8346-2f4a583b14d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be4b3d5678b47f7bf85a6958b12f8eb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:09.363210 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c7eb84d7-7b07-42c8-8346-2f4a583b14d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be4b3d5678b47f7bf85a6958b12f8eb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:09.412874 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 899/1772] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:08 2022] DELETE /identity/v3/users/1be4b3d5678b47f7bf85a6958b12f8eb => generated 0 bytes in 947 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:09.415678 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb84d7-7b07-42c8-8346-2f4a583b14d1 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:09.418074 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c7eb84d7-7b07-42c8-8346-2f4a583b14d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:09.475718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c11b56-fbd8-4f9c-9021-8f67ad96a6bf admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:09.612906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8fd6e-5b2e-4004-a771-2fdd9aa65f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:09.613854 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8fd6e-5b2e-4004-a771-2fdd9aa65f02 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:09.614277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8fd6e-5b2e-4004-a771-2fdd9aa65f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:09.614815 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8fd6e-5b2e-4004-a771-2fdd9aa65f02 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:09.615952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8fd6e-5b2e-4004-a771-2fdd9aa65f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:09.618566 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8fd6e-5b2e-4004-a771-2fdd9aa65f02 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:09.697014 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb84d7-7b07-42c8-8346-2f4a583b14d1 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:09.708540 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcd714-d879-421a-ae3f-9e99ecbea395 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac48cd591b44f2999d2f172262019da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:09.710451 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcd714-d879-421a-ae3f-9e99ecbea395 service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:09.710868 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcd714-d879-421a-ae3f-9e99ecbea395 service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:09.711349 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcd714-d879-421a-ae3f-9e99ecbea395 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:09.713948 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-aebcd714-d879-421a-ae3f-9e99ecbea395 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:09.748483 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 874/1773] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:09 2022] POST /identity/v3/users => generated 289 bytes in 606 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:09.752371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8fd6e-5b2e-4004-a771-2fdd9aa65f02 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:09.755844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f9a8fd6e-5b2e-4004-a771-2fdd9aa65f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:09.809913 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8fd6e-5b2e-4004-a771-2fdd9aa65f02 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:09.810504 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcd714-d879-421a-ae3f-9e99ecbea395 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:09.812137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcd714-d879-421a-ae3f-9e99ecbea395 service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:09.822390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 900/1774] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Aug 9 19:18:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 19:18:09.849033 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72bbb2-d01d-436e-9860-b6b5e52e379f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:09.850220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72bbb2-d01d-436e-9860-b6b5e52e379f admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:09.852947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72bbb2-d01d-436e-9860-b6b5e52e379f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:09.853382 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72bbb2-d01d-436e-9860-b6b5e52e379f admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:09.854272 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72bbb2-d01d-436e-9860-b6b5e52e379f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:09.858980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72bbb2-d01d-436e-9860-b6b5e52e379f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:09.892107 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 875/1775] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:09.897302 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcd714-d879-421a-ae3f-9e99ecbea395 service swift] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:09.924340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcd714-d879-421a-ae3f-9e99ecbea395 service swift] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:09.946009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644682b-ce34-4fe1-a3df-dca15c03c747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:09.947079 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644682b-ce34-4fe1-a3df-dca15c03c747 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:09.948194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644682b-ce34-4fe1-a3df-dca15c03c747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:09.948563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644682b-ce34-4fe1-a3df-dca15c03c747 admin admin] PATH_INFO: `/v3/projects/c7fa36e96b31455b9a985dd5ad67b227/users/eb460256f7ee4f9d9b4af653c59057a1/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:10.003452 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644682b-ce34-4fe1-a3df-dca15c03c747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7fa36e96b31455b9a985dd5ad67b227, user_id=eb460256f7ee4f9d9b4af653c59057a1, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:10.009897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644682b-ce34-4fe1-a3df-dca15c03c747 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:10.132995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 901/1776] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:09 2022] PUT /identity/v3/projects/c7fa36e96b31455b9a985dd5ad67b227/users/eb460256f7ee4f9d9b4af653c59057a1/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:10.136552 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72bbb2-d01d-436e-9860-b6b5e52e379f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:10.157205 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72bbb2-d01d-436e-9860-b6b5e52e379f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:10.187128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644682b-ce34-4fe1-a3df-dca15c03c747 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:10.189051 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4644682b-ce34-4fe1-a3df-dca15c03c747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:10.388704 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64769e3d-af67-4bef-bd6f-ff8086ec8ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:10.390988 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64769e3d-af67-4bef-bd6f-ff8086ec8ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:10.391420 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64769e3d-af67-4bef-bd6f-ff8086ec8ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:10.391820 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64769e3d-af67-4bef-bd6f-ff8086ec8ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:10.392763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64769e3d-af67-4bef-bd6f-ff8086ec8ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:10.397829 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64769e3d-af67-4bef-bd6f-ff8086ec8ca1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:10.430509 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 876/1777] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:10.438927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64769e3d-af67-4bef-bd6f-ff8086ec8ca1 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:10.503241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64769e3d-af67-4bef-bd6f-ff8086ec8ca1 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:10.526539 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bd47a-385e-456a-bee4-6c053aa46cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:10.529703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bd47a-385e-456a-bee4-6c053aa46cc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:10.533044 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bd47a-385e-456a-bee4-6c053aa46cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:10.534756 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bd47a-385e-456a-bee4-6c053aa46cc9 admin admin] PATH_INFO: `/v3/projects/c7fa36e96b31455b9a985dd5ad67b227/users/eb460256f7ee4f9d9b4af653c59057a1/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:10.543588 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bd47a-385e-456a-bee4-6c053aa46cc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7fa36e96b31455b9a985dd5ad67b227, user_id=eb460256f7ee4f9d9b4af653c59057a1, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:10.551922 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bd47a-385e-456a-bee4-6c053aa46cc9 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:10.560571 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:10.577987 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644682b-ce34-4fe1-a3df-dca15c03c747 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:10.598786 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 877/1778] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:10 2022] PUT /identity/v3/projects/c7fa36e96b31455b9a985dd5ad67b227/users/eb460256f7ee4f9d9b4af653c59057a1/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:10.616039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0a7d9-4b04-4007-8c70-de0a4edc0446 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:10.616306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0a7d9-4b04-4007-8c70-de0a4edc0446 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:10.618634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0a7d9-4b04-4007-8c70-de0a4edc0446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:10.664009 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1bd0a7d9-4b04-4007-8c70-de0a4edc0446 None None] MFA Rules not processed for user `a62d954163ca4bf298f461b4d253269e`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:10.665781 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1bd0a7d9-4b04-4007-8c70-de0a4edc0446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:10.845857 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429bf95-3ffa-40fa-977b-44cee769fc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:10.849161 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429bf95-3ffa-40fa-977b-44cee769fc81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:10.850342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429bf95-3ffa-40fa-977b-44cee769fc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:10.851387 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429bf95-3ffa-40fa-977b-44cee769fc81 admin admin] PATH_INFO: `/v3/users/9d67074bb53a4a64901823c6d773e279` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:10.854570 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429bf95-3ffa-40fa-977b-44cee769fc81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d67074bb53a4a64901823c6d773e279)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:10.858033 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 878/1779] 10.222.0.47 () {58 vars in 1015 bytes} [Tue Aug 9 19:18:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:10.860966 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ea414-ef8a-4ffb-8c5d-6e9c415d2d0f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:10.861116 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429bf95-3ffa-40fa-977b-44cee769fc81 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:10.861322 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ea414-ef8a-4ffb-8c5d-6e9c415d2d0f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:10.863331 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ea414-ef8a-4ffb-8c5d-6e9c415d2d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:10.960229 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-681ea414-ef8a-4ffb-8c5d-6e9c415d2d0f None None] MFA Rules not processed for user `eb460256f7ee4f9d9b4af653c59057a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:10.971259 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-681ea414-ef8a-4ffb-8c5d-6e9c415d2d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:11.120725 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:11.196492 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8429bf95-3ffa-40fa-977b-44cee769fc81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d67074bb53a4a64901823c6d773e279'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:11.276520 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 879/1780] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:11.277651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ea414-ef8a-4ffb-8c5d-6e9c415d2d0f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:11.279820 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-681ea414-ef8a-4ffb-8c5d-6e9c415d2d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:11.290725 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8429bf95-3ffa-40fa-977b-44cee769fc81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d67074bb53a4a64901823c6d773e279'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:11.291577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8429bf95-3ffa-40fa-977b-44cee769fc81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d67074bb53a4a64901823c6d773e279'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:11.297132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8429bf95-3ffa-40fa-977b-44cee769fc81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d67074bb53a4a64901823c6d773e279'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:11.297260 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ea414-ef8a-4ffb-8c5d-6e9c415d2d0f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:11.300970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21972b76-0744-44fd-b773-44133834a2ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:11.302143 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21972b76-0744-44fd-b773-44133834a2ec service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:11.302566 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21972b76-0744-44fd-b773-44133834a2ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:11.303006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21972b76-0744-44fd-b773-44133834a2ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:11.304888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8429bf95-3ffa-40fa-977b-44cee769fc81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d67074bb53a4a64901823c6d773e279'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:11.305413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-21972b76-0744-44fd-b773-44133834a2ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:11.318232 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21972b76-0744-44fd-b773-44133834a2ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:11.319912 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21972b76-0744-44fd-b773-44133834a2ec service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:11.329782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 880/1781] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:11.331542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21972b76-0744-44fd-b773-44133834a2ec service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:11.333155 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-21972b76-0744-44fd-b773-44133834a2ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:11.383936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 902/1782] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:10 2022] DELETE /identity/v3/users/9d67074bb53a4a64901823c6d773e279 => generated 0 bytes in 1197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:11.384948 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429bf95-3ffa-40fa-977b-44cee769fc81 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:11.387387 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8429bf95-3ffa-40fa-977b-44cee769fc81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:11.406363 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21972b76-0744-44fd-b773-44133834a2ec service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:11.499948 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244fae7-9e30-49b8-ac8a-93c67323426b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:11.500692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244fae7-9e30-49b8-ac8a-93c67323426b service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:11.501790 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244fae7-9e30-49b8-ac8a-93c67323426b service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:11.501790 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244fae7-9e30-49b8-ac8a-93c67323426b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:11.505420 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d244fae7-9e30-49b8-ac8a-93c67323426b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:11.718666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429bf95-3ffa-40fa-977b-44cee769fc81 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:11.718666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a39b5f-7ee5-4e2e-98ad-4c30fa357fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:11.718666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a39b5f-7ee5-4e2e-98ad-4c30fa357fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:11.718666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a39b5f-7ee5-4e2e-98ad-4c30fa357fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:11.720152 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a39b5f-7ee5-4e2e-98ad-4c30fa357fa6 admin admin] PATH_INFO: `/v3/projects/7250d124bc0a41119a3c03e10640c69e` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:11.720152 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a39b5f-7ee5-4e2e-98ad-4c30fa357fa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7250d124bc0a41119a3c03e10640c69e)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:11.720152 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a39b5f-7ee5-4e2e-98ad-4c30fa357fa6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:11.720992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244fae7-9e30-49b8-ac8a-93c67323426b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:11.720992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244fae7-9e30-49b8-ac8a-93c67323426b service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:11.720992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 881/1783] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:11.720992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080508f-c705-46a3-96b5-34fcbacda1b6 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:11.720992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080508f-c705-46a3-96b5-34fcbacda1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:11.720992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080508f-c705-46a3-96b5-34fcbacda1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:11.722166 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f080508f-c705-46a3-96b5-34fcbacda1b6 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:11.722166 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f080508f-c705-46a3-96b5-34fcbacda1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:11.722166 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 882/1784] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:11.732346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080508f-c705-46a3-96b5-34fcbacda1b6 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:11.734807 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f080508f-c705-46a3-96b5-34fcbacda1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:11.824303 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080508f-c705-46a3-96b5-34fcbacda1b6 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:11.863732 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96715b-83fe-4f3b-92d4-5b09ff9fd8b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:11.863732 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96715b-83fe-4f3b-92d4-5b09ff9fd8b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:11.863732 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96715b-83fe-4f3b-92d4-5b09ff9fd8b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:11.863732 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96715b-83fe-4f3b-92d4-5b09ff9fd8b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:11.865067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96715b-83fe-4f3b-92d4-5b09ff9fd8b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:11.865067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96715b-83fe-4f3b-92d4-5b09ff9fd8b8 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:11.869925 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 883/1785] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:18:12.140397 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-28a39b5f-7ee5-4e2e-98ad-4c30fa357fa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7250d124bc0a41119a3c03e10640c69e', 'request_id': 'req-28a39b5f-7ee5-4e2e-98ad-4c30fa357fa6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:12.170875 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-28a39b5f-7ee5-4e2e-98ad-4c30fa357fa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7250d124bc0a41119a3c03e10640c69e', 'request_id': 'req-28a39b5f-7ee5-4e2e-98ad-4c30fa357fa6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:12.279450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-28a39b5f-7ee5-4e2e-98ad-4c30fa357fa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7250d124bc0a41119a3c03e10640c69e', 'request_id': 'req-28a39b5f-7ee5-4e2e-98ad-4c30fa357fa6'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:12.300569 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96715b-83fe-4f3b-92d4-5b09ff9fd8b8 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:12.302383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ab96715b-83fe-4f3b-92d4-5b09ff9fd8b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:12.322882 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-28a39b5f-7ee5-4e2e-98ad-4c30fa357fa6 admin admin] The token cache is being invalidate because project 7250d124bc0a41119a3c03e10640c69e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:12.323835 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-28a39b5f-7ee5-4e2e-98ad-4c30fa357fa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:12.324732 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-28a39b5f-7ee5-4e2e-98ad-4c30fa357fa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:12.332998 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 903/1786] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:11 2022] DELETE /identity/v3/projects/7250d124bc0a41119a3c03e10640c69e => generated 0 bytes in 942 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:12.344355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d91b78-ea69-47e1-b907-4147b6dd3c62 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:12.347076 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d91b78-ea69-47e1-b907-4147b6dd3c62 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:12.347745 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d91b78-ea69-47e1-b907-4147b6dd3c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:12.364411 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96715b-83fe-4f3b-92d4-5b09ff9fd8b8 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:12.388214 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-19d91b78-ea69-47e1-b907-4147b6dd3c62 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:12.389340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-19d91b78-ea69-47e1-b907-4147b6dd3c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:12.571683 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 904/1787] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:12.588057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2b987-ae8c-4ce9-9fbd-b388da850803 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:12.588668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2b987-ae8c-4ce9-9fbd-b388da850803 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:12.589087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2b987-ae8c-4ce9-9fbd-b388da850803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:12.609366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d092b-c9b2-47cc-a3f6-0ad48734395e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:12.610414 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d092b-c9b2-47cc-a3f6-0ad48734395e service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:12.610665 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d092b-c9b2-47cc-a3f6-0ad48734395e service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:12.610969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d092b-c9b2-47cc-a3f6-0ad48734395e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:12.618333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-430d092b-c9b2-47cc-a3f6-0ad48734395e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:12.635567 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6cb2b987-ae8c-4ce9-9fbd-b388da850803 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:12.638695 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6cb2b987-ae8c-4ce9-9fbd-b388da850803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:12.686009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 905/1788] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:12.691042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2b987-ae8c-4ce9-9fbd-b388da850803 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:12.717445 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2b987-ae8c-4ce9-9fbd-b388da850803 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:12.731048 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef1aa0-9755-4319-add3-4c2c66797a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:12.731821 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef1aa0-9755-4319-add3-4c2c66797a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:12.732589 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef1aa0-9755-4319-add3-4c2c66797a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:12.733041 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef1aa0-9755-4319-add3-4c2c66797a87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:12.734524 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef1aa0-9755-4319-add3-4c2c66797a87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:18:12.735115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef1aa0-9755-4319-add3-4c2c66797a87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:12.739220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef1aa0-9755-4319-add3-4c2c66797a87 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:12.755157 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 906/1789] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:18:12.773558 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef1aa0-9755-4319-add3-4c2c66797a87 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:12.787843 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef1aa0-9755-4319-add3-4c2c66797a87 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:12.796047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349a511-d7d2-4822-bae2-63db038aff28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:12.796955 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349a511-d7d2-4822-bae2-63db038aff28 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:12.797069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349a511-d7d2-4822-bae2-63db038aff28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:12.797276 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349a511-d7d2-4822-bae2-63db038aff28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:12.798682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349a511-d7d2-4822-bae2-63db038aff28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:12.801721 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349a511-d7d2-4822-bae2-63db038aff28 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:12.833860 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d092b-c9b2-47cc-a3f6-0ad48734395e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:12.835349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d092b-c9b2-47cc-a3f6-0ad48734395e service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:12.857891 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 884/1790] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:12.931781 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:12.937301 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 907/1791] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:12 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:12.941959 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d092b-c9b2-47cc-a3f6-0ad48734395e service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:12.964723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d092b-c9b2-47cc-a3f6-0ad48734395e service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:13.075799 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ae73a-ce18-445a-adfd-31d995061078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:13.076976 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ae73a-ce18-445a-adfd-31d995061078 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:13.077098 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ae73a-ce18-445a-adfd-31d995061078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:13.077540 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ae73a-ce18-445a-adfd-31d995061078 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:13.078357 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ae73a-ce18-445a-adfd-31d995061078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:13.082685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ae73a-ce18-445a-adfd-31d995061078 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:13.184809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 885/1792] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:12 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:18:13.186384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349a511-d7d2-4822-bae2-63db038aff28 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:13.202931 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349a511-d7d2-4822-bae2-63db038aff28 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:13.220043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9630539-9d28-4ad2-b380-e5aa6af22dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:13.221907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9630539-9d28-4ad2-b380-e5aa6af22dfc admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:13.222175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9630539-9d28-4ad2-b380-e5aa6af22dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:13.222772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9630539-9d28-4ad2-b380-e5aa6af22dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:13.223594 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9630539-9d28-4ad2-b380-e5aa6af22dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:13.226232 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9630539-9d28-4ad2-b380-e5aa6af22dfc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:13.242961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 908/1793] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:13.244400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ae73a-ce18-445a-adfd-31d995061078 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:13.258263 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ae73a-ce18-445a-adfd-31d995061078 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:13.290598 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cbcf3-fcf4-4338-8cc2-a3cb6eac99ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:13.291469 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbcf3-fcf4-4338-8cc2-a3cb6eac99ef admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:13.292301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbcf3-fcf4-4338-8cc2-a3cb6eac99ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:13.292584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbcf3-fcf4-4338-8cc2-a3cb6eac99ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:13.293251 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cbcf3-fcf4-4338-8cc2-a3cb6eac99ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:13.296459 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cbcf3-fcf4-4338-8cc2-a3cb6eac99ef admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:13.311996 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 886/1794] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:13.312843 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9630539-9d28-4ad2-b380-e5aa6af22dfc admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:13.331708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9630539-9d28-4ad2-b380-e5aa6af22dfc admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:13.352277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43a12c-5036-43cb-b31a-ed1fa82fe09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:13.353000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43a12c-5036-43cb-b31a-ed1fa82fe09d admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:13.353288 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43a12c-5036-43cb-b31a-ed1fa82fe09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:13.353631 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43a12c-5036-43cb-b31a-ed1fa82fe09d admin admin] PATH_INFO: `/v3/projects/bb3335b8b10d44e989f6376b8b5b881d/users/a5e5cffa2c814581abe90c3ef5ea999c/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:13.416181 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43a12c-5036-43cb-b31a-ed1fa82fe09d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3335b8b10d44e989f6376b8b5b881d, user_id=a5e5cffa2c814581abe90c3ef5ea999c, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:13.419998 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43a12c-5036-43cb-b31a-ed1fa82fe09d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:13.506699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 909/1795] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:13 2022] PUT /identity/v3/projects/bb3335b8b10d44e989f6376b8b5b881d/users/a5e5cffa2c814581abe90c3ef5ea999c/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:13.522589 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3283fe2-2c47-4dbd-b4d6-8fff553777d1 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:13.529801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3283fe2-2c47-4dbd-b4d6-8fff553777d1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:13.529801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3283fe2-2c47-4dbd-b4d6-8fff553777d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:13.563062 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a3283fe2-2c47-4dbd-b4d6-8fff553777d1 None None] MFA Rules not processed for user `a5e5cffa2c814581abe90c3ef5ea999c`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:13.565976 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a3283fe2-2c47-4dbd-b4d6-8fff553777d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:13.680424 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 887/1796] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:13.695038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43a12c-5036-43cb-b31a-ed1fa82fe09d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:13.696873 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ee43a12c-5036-43cb-b31a-ed1fa82fe09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:13.834737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43a12c-5036-43cb-b31a-ed1fa82fe09d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:13.842640 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de1bcb-b381-4238-bc0c-196868db346c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:13.843344 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de1bcb-b381-4238-bc0c-196868db346c service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:13.843694 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de1bcb-b381-4238-bc0c-196868db346c service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:13.843967 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de1bcb-b381-4238-bc0c-196868db346c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:13.868115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de1bcb-b381-4238-bc0c-196868db346c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:13.871576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de1bcb-b381-4238-bc0c-196868db346c service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:13.884741 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 910/1797] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:14.001779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3283fe2-2c47-4dbd-b4d6-8fff553777d1 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:14.001779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a3283fe2-2c47-4dbd-b4d6-8fff553777d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:14.112543 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:14.151248 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3283fe2-2c47-4dbd-b4d6-8fff553777d1 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:14.168394 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8027b34-06c4-4692-b381-c66829d18c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:14.169660 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8027b34-06c4-4692-b381-c66829d18c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:14.171896 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8027b34-06c4-4692-b381-c66829d18c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:14.172478 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8027b34-06c4-4692-b381-c66829d18c9d admin admin] PATH_INFO: `/v3/projects/ac65772ea7514462a14672420139e9ef` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:14.176708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8027b34-06c4-4692-b381-c66829d18c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac65772ea7514462a14672420139e9ef)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:14.181587 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8027b34-06c4-4692-b381-c66829d18c9d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:14.411484 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a8027b34-06c4-4692-b381-c66829d18c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac65772ea7514462a14672420139e9ef', 'request_id': 'req-a8027b34-06c4-4692-b381-c66829d18c9d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:14.429479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a8027b34-06c4-4692-b381-c66829d18c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac65772ea7514462a14672420139e9ef', 'request_id': 'req-a8027b34-06c4-4692-b381-c66829d18c9d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:14.574056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a8027b34-06c4-4692-b381-c66829d18c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac65772ea7514462a14672420139e9ef', 'request_id': 'req-a8027b34-06c4-4692-b381-c66829d18c9d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:14.594250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a8027b34-06c4-4692-b381-c66829d18c9d admin admin] The token cache is being invalidate because project ac65772ea7514462a14672420139e9ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:14.594521 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a8027b34-06c4-4692-b381-c66829d18c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:14.600311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa3f31-d025-4db7-8748-915d6fd9f75a None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:14.600917 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa3f31-d025-4db7-8748-915d6fd9f75a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:14.601174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa3f31-d025-4db7-8748-915d6fd9f75a None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:14.605610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 911/1798] 10.222.0.65 () {54 vars in 921 bytes} [Tue Aug 9 19:18:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:18:14.606264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a8027b34-06c4-4692-b381-c66829d18c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:14.608501 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 888/1799] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:13 2022] DELETE /identity/v3/projects/ac65772ea7514462a14672420139e9ef => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:14.614842 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa3f31-d025-4db7-8748-915d6fd9f75a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:14.622819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-96aa3f31-d025-4db7-8748-915d6fd9f75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:14.651037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289cbf3-a978-455c-bff8-3874917d2f04 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:14.651328 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289cbf3-a978-455c-bff8-3874917d2f04 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:14.651606 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289cbf3-a978-455c-bff8-3874917d2f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:14.707254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a289cbf3-a978-455c-bff8-3874917d2f04 None None] MFA Rules not processed for user `2cfda1bec35145f3bbcc13fae0b7af2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:14.707254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a289cbf3-a978-455c-bff8-3874917d2f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:14.816771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa3f31-d025-4db7-8748-915d6fd9f75a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:14.865163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07755f04-299a-4def-9a14-074d3ee84b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:14.865892 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07755f04-299a-4def-9a14-074d3ee84b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:14.866175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07755f04-299a-4def-9a14-074d3ee84b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:14.866446 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07755f04-299a-4def-9a14-074d3ee84b5c admin admin] PATH_INFO: `/v3/users/a67a97af2f8d4f6ea9c2bd2ed9894ca5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:14.871724 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07755f04-299a-4def-9a14-074d3ee84b5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67a97af2f8d4f6ea9c2bd2ed9894ca5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:14.877077 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07755f04-299a-4def-9a14-074d3ee84b5c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:14.931722 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:14.950925 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 889/1800] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Aug 9 19:18:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:15.093217 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289cbf3-a978-455c-bff8-3874917d2f04 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:15.094791 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a289cbf3-a978-455c-bff8-3874917d2f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:15.120982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289cbf3-a978-455c-bff8-3874917d2f04 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:15.147768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6fd3d-b5a4-45f2-bfcb-4ec1a58d6fbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:15.148332 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6fd3d-b5a4-45f2-bfcb-4ec1a58d6fbd service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:15.148611 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6fd3d-b5a4-45f2-bfcb-4ec1a58d6fbd service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:15.148944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6fd3d-b5a4-45f2-bfcb-4ec1a58d6fbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:15.185110 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6fd3d-b5a4-45f2-bfcb-4ec1a58d6fbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:15.189549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6fd3d-b5a4-45f2-bfcb-4ec1a58d6fbd service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:15.199887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-07755f04-299a-4def-9a14-074d3ee84b5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67a97af2f8d4f6ea9c2bd2ed9894ca5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:15.218318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 890/1801] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:18:15.240296 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa9bd8-851c-401d-bf52-0f35004aba95 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:15.240782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa9bd8-851c-401d-bf52-0f35004aba95 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:15.241071 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa9bd8-851c-401d-bf52-0f35004aba95 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:15.253835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 891/1802] 10.222.0.65 () {54 vars in 921 bytes} [Tue Aug 9 19:18:15 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:18:15.268619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4391b-cd5d-4ea5-8320-bb139ef4d07d None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:15.269203 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4391b-cd5d-4ea5-8320-bb139ef4d07d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:15.270244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4391b-cd5d-4ea5-8320-bb139ef4d07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:15.306761 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-6ba4391b-cd5d-4ea5-8320-bb139ef4d07d None None] MFA Rules not processed for user `2cfda1bec35145f3bbcc13fae0b7af2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:15.308264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6ba4391b-cd5d-4ea5-8320-bb139ef4d07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:15.311580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-07755f04-299a-4def-9a14-074d3ee84b5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67a97af2f8d4f6ea9c2bd2ed9894ca5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:15.312244 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-07755f04-299a-4def-9a14-074d3ee84b5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67a97af2f8d4f6ea9c2bd2ed9894ca5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:15.321666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-07755f04-299a-4def-9a14-074d3ee84b5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67a97af2f8d4f6ea9c2bd2ed9894ca5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:15.322219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-07755f04-299a-4def-9a14-074d3ee84b5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67a97af2f8d4f6ea9c2bd2ed9894ca5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:15.339668 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 892/1803] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Aug 9 19:18:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:15.360853 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4391b-cd5d-4ea5-8320-bb139ef4d07d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:15.363694 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6ba4391b-cd5d-4ea5-8320-bb139ef4d07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:15.389163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 912/1804] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:14 2022] DELETE /identity/v3/users/a67a97af2f8d4f6ea9c2bd2ed9894ca5 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:15.395401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4391b-cd5d-4ea5-8320-bb139ef4d07d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:15.417127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:15.550526 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc1451-2656-45f4-8adf-86ef7ecb3045 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:15.550526 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc1451-2656-45f4-8adf-86ef7ecb3045 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:15.550526 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc1451-2656-45f4-8adf-86ef7ecb3045 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:15.550526 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc1451-2656-45f4-8adf-86ef7ecb3045 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:15.581578 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc1451-2656-45f4-8adf-86ef7ecb3045 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:15.585306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc1451-2656-45f4-8adf-86ef7ecb3045 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:15.616899 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 893/1805] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:16.854638 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:17.008357 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:17.161234 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07755f04-299a-4def-9a14-074d3ee84b5c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:17.163158 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-07755f04-299a-4def-9a14-074d3ee84b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:17.386046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07755f04-299a-4def-9a14-074d3ee84b5c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:17.397707 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d1a17-71d6-4796-9033-ec17073fdaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:17.402287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d1a17-71d6-4796-9033-ec17073fdaf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:17.402684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d1a17-71d6-4796-9033-ec17073fdaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:17.402893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d1a17-71d6-4796-9033-ec17073fdaf8 admin admin] PATH_INFO: `/v3/projects/9ba0567b16a245708ade0909ba8be350` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:17.404480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d1a17-71d6-4796-9033-ec17073fdaf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba0567b16a245708ade0909ba8be350)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:17.413038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d1a17-71d6-4796-9033-ec17073fdaf8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:17.615071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-625d1a17-71d6-4796-9033-ec17073fdaf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba0567b16a245708ade0909ba8be350', 'request_id': 'req-625d1a17-71d6-4796-9033-ec17073fdaf8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:17.626763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-625d1a17-71d6-4796-9033-ec17073fdaf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba0567b16a245708ade0909ba8be350', 'request_id': 'req-625d1a17-71d6-4796-9033-ec17073fdaf8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:17.661029 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:17.737751 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-625d1a17-71d6-4796-9033-ec17073fdaf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba0567b16a245708ade0909ba8be350', 'request_id': 'req-625d1a17-71d6-4796-9033-ec17073fdaf8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:17.779140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-625d1a17-71d6-4796-9033-ec17073fdaf8 admin admin] The token cache is being invalidate because project 9ba0567b16a245708ade0909ba8be350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:17.785933 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-625d1a17-71d6-4796-9033-ec17073fdaf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:17.787064 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-625d1a17-71d6-4796-9033-ec17073fdaf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:17.789035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 913/1806] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:17 2022] DELETE /identity/v3/projects/9ba0567b16a245708ade0909ba8be350 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:17.794347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3d8fe-4221-4a86-8a9d-bba1deb07934 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:17.794944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3d8fe-4221-4a86-8a9d-bba1deb07934 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:17.795350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3d8fe-4221-4a86-8a9d-bba1deb07934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:17.825237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-00a3d8fe-4221-4a86-8a9d-bba1deb07934 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:17.826724 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-00a3d8fe-4221-4a86-8a9d-bba1deb07934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:17.990698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebaa3e-dbab-4b7b-a10b-b4700dbf77eb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:17.991187 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebaa3e-dbab-4b7b-a10b-b4700dbf77eb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:17.991600 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebaa3e-dbab-4b7b-a10b-b4700dbf77eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:17.998931 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 894/1807] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:18.030487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3d8fe-4221-4a86-8a9d-bba1deb07934 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:18.031548 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c6ebaa3e-dbab-4b7b-a10b-b4700dbf77eb None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:18.033088 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c6ebaa3e-dbab-4b7b-a10b-b4700dbf77eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:18.034068 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-00a3d8fe-4221-4a86-8a9d-bba1deb07934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:18.065350 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 914/1808] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:18.070084 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebaa3e-dbab-4b7b-a10b-b4700dbf77eb None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:18.072661 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c6ebaa3e-dbab-4b7b-a10b-b4700dbf77eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:18.077946 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3d8fe-4221-4a86-8a9d-bba1deb07934 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:18.088758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f44eb4-a0fa-4709-973d-1c54962e1420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:18.089885 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f44eb4-a0fa-4709-973d-1c54962e1420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:18.090361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f44eb4-a0fa-4709-973d-1c54962e1420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:18.091409 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f44eb4-a0fa-4709-973d-1c54962e1420 admin admin] PATH_INFO: `/v3/users/a5e5cffa2c814581abe90c3ef5ea999c` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:18.094679 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f44eb4-a0fa-4709-973d-1c54962e1420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e5cffa2c814581abe90c3ef5ea999c)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:18.107890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f44eb4-a0fa-4709-973d-1c54962e1420 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:18.111206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebaa3e-dbab-4b7b-a10b-b4700dbf77eb None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:18.124892 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe1037-89ee-4632-8a56-4aa54835dcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:18.127418 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe1037-89ee-4632-8a56-4aa54835dcf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:18.129082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe1037-89ee-4632-8a56-4aa54835dcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:18.129569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe1037-89ee-4632-8a56-4aa54835dcf3 admin admin] PATH_INFO: `/v3/users/dcd8ca3d7f764cfaa97bf37cf76a0ab7` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:18.133797 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe1037-89ee-4632-8a56-4aa54835dcf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd8ca3d7f764cfaa97bf37cf76a0ab7)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:18.137677 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe1037-89ee-4632-8a56-4aa54835dcf3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:18.420370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-43f44eb4-a0fa-4709-973d-1c54962e1420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e5cffa2c814581abe90c3ef5ea999c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:18.427974 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3cfe1037-89ee-4632-8a56-4aa54835dcf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd8ca3d7f764cfaa97bf37cf76a0ab7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:18.434507 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-43f44eb4-a0fa-4709-973d-1c54962e1420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e5cffa2c814581abe90c3ef5ea999c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:18.435485 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-43f44eb4-a0fa-4709-973d-1c54962e1420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e5cffa2c814581abe90c3ef5ea999c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:18.438263 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-43f44eb4-a0fa-4709-973d-1c54962e1420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e5cffa2c814581abe90c3ef5ea999c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:18.553991 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3cfe1037-89ee-4632-8a56-4aa54835dcf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd8ca3d7f764cfaa97bf37cf76a0ab7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:18.555452 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3cfe1037-89ee-4632-8a56-4aa54835dcf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd8ca3d7f764cfaa97bf37cf76a0ab7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:18.556412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3cfe1037-89ee-4632-8a56-4aa54835dcf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd8ca3d7f764cfaa97bf37cf76a0ab7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:18.570460 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3cfe1037-89ee-4632-8a56-4aa54835dcf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd8ca3d7f764cfaa97bf37cf76a0ab7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:18.621923 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 915/1809] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:18 2022] DELETE /identity/v3/users/dcd8ca3d7f764cfaa97bf37cf76a0ab7 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:18.623303 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe1037-89ee-4632-8a56-4aa54835dcf3 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:18.625435 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3cfe1037-89ee-4632-8a56-4aa54835dcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:18.678726 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-43f44eb4-a0fa-4709-973d-1c54962e1420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e5cffa2c814581abe90c3ef5ea999c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:18.735303 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 895/1810] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:18 2022] DELETE /identity/v3/users/a5e5cffa2c814581abe90c3ef5ea999c => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:18.735303 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a630bf0-2591-4710-a5c2-6f295bb489e5 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:18.735303 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a630bf0-2591-4710-a5c2-6f295bb489e5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:18.735303 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a630bf0-2591-4710-a5c2-6f295bb489e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:18.758575 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe1037-89ee-4632-8a56-4aa54835dcf3 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:18.763176 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1a630bf0-2591-4710-a5c2-6f295bb489e5 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:18.764427 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1a630bf0-2591-4710-a5c2-6f295bb489e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:18.849444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 896/1811] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:18.851655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca9845-fd17-476b-abe9-687616169bbf None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:18.852165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca9845-fd17-476b-abe9-687616169bbf None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:18.852445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca9845-fd17-476b-abe9-687616169bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:18.870519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ef765-5b0a-4013-8057-095e1fa9381e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:18.876172 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ef765-5b0a-4013-8057-095e1fa9381e admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:18.876172 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ef765-5b0a-4013-8057-095e1fa9381e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:18.876172 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ef765-5b0a-4013-8057-095e1fa9381e admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:18.876172 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ef765-5b0a-4013-8057-095e1fa9381e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:18:18.876172 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ef765-5b0a-4013-8057-095e1fa9381e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:18.877622 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ef765-5b0a-4013-8057-095e1fa9381e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:18.882128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-68ca9845-fd17-476b-abe9-687616169bbf None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:18.884251 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-68ca9845-fd17-476b-abe9-687616169bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:18.893144 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 916/1812] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:18:18.894533 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ef765-5b0a-4013-8057-095e1fa9381e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:18.896124 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 897/1813] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:18.897592 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca9845-fd17-476b-abe9-687616169bbf None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:18.900277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-364ef765-5b0a-4013-8057-095e1fa9381e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:18.910171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca9845-fd17-476b-abe9-687616169bbf None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:18.915866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4b683-2624-48d6-9f6b-8590535119d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:18.916483 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4b683-2624-48d6-9f6b-8590535119d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:18.916775 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4b683-2624-48d6-9f6b-8590535119d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:18.917048 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4b683-2624-48d6-9f6b-8590535119d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:18.917898 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4b683-2624-48d6-9f6b-8590535119d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:18.920099 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4b683-2624-48d6-9f6b-8590535119d6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:18.986557 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ef765-5b0a-4013-8057-095e1fa9381e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:18.991291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102df42-613e-45cd-b17d-5241fac862be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:18.992434 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102df42-613e-45cd-b17d-5241fac862be service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:18.992916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102df42-613e-45cd-b17d-5241fac862be service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:18.993108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102df42-613e-45cd-b17d-5241fac862be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:19.009978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102df42-613e-45cd-b17d-5241fac862be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:19.011459 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102df42-613e-45cd-b17d-5241fac862be service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:19.029913 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 917/1814] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:19.030878 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102df42-613e-45cd-b17d-5241fac862be service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:19.045865 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 898/1815] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:18 2022] POST /identity/v3/projects => generated 369 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:19.048023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4b683-2624-48d6-9f6b-8590535119d6 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:19.051448 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102df42-613e-45cd-b17d-5241fac862be service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:19.100328 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:19.136312 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f88083-0d73-46bc-90e4-5062c95e8953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:19.137435 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f88083-0d73-46bc-90e4-5062c95e8953 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:19.138213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f88083-0d73-46bc-90e4-5062c95e8953 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:19.138682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f88083-0d73-46bc-90e4-5062c95e8953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:19.159719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4b683-2624-48d6-9f6b-8590535119d6 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:19.167480 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90163e58-33ac-46a0-8350-a91a5a3f4b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:19.168086 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90163e58-33ac-46a0-8350-a91a5a3f4b85 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:19.168368 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90163e58-33ac-46a0-8350-a91a5a3f4b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:19.168644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90163e58-33ac-46a0-8350-a91a5a3f4b85 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:19.169295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90163e58-33ac-46a0-8350-a91a5a3f4b85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:19.171985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90163e58-33ac-46a0-8350-a91a5a3f4b85 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:19.240595 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f88083-0d73-46bc-90e4-5062c95e8953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:19.243181 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f88083-0d73-46bc-90e4-5062c95e8953 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:19.256825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 918/1816] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:19.295478 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 899/1817] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:19 2022] POST /identity/v3/users => generated 285 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:18:19.300139 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f88083-0d73-46bc-90e4-5062c95e8953 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:19.312317 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f88083-0d73-46bc-90e4-5062c95e8953 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:19.319861 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c017d2-a138-4edc-962b-4f8514502bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:19.320864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c017d2-a138-4edc-962b-4f8514502bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:19.324938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c017d2-a138-4edc-962b-4f8514502bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:19.324938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c017d2-a138-4edc-962b-4f8514502bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:19.324938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c017d2-a138-4edc-962b-4f8514502bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:19.324938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c017d2-a138-4edc-962b-4f8514502bf6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:19.349332 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 919/1818] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:19.355357 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90163e58-33ac-46a0-8350-a91a5a3f4b85 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:19.370387 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90163e58-33ac-46a0-8350-a91a5a3f4b85 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:19.372954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:19.383670 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09610a04-4b45-49b8-9daf-ff8930a70d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:19.384703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09610a04-4b45-49b8-9daf-ff8930a70d95 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:19.384703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09610a04-4b45-49b8-9daf-ff8930a70d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:19.384928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09610a04-4b45-49b8-9daf-ff8930a70d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:19.385864 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09610a04-4b45-49b8-9daf-ff8930a70d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:19.388698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09610a04-4b45-49b8-9daf-ff8930a70d95 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:19.426950 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 900/1819] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:19.432397 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c017d2-a138-4edc-962b-4f8514502bf6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:19.449818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c017d2-a138-4edc-962b-4f8514502bf6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:19.458205 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ddd18-bb32-4a4a-a710-6cc279253576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:19.460450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ddd18-bb32-4a4a-a710-6cc279253576 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:19.461084 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ddd18-bb32-4a4a-a710-6cc279253576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:19.466766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ddd18-bb32-4a4a-a710-6cc279253576 admin admin] PATH_INFO: `/v3/projects/b55510feaa504b22903dfa9d217de718/users/abe57f90fced4c9a9f957a94c1c16584/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:19.510039 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ddd18-bb32-4a4a-a710-6cc279253576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55510feaa504b22903dfa9d217de718, user_id=abe57f90fced4c9a9f957a94c1c16584, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:19.520748 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ddd18-bb32-4a4a-a710-6cc279253576 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:19.659642 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 920/1820] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:19 2022] PUT /identity/v3/projects/b55510feaa504b22903dfa9d217de718/users/abe57f90fced4c9a9f957a94c1c16584/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:19.670863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3847892-a822-47a8-93cb-5a9af5dceff2 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:19.671404 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3847892-a822-47a8-93cb-5a9af5dceff2 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:19.671832 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3847892-a822-47a8-93cb-5a9af5dceff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:19.714452 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ddd18-bb32-4a4a-a710-6cc279253576 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:19.718807 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2d5ddd18-bb32-4a4a-a710-6cc279253576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:19.784770 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c3847892-a822-47a8-93cb-5a9af5dceff2 None None] MFA Rules not processed for user `abe57f90fced4c9a9f957a94c1c16584`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:19.785859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c3847892-a822-47a8-93cb-5a9af5dceff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:19.835249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ddd18-bb32-4a4a-a710-6cc279253576 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:19.842918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02bd0d-d97e-4e9a-81b0-a5c6d5bc9bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:19.844270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02bd0d-d97e-4e9a-81b0-a5c6d5bc9bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:19.844812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02bd0d-d97e-4e9a-81b0-a5c6d5bc9bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:19.845288 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02bd0d-d97e-4e9a-81b0-a5c6d5bc9bb0 admin admin] PATH_INFO: `/v3/users/1ba27aee523b4aeda3d6f081ba2f6545` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:19.847829 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02bd0d-d97e-4e9a-81b0-a5c6d5bc9bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ba27aee523b4aeda3d6f081ba2f6545)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:19.851459 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c02bd0d-d97e-4e9a-81b0-a5c6d5bc9bb0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:19.889663 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 901/1821] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:19.894126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3847892-a822-47a8-93cb-5a9af5dceff2 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:19.915036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3847892-a822-47a8-93cb-5a9af5dceff2 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:19.921211 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf7c6b-d580-4e5c-9802-3a7ffec1bcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:19.922121 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf7c6b-d580-4e5c-9802-3a7ffec1bcd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:19.922620 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf7c6b-d580-4e5c-9802-3a7ffec1bcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:19.923027 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf7c6b-d580-4e5c-9802-3a7ffec1bcd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:19.925834 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf7c6b-d580-4e5c-9802-3a7ffec1bcd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:19.927505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf7c6b-d580-4e5c-9802-3a7ffec1bcd4 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:20.071869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 902/1822] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:19 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:20.080595 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf7c6b-d580-4e5c-9802-3a7ffec1bcd4 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:20.083450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0c02bd0d-d97e-4e9a-81b0-a5c6d5bc9bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ba27aee523b4aeda3d6f081ba2f6545'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:20.183329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0c02bd0d-d97e-4e9a-81b0-a5c6d5bc9bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ba27aee523b4aeda3d6f081ba2f6545'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:20.183995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0c02bd0d-d97e-4e9a-81b0-a5c6d5bc9bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ba27aee523b4aeda3d6f081ba2f6545'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:20.184673 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0c02bd0d-d97e-4e9a-81b0-a5c6d5bc9bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ba27aee523b4aeda3d6f081ba2f6545'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:20.194136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0c02bd0d-d97e-4e9a-81b0-a5c6d5bc9bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ba27aee523b4aeda3d6f081ba2f6545'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:20.206404 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf7c6b-d580-4e5c-9802-3a7ffec1bcd4 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:20.221244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f23b09-1a91-428f-883a-e454352297d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:20.223288 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f23b09-1a91-428f-883a-e454352297d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:20.225193 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f23b09-1a91-428f-883a-e454352297d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:20.225595 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f23b09-1a91-428f-883a-e454352297d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:20.226340 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f23b09-1a91-428f-883a-e454352297d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:20.232625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f23b09-1a91-428f-883a-e454352297d2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:20.247033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 921/1823] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:19 2022] DELETE /identity/v3/users/1ba27aee523b4aeda3d6f081ba2f6545 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:20.251846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b631bc-2bf8-4179-a623-6c1b09f33c0d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:20.252145 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b631bc-2bf8-4179-a623-6c1b09f33c0d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:20.254651 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b631bc-2bf8-4179-a623-6c1b09f33c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:20.297625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-71b631bc-2bf8-4179-a623-6c1b09f33c0d None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:20.299342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-71b631bc-2bf8-4179-a623-6c1b09f33c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:20.369240 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 903/1824] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:20 2022] POST /identity/v3/users => generated 290 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:20.374067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f23b09-1a91-428f-883a-e454352297d2 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:20.374705 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:20.384140 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-72f23b09-1a91-428f-883a-e454352297d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:20.406077 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f23b09-1a91-428f-883a-e454352297d2 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:20.437411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 922/1825] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:20.457140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b631bc-2bf8-4179-a623-6c1b09f33c0d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:20.467471 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-71b631bc-2bf8-4179-a623-6c1b09f33c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:20.523780 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99d659-9c7a-407b-a2e8-e193b7993d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:20.524583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99d659-9c7a-407b-a2e8-e193b7993d02 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:20.525029 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99d659-9c7a-407b-a2e8-e193b7993d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:20.525526 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99d659-9c7a-407b-a2e8-e193b7993d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:20.526560 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99d659-9c7a-407b-a2e8-e193b7993d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:20.529259 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99d659-9c7a-407b-a2e8-e193b7993d02 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:20.543469 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 904/1826] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:20.547227 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99d659-9c7a-407b-a2e8-e193b7993d02 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:20.561474 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99d659-9c7a-407b-a2e8-e193b7993d02 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:20.568592 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908389a1-e132-4077-a6a8-747c5bc8b36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:20.569439 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908389a1-e132-4077-a6a8-747c5bc8b36f admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:20.569752 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908389a1-e132-4077-a6a8-747c5bc8b36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:20.570084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908389a1-e132-4077-a6a8-747c5bc8b36f admin admin] PATH_INFO: `/v3/projects/38a07ce3faaf4d35af97285f45c00bc9/users/472898432b0947b99307c923f2833c88/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:20.572057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b631bc-2bf8-4179-a623-6c1b09f33c0d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:20.579417 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43a9a4-1cc6-415e-a52c-39f54ccc6e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:20.581625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43a9a4-1cc6-415e-a52c-39f54ccc6e63 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:20.582063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43a9a4-1cc6-415e-a52c-39f54ccc6e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:20.583314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43a9a4-1cc6-415e-a52c-39f54ccc6e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:20.596713 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908389a1-e132-4077-a6a8-747c5bc8b36f admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a07ce3faaf4d35af97285f45c00bc9, user_id=472898432b0947b99307c923f2833c88, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:20.602435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908389a1-e132-4077-a6a8-747c5bc8b36f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:20.625740 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43a9a4-1cc6-415e-a52c-39f54ccc6e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:20.627948 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43a9a4-1cc6-415e-a52c-39f54ccc6e63 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:20.659578 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 923/1827] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:20.728819 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 905/1828] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:20 2022] PUT /identity/v3/projects/38a07ce3faaf4d35af97285f45c00bc9/users/472898432b0947b99307c923f2833c88/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:20.732445 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43a9a4-1cc6-415e-a52c-39f54ccc6e63 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:20.739039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:20.745976 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43a9a4-1cc6-415e-a52c-39f54ccc6e63 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:20.820252 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25983d8-c623-4f59-9fba-cc80b8a1d701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:20.820917 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25983d8-c623-4f59-9fba-cc80b8a1d701 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:20.821385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25983d8-c623-4f59-9fba-cc80b8a1d701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:20.823701 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25983d8-c623-4f59-9fba-cc80b8a1d701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:20.824603 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25983d8-c623-4f59-9fba-cc80b8a1d701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:20.826684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25983d8-c623-4f59-9fba-cc80b8a1d701 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:20.853203 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 924/1829] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:20.856338 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908389a1-e132-4077-a6a8-747c5bc8b36f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:20.887731 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908389a1-e132-4077-a6a8-747c5bc8b36f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:20.906584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe688362-25ab-4e1e-91e1-181ba74623b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:20.907515 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe688362-25ab-4e1e-91e1-181ba74623b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:20.908567 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe688362-25ab-4e1e-91e1-181ba74623b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:20.909209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe688362-25ab-4e1e-91e1-181ba74623b4 admin admin] PATH_INFO: `/v3/projects/38a07ce3faaf4d35af97285f45c00bc9/users/472898432b0947b99307c923f2833c88/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:20.917185 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe688362-25ab-4e1e-91e1-181ba74623b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a07ce3faaf4d35af97285f45c00bc9, user_id=472898432b0947b99307c923f2833c88, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:20.920542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe688362-25ab-4e1e-91e1-181ba74623b4 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:20.933679 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 906/1830] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:20 2022] PUT /identity/v3/projects/38a07ce3faaf4d35af97285f45c00bc9/users/472898432b0947b99307c923f2833c88/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:20.944068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92f224-c783-4d0a-ad27-97a8c420d75f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:20.944549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92f224-c783-4d0a-ad27-97a8c420d75f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:20.945018 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92f224-c783-4d0a-ad27-97a8c420d75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:20.988790 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-fb92f224-c783-4d0a-ad27-97a8c420d75f None None] MFA Rules not processed for user `472898432b0947b99307c923f2833c88`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:20.990647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fb92f224-c783-4d0a-ad27-97a8c420d75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:21.172677 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe688362-25ab-4e1e-91e1-181ba74623b4 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:21.175541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fe688362-25ab-4e1e-91e1-181ba74623b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:21.185928 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 925/1831] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:21.192223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92f224-c783-4d0a-ad27-97a8c420d75f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:21.201189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fb92f224-c783-4d0a-ad27-97a8c420d75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:21.342879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe688362-25ab-4e1e-91e1-181ba74623b4 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:21.354228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc1c46-332f-4989-acca-0cd159a0b410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:21.354228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc1c46-332f-4989-acca-0cd159a0b410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:21.354228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc1c46-332f-4989-acca-0cd159a0b410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:21.354581 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc1c46-332f-4989-acca-0cd159a0b410 admin admin] PATH_INFO: `/v3/projects/0a79a3deb0944be19bf20839e16257c9` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:21.355697 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc1c46-332f-4989-acca-0cd159a0b410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a79a3deb0944be19bf20839e16257c9)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:21.359580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc1c46-332f-4989-acca-0cd159a0b410 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:21.375810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92f224-c783-4d0a-ad27-97a8c420d75f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:21.387426 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cc3e0-3251-4afa-acc4-ae376959b352 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:21.388054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cc3e0-3251-4afa-acc4-ae376959b352 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:21.388894 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cc3e0-3251-4afa-acc4-ae376959b352 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:21.388894 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cc3e0-3251-4afa-acc4-ae376959b352 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:21.424387 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cc3e0-3251-4afa-acc4-ae376959b352 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:21.425916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cc3e0-3251-4afa-acc4-ae376959b352 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:21.452598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 926/1832] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:21.490935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cc3e0-3251-4afa-acc4-ae376959b352 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:21.493049 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e59cc3e0-3251-4afa-acc4-ae376959b352 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:21.524246 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d9dc1c46-332f-4989-acca-0cd159a0b410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a79a3deb0944be19bf20839e16257c9', 'request_id': 'req-d9dc1c46-332f-4989-acca-0cd159a0b410'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:21.539228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cc3e0-3251-4afa-acc4-ae376959b352 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:21.560053 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d9dc1c46-332f-4989-acca-0cd159a0b410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a79a3deb0944be19bf20839e16257c9', 'request_id': 'req-d9dc1c46-332f-4989-acca-0cd159a0b410'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:21.647707 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe408d-4476-4c5e-9fed-3148a0f2ae62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:21.648522 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe408d-4476-4c5e-9fed-3148a0f2ae62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:21.648919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe408d-4476-4c5e-9fed-3148a0f2ae62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:21.649356 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe408d-4476-4c5e-9fed-3148a0f2ae62 admin admin] PATH_INFO: `/v3/projects/e83ddf5e7d8f4cef8efd07f4b8342610` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:21.651330 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe408d-4476-4c5e-9fed-3148a0f2ae62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e83ddf5e7d8f4cef8efd07f4b8342610)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:21.663761 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe408d-4476-4c5e-9fed-3148a0f2ae62 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:21.699295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d9dc1c46-332f-4989-acca-0cd159a0b410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a79a3deb0944be19bf20839e16257c9', 'request_id': 'req-d9dc1c46-332f-4989-acca-0cd159a0b410'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:21.723245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d9dc1c46-332f-4989-acca-0cd159a0b410 admin admin] The token cache is being invalidate because project 0a79a3deb0944be19bf20839e16257c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:21.723549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d9dc1c46-332f-4989-acca-0cd159a0b410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:21.725180 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d9dc1c46-332f-4989-acca-0cd159a0b410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:21.734604 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 907/1833] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:21 2022] DELETE /identity/v3/projects/0a79a3deb0944be19bf20839e16257c9 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:21.735636 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc1c46-332f-4989-acca-0cd159a0b410 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:21.738355 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d9dc1c46-332f-4989-acca-0cd159a0b410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:21.759124 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc1c46-332f-4989-acca-0cd159a0b410 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:21.766482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ac005-7851-477b-95ea-9ba332b5e882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:21.781157 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ac005-7851-477b-95ea-9ba332b5e882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:21.781881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ac005-7851-477b-95ea-9ba332b5e882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:21.790094 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ac005-7851-477b-95ea-9ba332b5e882 admin admin] PATH_INFO: `/v3/projects/bb3335b8b10d44e989f6376b8b5b881d` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:21.793812 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ac005-7851-477b-95ea-9ba332b5e882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb3335b8b10d44e989f6376b8b5b881d)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:21.795590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ac005-7851-477b-95ea-9ba332b5e882 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:21.885829 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-67fe408d-4476-4c5e-9fed-3148a0f2ae62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e83ddf5e7d8f4cef8efd07f4b8342610', 'request_id': 'req-67fe408d-4476-4c5e-9fed-3148a0f2ae62'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:21.892005 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-67fe408d-4476-4c5e-9fed-3148a0f2ae62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e83ddf5e7d8f4cef8efd07f4b8342610', 'request_id': 'req-67fe408d-4476-4c5e-9fed-3148a0f2ae62'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:21.934256 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:21.962375 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-67fe408d-4476-4c5e-9fed-3148a0f2ae62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e83ddf5e7d8f4cef8efd07f4b8342610', 'request_id': 'req-67fe408d-4476-4c5e-9fed-3148a0f2ae62'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:21.976825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-67fe408d-4476-4c5e-9fed-3148a0f2ae62 admin admin] The token cache is being invalidate because project e83ddf5e7d8f4cef8efd07f4b8342610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:21.977128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-67fe408d-4476-4c5e-9fed-3148a0f2ae62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:21.977867 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-67fe408d-4476-4c5e-9fed-3148a0f2ae62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:21.979896 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 927/1834] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:21 2022] DELETE /identity/v3/projects/e83ddf5e7d8f4cef8efd07f4b8342610 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:21.980821 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe408d-4476-4c5e-9fed-3148a0f2ae62 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:21.986436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-67fe408d-4476-4c5e-9fed-3148a0f2ae62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:21.994177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-583ac005-7851-477b-95ea-9ba332b5e882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb3335b8b10d44e989f6376b8b5b881d', 'request_id': 'req-583ac005-7851-477b-95ea-9ba332b5e882'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:21.999832 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-583ac005-7851-477b-95ea-9ba332b5e882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb3335b8b10d44e989f6376b8b5b881d', 'request_id': 'req-583ac005-7851-477b-95ea-9ba332b5e882'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:22.043610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe408d-4476-4c5e-9fed-3148a0f2ae62 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:22.081073 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-583ac005-7851-477b-95ea-9ba332b5e882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb3335b8b10d44e989f6376b8b5b881d', 'request_id': 'req-583ac005-7851-477b-95ea-9ba332b5e882'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:22.081601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:22.093799 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-583ac005-7851-477b-95ea-9ba332b5e882 admin admin] The token cache is being invalidate because project bb3335b8b10d44e989f6376b8b5b881d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:22.094095 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-583ac005-7851-477b-95ea-9ba332b5e882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:22.094766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-583ac005-7851-477b-95ea-9ba332b5e882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:22.096710 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 908/1835] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:21 2022] DELETE /identity/v3/projects/bb3335b8b10d44e989f6376b8b5b881d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:22.100903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498f86a-aa51-4386-bdd5-afb77ec278b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:22.101046 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ac005-7851-477b-95ea-9ba332b5e882 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:22.101879 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498f86a-aa51-4386-bdd5-afb77ec278b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:22.102232 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498f86a-aa51-4386-bdd5-afb77ec278b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:22.102583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498f86a-aa51-4386-bdd5-afb77ec278b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:22.102703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-583ac005-7851-477b-95ea-9ba332b5e882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:22.104593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b498f86a-aa51-4386-bdd5-afb77ec278b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:22.167378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498f86a-aa51-4386-bdd5-afb77ec278b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:22.169037 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498f86a-aa51-4386-bdd5-afb77ec278b1 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:22.176639 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ac005-7851-477b-95ea-9ba332b5e882 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:22.179238 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 928/1836] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:22.180002 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498f86a-aa51-4386-bdd5-afb77ec278b1 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:22.181489 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b498f86a-aa51-4386-bdd5-afb77ec278b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:22.197717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb009e9-d932-4c1c-b528-f05fc93794e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:22.197717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb009e9-d932-4c1c-b528-f05fc93794e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:22.197717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb009e9-d932-4c1c-b528-f05fc93794e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:22.197717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb009e9-d932-4c1c-b528-f05fc93794e3 admin admin] PATH_INFO: `/v3/users/eb460256f7ee4f9d9b4af653c59057a1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:22.198083 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb009e9-d932-4c1c-b528-f05fc93794e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb460256f7ee4f9d9b4af653c59057a1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:22.198083 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb009e9-d932-4c1c-b528-f05fc93794e3 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:22.202671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498f86a-aa51-4386-bdd5-afb77ec278b1 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:22.209891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1b7c7-53df-43c7-8b6d-469450f9e58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:22.210915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1b7c7-53df-43c7-8b6d-469450f9e58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:22.211205 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1b7c7-53df-43c7-8b6d-469450f9e58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:22.211647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1b7c7-53df-43c7-8b6d-469450f9e58f admin admin] PATH_INFO: `/v3/users/156af3d6752b4e319eadcfe4ca515145` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:22.213801 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1b7c7-53df-43c7-8b6d-469450f9e58f admin admin] RBAC: Authorizing `identity:delete_user(user_id=156af3d6752b4e319eadcfe4ca515145)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:22.216495 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1b7c7-53df-43c7-8b6d-469450f9e58f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:22.444881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9cc1b7c7-53df-43c7-8b6d-469450f9e58f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '156af3d6752b4e319eadcfe4ca515145'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:22.447132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bbb009e9-d932-4c1c-b528-f05fc93794e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb460256f7ee4f9d9b4af653c59057a1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:22.456568 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bbb009e9-d932-4c1c-b528-f05fc93794e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb460256f7ee4f9d9b4af653c59057a1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:22.457428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bbb009e9-d932-4c1c-b528-f05fc93794e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb460256f7ee4f9d9b4af653c59057a1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:22.458163 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bbb009e9-d932-4c1c-b528-f05fc93794e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb460256f7ee4f9d9b4af653c59057a1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:22.516964 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9cc1b7c7-53df-43c7-8b6d-469450f9e58f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '156af3d6752b4e319eadcfe4ca515145'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:22.518396 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9cc1b7c7-53df-43c7-8b6d-469450f9e58f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '156af3d6752b4e319eadcfe4ca515145'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:22.519426 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9cc1b7c7-53df-43c7-8b6d-469450f9e58f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '156af3d6752b4e319eadcfe4ca515145'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:22.527441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9cc1b7c7-53df-43c7-8b6d-469450f9e58f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '156af3d6752b4e319eadcfe4ca515145'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:22.545837 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 929/1837] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:22 2022] DELETE /identity/v3/users/156af3d6752b4e319eadcfe4ca515145 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:22.547105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d421a25-f966-4d34-b869-af4e40a0a50c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:22.547388 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d421a25-f966-4d34-b869-af4e40a0a50c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:22.547655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d421a25-f966-4d34-b869-af4e40a0a50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:22.575963 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3d421a25-f966-4d34-b869-af4e40a0a50c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:22.577074 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3d421a25-f966-4d34-b869-af4e40a0a50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:22.636677 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bbb009e9-d932-4c1c-b528-f05fc93794e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb460256f7ee4f9d9b4af653c59057a1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:22.643918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 930/1838] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:22.657751 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d73b0-4d5a-4d13-b971-f81549412e20 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:22.658398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d73b0-4d5a-4d13-b971-f81549412e20 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:22.659126 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d73b0-4d5a-4d13-b971-f81549412e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:22.662769 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 909/1839] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:22 2022] DELETE /identity/v3/users/eb460256f7ee4f9d9b4af653c59057a1 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:22.681909 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-199d73b0-4d5a-4d13-b971-f81549412e20 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:22.683625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-199d73b0-4d5a-4d13-b971-f81549412e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:22.752173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 931/1840] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:22.753520 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb009e9-d932-4c1c-b528-f05fc93794e3 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:22.755560 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-bbb009e9-d932-4c1c-b528-f05fc93794e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:22.771167 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb009e9-d932-4c1c-b528-f05fc93794e3 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:22.776151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818e6bd-7f8b-488a-a6eb-340b85d2d761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:22.776985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818e6bd-7f8b-488a-a6eb-340b85d2d761 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:22.777484 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818e6bd-7f8b-488a-a6eb-340b85d2d761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:22.777881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818e6bd-7f8b-488a-a6eb-340b85d2d761 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:22.778804 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818e6bd-7f8b-488a-a6eb-340b85d2d761 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:18:22.779342 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818e6bd-7f8b-488a-a6eb-340b85d2d761 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:22.781207 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818e6bd-7f8b-488a-a6eb-340b85d2d761 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:22.795554 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 910/1841] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:18:22.799979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d73b0-4d5a-4d13-b971-f81549412e20 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:22.809783 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d73b0-4d5a-4d13-b971-f81549412e20 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:22.815025 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855ef27-5fe3-4fd2-a9ff-41f84b59aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:22.815740 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ef27-5fe3-4fd2-a9ff-41f84b59aea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:22.816019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ef27-5fe3-4fd2-a9ff-41f84b59aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:22.816290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ef27-5fe3-4fd2-a9ff-41f84b59aea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:22.816936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855ef27-5fe3-4fd2-a9ff-41f84b59aea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:22.818877 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855ef27-5fe3-4fd2-a9ff-41f84b59aea8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:22.932415 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 932/1842] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:22 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:18:22.933319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818e6bd-7f8b-488a-a6eb-340b85d2d761 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:22.954233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818e6bd-7f8b-488a-a6eb-340b85d2d761 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:23.054312 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109df537-b581-41f5-9703-8ab7f39a974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:23.055103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109df537-b581-41f5-9703-8ab7f39a974c admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:23.055523 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109df537-b581-41f5-9703-8ab7f39a974c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:23.055955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109df537-b581-41f5-9703-8ab7f39a974c admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:23.056726 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109df537-b581-41f5-9703-8ab7f39a974c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:23.059008 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109df537-b581-41f5-9703-8ab7f39a974c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:23.113323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855ef27-5fe3-4fd2-a9ff-41f84b59aea8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:23.115251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a855ef27-5fe3-4fd2-a9ff-41f84b59aea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:23.130823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855ef27-5fe3-4fd2-a9ff-41f84b59aea8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:23.137290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f943291-28fd-49a8-aa7b-4300ce26d01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:23.138219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f943291-28fd-49a8-aa7b-4300ce26d01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:23.138719 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f943291-28fd-49a8-aa7b-4300ce26d01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:23.139239 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f943291-28fd-49a8-aa7b-4300ce26d01b admin admin] PATH_INFO: `/v3/projects/f1a7f0ce873048a6a4b60c8989540a73` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:23.140710 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f943291-28fd-49a8-aa7b-4300ce26d01b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a7f0ce873048a6a4b60c8989540a73)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:23.143055 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f943291-28fd-49a8-aa7b-4300ce26d01b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:23.175160 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 911/1843] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:22 2022] POST /identity/v3/users => generated 285 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:23.176805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109df537-b581-41f5-9703-8ab7f39a974c admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:23.187149 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109df537-b581-41f5-9703-8ab7f39a974c admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:23.191868 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc629f13-df5d-4802-b74a-c71130c9432f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:23.192473 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc629f13-df5d-4802-b74a-c71130c9432f admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:23.192751 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc629f13-df5d-4802-b74a-c71130c9432f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:23.193176 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc629f13-df5d-4802-b74a-c71130c9432f admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:23.193842 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc629f13-df5d-4802-b74a-c71130c9432f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:23.195478 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc629f13-df5d-4802-b74a-c71130c9432f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:23.207679 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 912/1844] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:23.211663 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc629f13-df5d-4802-b74a-c71130c9432f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:23.223508 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc629f13-df5d-4802-b74a-c71130c9432f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:23.228378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c656cb7-e31b-44e5-aa43-125bd1fa13cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:23.228977 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c656cb7-e31b-44e5-aa43-125bd1fa13cd admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:23.229377 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c656cb7-e31b-44e5-aa43-125bd1fa13cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:23.229680 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c656cb7-e31b-44e5-aa43-125bd1fa13cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:23.230312 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c656cb7-e31b-44e5-aa43-125bd1fa13cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:23.231889 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c656cb7-e31b-44e5-aa43-125bd1fa13cd admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:23.241960 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 913/1845] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:18:23.245931 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c656cb7-e31b-44e5-aa43-125bd1fa13cd admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:23.255373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c656cb7-e31b-44e5-aa43-125bd1fa13cd admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:23.259782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e65bae-9149-4206-9589-0f3c582688db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:23.260391 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e65bae-9149-4206-9589-0f3c582688db admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:23.260665 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e65bae-9149-4206-9589-0f3c582688db admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:23.260933 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e65bae-9149-4206-9589-0f3c582688db admin admin] PATH_INFO: `/v3/projects/f642d1a9654249e6a366ea4336cfb36a/users/38d5eee0f6884b65ac78368b4302bbcb/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:23.275379 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e65bae-9149-4206-9589-0f3c582688db admin admin] RBAC: Authorizing `identity:create_grant(project_id=f642d1a9654249e6a366ea4336cfb36a, user_id=38d5eee0f6884b65ac78368b4302bbcb, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:23.278067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e65bae-9149-4206-9589-0f3c582688db admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:23.287635 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0f943291-28fd-49a8-aa7b-4300ce26d01b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a7f0ce873048a6a4b60c8989540a73', 'request_id': 'req-0f943291-28fd-49a8-aa7b-4300ce26d01b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:23.294126 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0f943291-28fd-49a8-aa7b-4300ce26d01b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a7f0ce873048a6a4b60c8989540a73', 'request_id': 'req-0f943291-28fd-49a8-aa7b-4300ce26d01b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:23.334784 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 914/1846] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:23 2022] PUT /identity/v3/projects/f642d1a9654249e6a366ea4336cfb36a/users/38d5eee0f6884b65ac78368b4302bbcb/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:23.335617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e65bae-9149-4206-9589-0f3c582688db admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:23.337322 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e1e65bae-9149-4206-9589-0f3c582688db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:23.351681 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0f943291-28fd-49a8-aa7b-4300ce26d01b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a7f0ce873048a6a4b60c8989540a73', 'request_id': 'req-0f943291-28fd-49a8-aa7b-4300ce26d01b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:23.363948 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0f943291-28fd-49a8-aa7b-4300ce26d01b admin admin] The token cache is being invalidate because project f1a7f0ce873048a6a4b60c8989540a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:23.364240 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0f943291-28fd-49a8-aa7b-4300ce26d01b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:23.364897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0f943291-28fd-49a8-aa7b-4300ce26d01b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:23.366441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 933/1847] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:23 2022] DELETE /identity/v3/projects/f1a7f0ce873048a6a4b60c8989540a73 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:23.367622 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fce8c-62f9-4c45-bcaf-7ca3e22db578 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:23.367907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fce8c-62f9-4c45-bcaf-7ca3e22db578 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:23.368223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fce8c-62f9-4c45-bcaf-7ca3e22db578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:23.396430 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-265fce8c-62f9-4c45-bcaf-7ca3e22db578 None None] MFA Rules not processed for user `38d5eee0f6884b65ac78368b4302bbcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:23.397717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-265fce8c-62f9-4c45-bcaf-7ca3e22db578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:23.403106 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e65bae-9149-4206-9589-0f3c582688db admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:23.407441 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2b9d6-c656-4645-887b-4fe65e2eed80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:23.408617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2b9d6-c656-4645-887b-4fe65e2eed80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:23.408890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2b9d6-c656-4645-887b-4fe65e2eed80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:23.409306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2b9d6-c656-4645-887b-4fe65e2eed80 admin admin] PATH_INFO: `/v3/projects/c7fa36e96b31455b9a985dd5ad67b227` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:23.410467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2b9d6-c656-4645-887b-4fe65e2eed80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7fa36e96b31455b9a985dd5ad67b227)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:23.412478 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2b9d6-c656-4645-887b-4fe65e2eed80 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:23.460460 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 934/1848] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:23.461743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66affe1-665a-4601-bab8-bd8f15c34d8c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:23.462024 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66affe1-665a-4601-bab8-bd8f15c34d8c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:23.462297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66affe1-665a-4601-bab8-bd8f15c34d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:23.482029 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d66affe1-665a-4601-bab8-bd8f15c34d8c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:23.483214 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d66affe1-665a-4601-bab8-bd8f15c34d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:23.491196 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 935/1849] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:23.492025 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66affe1-665a-4601-bab8-bd8f15c34d8c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:23.493252 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d66affe1-665a-4601-bab8-bd8f15c34d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:23.510344 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b6b2b9d6-c656-4645-887b-4fe65e2eed80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7fa36e96b31455b9a985dd5ad67b227', 'request_id': 'req-b6b2b9d6-c656-4645-887b-4fe65e2eed80'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:23.516093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b6b2b9d6-c656-4645-887b-4fe65e2eed80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7fa36e96b31455b9a985dd5ad67b227', 'request_id': 'req-b6b2b9d6-c656-4645-887b-4fe65e2eed80'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:23.570025 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66affe1-665a-4601-bab8-bd8f15c34d8c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:23.582801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b6b2b9d6-c656-4645-887b-4fe65e2eed80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7fa36e96b31455b9a985dd5ad67b227', 'request_id': 'req-b6b2b9d6-c656-4645-887b-4fe65e2eed80'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:23.594891 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b6b2b9d6-c656-4645-887b-4fe65e2eed80 admin admin] The token cache is being invalidate because project c7fa36e96b31455b9a985dd5ad67b227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:23.595222 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b6b2b9d6-c656-4645-887b-4fe65e2eed80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:23.596307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b6b2b9d6-c656-4645-887b-4fe65e2eed80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:23.598008 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 915/1850] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:23 2022] DELETE /identity/v3/projects/c7fa36e96b31455b9a985dd5ad67b227 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:23.599136 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3624fa-ee6c-4539-8a34-bffcda44290a None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:23.599677 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3624fa-ee6c-4539-8a34-bffcda44290a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:23.599956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3624fa-ee6c-4539-8a34-bffcda44290a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:23.619817 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-cb3624fa-ee6c-4539-8a34-bffcda44290a None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:23.620421 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a6285-399a-433c-aeea-0e25ab2a26f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d8000eb20445b78ee56ac372cd024c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:23.621038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a6285-399a-433c-aeea-0e25ab2a26f8 service glance] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:23.621150 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cb3624fa-ee6c-4539-8a34-bffcda44290a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:23.621323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a6285-399a-433c-aeea-0e25ab2a26f8 service glance] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:23.621633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a6285-399a-433c-aeea-0e25ab2a26f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:23.623339 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e14a6285-399a-433c-aeea-0e25ab2a26f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:23.685257 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 916/1851] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:23.686474 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a23a79-5f16-4006-bff9-a444f8ae5c7b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:23.686755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a23a79-5f16-4006-bff9-a444f8ae5c7b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:23.687032 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a23a79-5f16-4006-bff9-a444f8ae5c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:23.688720 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a6285-399a-433c-aeea-0e25ab2a26f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:23.691492 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a6285-399a-433c-aeea-0e25ab2a26f8 service glance] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:23.702248 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 936/1852] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:23.702970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a6285-399a-433c-aeea-0e25ab2a26f8 service glance] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:23.715428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-98a23a79-5f16-4006-bff9-a444f8ae5c7b None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:23.717427 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-98a23a79-5f16-4006-bff9-a444f8ae5c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:23.719913 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a6285-399a-433c-aeea-0e25ab2a26f8 service glance] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:23.729101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1dde0-fa9e-449b-a2ce-132302c80349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:23.729835 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1dde0-fa9e-449b-a2ce-132302c80349 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:23.730141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 917/1853] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:23.730278 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1dde0-fa9e-449b-a2ce-132302c80349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:23.730444 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1dde0-fa9e-449b-a2ce-132302c80349 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:23.731110 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1dde0-fa9e-449b-a2ce-132302c80349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:18:23.731416 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1dde0-fa9e-449b-a2ce-132302c80349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:23.733023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1dde0-fa9e-449b-a2ce-132302c80349 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:23.738291 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f77cb9-864d-4268-beb2-6955dc8eaca4 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:23.738687 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f77cb9-864d-4268-beb2-6955dc8eaca4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:23.739035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f77cb9-864d-4268-beb2-6955dc8eaca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:23.749376 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 937/1854] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:18:23.750474 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1dde0-fa9e-449b-a2ce-132302c80349 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:23.760297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-92f77cb9-864d-4268-beb2-6955dc8eaca4 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:23.761509 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-92f77cb9-864d-4268-beb2-6955dc8eaca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:23.763417 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1dde0-fa9e-449b-a2ce-132302c80349 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:23.772722 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a93f1-9cf9-427b-9ba7-787bffbac4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:23.772722 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a93f1-9cf9-427b-9ba7-787bffbac4ff admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:23.772722 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a93f1-9cf9-427b-9ba7-787bffbac4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:23.772722 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a93f1-9cf9-427b-9ba7-787bffbac4ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:23.773016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 918/1855] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:23.773108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a93f1-9cf9-427b-9ba7-787bffbac4ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:23.773751 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a93f1-9cf9-427b-9ba7-787bffbac4ff admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:23.776270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f77cb9-864d-4268-beb2-6955dc8eaca4 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:23.796432 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f77cb9-864d-4268-beb2-6955dc8eaca4 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:23.802627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89e07d-07e6-4ebb-9b9f-d322593c5caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:23.803362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e07d-07e6-4ebb-9b9f-d322593c5caf admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:23.804230 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e07d-07e6-4ebb-9b9f-d322593c5caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:23.804575 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e07d-07e6-4ebb-9b9f-d322593c5caf admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:23.805303 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89e07d-07e6-4ebb-9b9f-d322593c5caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:18:23.805710 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89e07d-07e6-4ebb-9b9f-d322593c5caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:23.807397 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89e07d-07e6-4ebb-9b9f-d322593c5caf admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:23.825489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 919/1856] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:18:23.828090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89e07d-07e6-4ebb-9b9f-d322593c5caf admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:23.839336 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89e07d-07e6-4ebb-9b9f-d322593c5caf admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:23.844087 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ae77c-e747-4847-a5a0-9d156b7ed552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:23.844677 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ae77c-e747-4847-a5a0-9d156b7ed552 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:23.844962 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ae77c-e747-4847-a5a0-9d156b7ed552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:23.845275 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ae77c-e747-4847-a5a0-9d156b7ed552 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:23.846308 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ae77c-e747-4847-a5a0-9d156b7ed552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:23.848232 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ae77c-e747-4847-a5a0-9d156b7ed552 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:23.882196 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 938/1857] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:23 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:23.883206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a93f1-9cf9-427b-9ba7-787bffbac4ff admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:23.946912 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a93f1-9cf9-427b-9ba7-787bffbac4ff admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:23.948240 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 920/1858] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:23 2022] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:23.952289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ae77c-e747-4847-a5a0-9d156b7ed552 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:23.967887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:24.016529 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e652d-73fd-4099-babb-987f842c02cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:24.017254 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e652d-73fd-4099-babb-987f842c02cf admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:24.017800 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e652d-73fd-4099-babb-987f842c02cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:24.018077 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e652d-73fd-4099-babb-987f842c02cf admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:24.018882 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e652d-73fd-4099-babb-987f842c02cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:24.020928 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e652d-73fd-4099-babb-987f842c02cf admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:24.024601 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ae77c-e747-4847-a5a0-9d156b7ed552 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:24.029762 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41003e-9e8c-4abe-8f51-117d0d413ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:24.030555 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41003e-9e8c-4abe-8f51-117d0d413ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:24.030835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41003e-9e8c-4abe-8f51-117d0d413ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:24.031107 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41003e-9e8c-4abe-8f51-117d0d413ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:24.031877 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41003e-9e8c-4abe-8f51-117d0d413ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:24.034115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41003e-9e8c-4abe-8f51-117d0d413ee1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:24.042802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:24.144194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 939/1859] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:23 2022] POST /identity/v3/users => generated 285 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:24.147555 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e652d-73fd-4099-babb-987f842c02cf admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:24.147695 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 921/1860] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:23 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:24.151057 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41003e-9e8c-4abe-8f51-117d0d413ee1 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:24.170147 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e652d-73fd-4099-babb-987f842c02cf admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:24.170352 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41003e-9e8c-4abe-8f51-117d0d413ee1 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:24.172129 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1cee5-20c3-4f54-a276-0a6e02e1f7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:24.172880 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1cee5-20c3-4f54-a276-0a6e02e1f7ff admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:24.173144 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08d7ee-99ab-44bb-a69a-a240d311a5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:24.173293 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1cee5-20c3-4f54-a276-0a6e02e1f7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:24.173989 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1cee5-20c3-4f54-a276-0a6e02e1f7ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:24.174444 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08d7ee-99ab-44bb-a69a-a240d311a5ea admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:24.174810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08d7ee-99ab-44bb-a69a-a240d311a5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:24.175158 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08d7ee-99ab-44bb-a69a-a240d311a5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:24.175264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1cee5-20c3-4f54-a276-0a6e02e1f7ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:24.176006 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08d7ee-99ab-44bb-a69a-a240d311a5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:24.177064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1cee5-20c3-4f54-a276-0a6e02e1f7ff admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:24.178251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08d7ee-99ab-44bb-a69a-a240d311a5ea admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:24.191035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 922/1861] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:18:24.199706 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 940/1862] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:24.203654 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08d7ee-99ab-44bb-a69a-a240d311a5ea admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:24.203789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1cee5-20c3-4f54-a276-0a6e02e1f7ff admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:24.222308 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1cee5-20c3-4f54-a276-0a6e02e1f7ff admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:24.226808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08d7ee-99ab-44bb-a69a-a240d311a5ea admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:24.236591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17f146-1c5c-46a9-add6-65a79547324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:24.239505 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1ea4b-4222-4aed-a800-43b1bb512c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:24.239505 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1ea4b-4222-4aed-a800-43b1bb512c82 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:24.239959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1ea4b-4222-4aed-a800-43b1bb512c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:24.240622 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1ea4b-4222-4aed-a800-43b1bb512c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:24.241345 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1ea4b-4222-4aed-a800-43b1bb512c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:24.243001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17f146-1c5c-46a9-add6-65a79547324c admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:24.243425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17f146-1c5c-46a9-add6-65a79547324c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:24.246251 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17f146-1c5c-46a9-add6-65a79547324c admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:24.246718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17f146-1c5c-46a9-add6-65a79547324c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:24.249432 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17f146-1c5c-46a9-add6-65a79547324c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:24.249913 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1ea4b-4222-4aed-a800-43b1bb512c82 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:24.265549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 941/1863] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:24.265905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 923/1864] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:24.267325 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1ea4b-4222-4aed-a800-43b1bb512c82 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:24.268530 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17f146-1c5c-46a9-add6-65a79547324c admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:24.283629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17f146-1c5c-46a9-add6-65a79547324c admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:24.286489 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1ea4b-4222-4aed-a800-43b1bb512c82 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:24.289195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55163448-972f-4e93-8f88-58d8f70e45a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:24.289965 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55163448-972f-4e93-8f88-58d8f70e45a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:24.290322 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55163448-972f-4e93-8f88-58d8f70e45a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:24.290751 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55163448-972f-4e93-8f88-58d8f70e45a0 admin admin] PATH_INFO: `/v3/projects/6eef01b568ad4620a0447b9428f86ba2/users/95aed2433a364f9a9ab619d99b324d3f/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:24.292548 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981af9b5-f11e-4a5f-912c-c699d50115ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:24.293232 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981af9b5-f11e-4a5f-912c-c699d50115ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:24.293668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981af9b5-f11e-4a5f-912c-c699d50115ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:24.294008 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981af9b5-f11e-4a5f-912c-c699d50115ab admin admin] PATH_INFO: `/v3/projects/5b3b4aca3bee4aeeae9de589c777fbb1/users/35bb80b172b0472baf939a3c758720dc/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:24.311151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55163448-972f-4e93-8f88-58d8f70e45a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eef01b568ad4620a0447b9428f86ba2, user_id=95aed2433a364f9a9ab619d99b324d3f, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:24.315049 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55163448-972f-4e93-8f88-58d8f70e45a0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:24.329903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981af9b5-f11e-4a5f-912c-c699d50115ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3b4aca3bee4aeeae9de589c777fbb1, user_id=35bb80b172b0472baf939a3c758720dc, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:24.332670 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981af9b5-f11e-4a5f-912c-c699d50115ab admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:24.442839 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 924/1865] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:24 2022] PUT /identity/v3/projects/6eef01b568ad4620a0447b9428f86ba2/users/95aed2433a364f9a9ab619d99b324d3f/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:24.454273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd4c42-7280-4e47-a529-5d37b12f67d5 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:24.454666 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd4c42-7280-4e47-a529-5d37b12f67d5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:24.455031 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd4c42-7280-4e47-a529-5d37b12f67d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:24.485032 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-7fbd4c42-7280-4e47-a529-5d37b12f67d5 None None] MFA Rules not processed for user `95aed2433a364f9a9ab619d99b324d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:24.487479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7fbd4c42-7280-4e47-a529-5d37b12f67d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:24.522392 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 942/1866] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:24 2022] PUT /identity/v3/projects/5b3b4aca3bee4aeeae9de589c777fbb1/users/35bb80b172b0472baf939a3c758720dc/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:24.539305 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7bbd0-1353-448c-b666-503bc59ee7d7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:24.539664 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7bbd0-1353-448c-b666-503bc59ee7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:24.541110 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7bbd0-1353-448c-b666-503bc59ee7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:24.577337 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-dab7bbd0-1353-448c-b666-503bc59ee7d7 None None] MFA Rules not processed for user `35bb80b172b0472baf939a3c758720dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:24.578735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-dab7bbd0-1353-448c-b666-503bc59ee7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:24.605292 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 925/1867] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:24.606401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd4c42-7280-4e47-a529-5d37b12f67d5 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:24.708616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 943/1868] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:24.710158 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7bbd0-1353-448c-b666-503bc59ee7d7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:24.714675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd4c42-7280-4e47-a529-5d37b12f67d5 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:24.818041 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab7bbd0-1353-448c-b666-503bc59ee7d7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:24.820158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c79a7-51e4-42a3-8578-4ae2624a7d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:24.821506 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c79a7-51e4-42a3-8578-4ae2624a7d46 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:24.822125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c79a7-51e4-42a3-8578-4ae2624a7d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:24.822638 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c79a7-51e4-42a3-8578-4ae2624a7d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:24.823661 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c79a7-51e4-42a3-8578-4ae2624a7d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:24.824280 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6bcc0-71e7-4bc6-bfdb-769f1825efbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:24.825146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6bcc0-71e7-4bc6-bfdb-769f1825efbc admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:24.825527 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6bcc0-71e7-4bc6-bfdb-769f1825efbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:24.826563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6bcc0-71e7-4bc6-bfdb-769f1825efbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:24.826563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6bcc0-71e7-4bc6-bfdb-769f1825efbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:24.827458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c79a7-51e4-42a3-8578-4ae2624a7d46 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:24.829289 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6bcc0-71e7-4bc6-bfdb-769f1825efbc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:24.927938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 944/1869] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:24 2022] POST /identity/v3/projects => generated 393 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:24.932272 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6bcc0-71e7-4bc6-bfdb-769f1825efbc admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:24.958694 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 926/1870] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:24 2022] POST /identity/v3/projects => generated 367 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:24.963082 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c79a7-51e4-42a3-8578-4ae2624a7d46 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:25.004586 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6bcc0-71e7-4bc6-bfdb-769f1825efbc admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:25.040187 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c79a7-51e4-42a3-8578-4ae2624a7d46 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:25.047961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0634987-97d1-4d95-9ee5-4b1f04c3ae8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:25.047961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0634987-97d1-4d95-9ee5-4b1f04c3ae8c admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:25.047961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0634987-97d1-4d95-9ee5-4b1f04c3ae8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:25.047961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0634987-97d1-4d95-9ee5-4b1f04c3ae8c admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:25.048418 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0634987-97d1-4d95-9ee5-4b1f04c3ae8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:25.050200 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0634987-97d1-4d95-9ee5-4b1f04c3ae8c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:25.085378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b219f-8f4e-47bd-a608-76226dc49338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:25.086025 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b219f-8f4e-47bd-a608-76226dc49338 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:25.086438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b219f-8f4e-47bd-a608-76226dc49338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:25.086738 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b219f-8f4e-47bd-a608-76226dc49338 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:25.087359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b219f-8f4e-47bd-a608-76226dc49338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:25.089291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b219f-8f4e-47bd-a608-76226dc49338 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:25.161726 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 927/1871] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:24 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:18:25.162660 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0634987-97d1-4d95-9ee5-4b1f04c3ae8c admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:25.181335 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0634987-97d1-4d95-9ee5-4b1f04c3ae8c admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:25.185647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd820b1-dd7a-4bb3-8115-aef474384c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:25.186296 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd820b1-dd7a-4bb3-8115-aef474384c00 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:25.186573 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd820b1-dd7a-4bb3-8115-aef474384c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:25.186850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd820b1-dd7a-4bb3-8115-aef474384c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:25.187509 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd820b1-dd7a-4bb3-8115-aef474384c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:25.189203 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd820b1-dd7a-4bb3-8115-aef474384c00 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:25.200294 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 928/1872] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:18:25.204617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd820b1-dd7a-4bb3-8115-aef474384c00 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:25.221215 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 945/1873] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:24 2022] POST /identity/v3/users => generated 303 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:25.222328 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b219f-8f4e-47bd-a608-76226dc49338 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:25.227680 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd820b1-dd7a-4bb3-8115-aef474384c00 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:25.233443 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3501d-caa4-4e94-94cd-ab493fab7c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:25.234692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3501d-caa4-4e94-94cd-ab493fab7c52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:25.235037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3501d-caa4-4e94-94cd-ab493fab7c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:25.235325 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3501d-caa4-4e94-94cd-ab493fab7c52 admin admin] PATH_INFO: `/v3/projects/3a49fa8c493d40de983aeab22fdaa656/users/688a3dcbfc9d414eb9d2933d817f9ab4/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:25.237275 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b219f-8f4e-47bd-a608-76226dc49338 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:25.243141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2a4f5-5efc-4088-9c0d-9a97f8f407ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:25.244000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2a4f5-5efc-4088-9c0d-9a97f8f407ec admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:25.244282 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2a4f5-5efc-4088-9c0d-9a97f8f407ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:25.244580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2a4f5-5efc-4088-9c0d-9a97f8f407ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:25.245314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2a4f5-5efc-4088-9c0d-9a97f8f407ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:25.246939 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2a4f5-5efc-4088-9c0d-9a97f8f407ec admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:25.263389 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3501d-caa4-4e94-94cd-ab493fab7c52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a49fa8c493d40de983aeab22fdaa656, user_id=688a3dcbfc9d414eb9d2933d817f9ab4, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:25.264138 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 946/1874] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:25.266813 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd3501d-caa4-4e94-94cd-ab493fab7c52 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:25.268452 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2a4f5-5efc-4088-9c0d-9a97f8f407ec admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:25.279130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2a4f5-5efc-4088-9c0d-9a97f8f407ec admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:25.285635 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc033e5a-af59-46a3-a0e6-2469c009dddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:25.286370 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc033e5a-af59-46a3-a0e6-2469c009dddb admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:25.286645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc033e5a-af59-46a3-a0e6-2469c009dddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:25.286916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc033e5a-af59-46a3-a0e6-2469c009dddb admin admin] PATH_INFO: `/v3/projects/76015df7bb63434280e894b6b91e062c/users/61c2a107b9f749b1b9643b17967393b9/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:25.303085 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc033e5a-af59-46a3-a0e6-2469c009dddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=76015df7bb63434280e894b6b91e062c, user_id=61c2a107b9f749b1b9643b17967393b9, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:25.306421 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc033e5a-af59-46a3-a0e6-2469c009dddb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:25.387965 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 929/1875] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:25 2022] PUT /identity/v3/projects/3a49fa8c493d40de983aeab22fdaa656/users/688a3dcbfc9d414eb9d2933d817f9ab4/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:25.392966 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3501d-caa4-4e94-94cd-ab493fab7c52 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:25.431460 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 947/1876] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:25 2022] PUT /identity/v3/projects/76015df7bb63434280e894b6b91e062c/users/61c2a107b9f749b1b9643b17967393b9/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:25.433632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:25.436193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc033e5a-af59-46a3-a0e6-2469c009dddb admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:25.524477 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc033e5a-af59-46a3-a0e6-2469c009dddb admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:25.527027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:25.533573 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8104c-2d80-4c35-8051-56cb8265441a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:25.534446 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8104c-2d80-4c35-8051-56cb8265441a admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:25.534818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8104c-2d80-4c35-8051-56cb8265441a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:25.535236 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8104c-2d80-4c35-8051-56cb8265441a admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:25.535831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3501d-caa4-4e94-94cd-ab493fab7c52 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:25.536064 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8104c-2d80-4c35-8051-56cb8265441a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:25.538675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8104c-2d80-4c35-8051-56cb8265441a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:25.543877 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37ccd2-9dd2-4062-8876-bb3e3d6b9e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:25.544431 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37ccd2-9dd2-4062-8876-bb3e3d6b9e6b admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:25.544739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37ccd2-9dd2-4062-8876-bb3e3d6b9e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:25.544990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37ccd2-9dd2-4062-8876-bb3e3d6b9e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:25.546134 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37ccd2-9dd2-4062-8876-bb3e3d6b9e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:25.548780 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37ccd2-9dd2-4062-8876-bb3e3d6b9e6b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:25.557198 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 948/1877] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:25.564416 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8104c-2d80-4c35-8051-56cb8265441a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:25.564638 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 930/1878] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:25.570767 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37ccd2-9dd2-4062-8876-bb3e3d6b9e6b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:25.576792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8104c-2d80-4c35-8051-56cb8265441a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:25.597306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c23f58-7e43-4b67-beb6-ae811561e090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:25.598307 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c23f58-7e43-4b67-beb6-ae811561e090 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:25.599000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c23f58-7e43-4b67-beb6-ae811561e090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:25.599280 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c23f58-7e43-4b67-beb6-ae811561e090 admin admin] PATH_INFO: `/v3/projects/76015df7bb63434280e894b6b91e062c/users/61c2a107b9f749b1b9643b17967393b9/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:25.602543 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c23f58-7e43-4b67-beb6-ae811561e090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76015df7bb63434280e894b6b91e062c, user_id=61c2a107b9f749b1b9643b17967393b9, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:25.606148 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c23f58-7e43-4b67-beb6-ae811561e090 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:25.609580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37ccd2-9dd2-4062-8876-bb3e3d6b9e6b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:25.616004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f4c17-6756-4e3d-af17-56fadb9e1c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:25.616831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f4c17-6756-4e3d-af17-56fadb9e1c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:25.617481 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f4c17-6756-4e3d-af17-56fadb9e1c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:25.618285 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f4c17-6756-4e3d-af17-56fadb9e1c03 admin admin] PATH_INFO: `/v3/projects/3a49fa8c493d40de983aeab22fdaa656/users/688a3dcbfc9d414eb9d2933d817f9ab4/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:25.622212 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 949/1879] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:25 2022] PUT /identity/v3/projects/76015df7bb63434280e894b6b91e062c/users/61c2a107b9f749b1b9643b17967393b9/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:25.622358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f4c17-6756-4e3d-af17-56fadb9e1c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a49fa8c493d40de983aeab22fdaa656, user_id=688a3dcbfc9d414eb9d2933d817f9ab4, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:25.625274 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f4c17-6756-4e3d-af17-56fadb9e1c03 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:25.631863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeafd4-6236-474e-8216-f8ce8f7bdd96 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:25.632158 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeafd4-6236-474e-8216-f8ce8f7bdd96 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:25.632438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeafd4-6236-474e-8216-f8ce8f7bdd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:25.643804 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 931/1880] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:25 2022] PUT /identity/v3/projects/3a49fa8c493d40de983aeab22fdaa656/users/688a3dcbfc9d414eb9d2933d817f9ab4/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:25.649849 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73618ab5-aaa3-4385-8a69-e305d88082cd None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:25.650280 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73618ab5-aaa3-4385-8a69-e305d88082cd None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:25.650593 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73618ab5-aaa3-4385-8a69-e305d88082cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:25.670762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-14aeafd4-6236-474e-8216-f8ce8f7bdd96 None None] MFA Rules not processed for user `61c2a107b9f749b1b9643b17967393b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:25.672358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-14aeafd4-6236-474e-8216-f8ce8f7bdd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:25.688456 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-73618ab5-aaa3-4385-8a69-e305d88082cd None None] MFA Rules not processed for user `688a3dcbfc9d414eb9d2933d817f9ab4`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:25.689825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-73618ab5-aaa3-4385-8a69-e305d88082cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:25.753244 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 950/1881] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:25.764608 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aeafd4-6236-474e-8216-f8ce8f7bdd96 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:25.770010 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-14aeafd4-6236-474e-8216-f8ce8f7bdd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:25.777044 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 932/1882] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:25.788245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73618ab5-aaa3-4385-8a69-e305d88082cd None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:25.789876 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-73618ab5-aaa3-4385-8a69-e305d88082cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:25.835666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aeafd4-6236-474e-8216-f8ce8f7bdd96 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:25.839585 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdd759-9add-4808-9d70-216916ce4ee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:25.840203 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdd759-9add-4808-9d70-216916ce4ee3 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:25.840531 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdd759-9add-4808-9d70-216916ce4ee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:25.840803 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdd759-9add-4808-9d70-216916ce4ee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:25.850419 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdd759-9add-4808-9d70-216916ce4ee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:25.851855 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdd759-9add-4808-9d70-216916ce4ee3 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:25.852762 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73618ab5-aaa3-4385-8a69-e305d88082cd None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:25.856343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2210ec-a7c6-4126-ba51-a6a71b07c7f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:25.856951 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2210ec-a7c6-4126-ba51-a6a71b07c7f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:25.857384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2210ec-a7c6-4126-ba51-a6a71b07c7f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:25.857688 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2210ec-a7c6-4126-ba51-a6a71b07c7f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:25.861192 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 951/1883] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:25 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:18:25.867047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2210ec-a7c6-4126-ba51-a6a71b07c7f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:25.868482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2210ec-a7c6-4126-ba51-a6a71b07c7f5 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:25.878999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 933/1884] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:18:25.950724 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdd759-9add-4808-9d70-216916ce4ee3 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:25.960015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdd759-9add-4808-9d70-216916ce4ee3 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:25.963772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b158545-a6cc-4819-a9bd-9bec60694c75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:25.966114 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b158545-a6cc-4819-a9bd-9bec60694c75 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:25.966114 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b158545-a6cc-4819-a9bd-9bec60694c75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:25.966114 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b158545-a6cc-4819-a9bd-9bec60694c75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:26.024822 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b158545-a6cc-4819-a9bd-9bec60694c75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:26.026365 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b158545-a6cc-4819-a9bd-9bec60694c75 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:26.036198 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 952/1885] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:27.722632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:27.846582 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:28.271334 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:28.471009 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2210ec-a7c6-4126-ba51-a6a71b07c7f5 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:28.472971 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3d2210ec-a7c6-4126-ba51-a6a71b07c7f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:28.569483 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2210ec-a7c6-4126-ba51-a6a71b07c7f5 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:28.576935 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ef2ea-91e5-469d-aa62-a8a1ec7f3bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:28.576935 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ef2ea-91e5-469d-aa62-a8a1ec7f3bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:28.577713 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ef2ea-91e5-469d-aa62-a8a1ec7f3bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:28.577995 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ef2ea-91e5-469d-aa62-a8a1ec7f3bff admin admin] PATH_INFO: `/v3/users/abe57f90fced4c9a9f957a94c1c16584` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:28.579295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ef2ea-91e5-469d-aa62-a8a1ec7f3bff admin admin] RBAC: Authorizing `identity:delete_user(user_id=abe57f90fced4c9a9f957a94c1c16584)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:28.583087 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ef2ea-91e5-469d-aa62-a8a1ec7f3bff admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:28.863706 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-087ef2ea-91e5-469d-aa62-a8a1ec7f3bff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abe57f90fced4c9a9f957a94c1c16584'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:28.875182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-087ef2ea-91e5-469d-aa62-a8a1ec7f3bff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abe57f90fced4c9a9f957a94c1c16584'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:28.875938 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-087ef2ea-91e5-469d-aa62-a8a1ec7f3bff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abe57f90fced4c9a9f957a94c1c16584'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:28.877361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-087ef2ea-91e5-469d-aa62-a8a1ec7f3bff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abe57f90fced4c9a9f957a94c1c16584'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:28.894729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:28.939430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-087ef2ea-91e5-469d-aa62-a8a1ec7f3bff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abe57f90fced4c9a9f957a94c1c16584'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:28.966026 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 934/1886] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:28 2022] DELETE /identity/v3/users/abe57f90fced4c9a9f957a94c1c16584 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:28.970899 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198fca0-6969-474b-b5ec-80a295376b72 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:28.971441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198fca0-6969-474b-b5ec-80a295376b72 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:28.971441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198fca0-6969-474b-b5ec-80a295376b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:28.992401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e198fca0-6969-474b-b5ec-80a295376b72 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:28.993624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e198fca0-6969-474b-b5ec-80a295376b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:29.054453 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 953/1887] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:29.066078 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ef2ea-91e5-469d-aa62-a8a1ec7f3bff admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:29.068100 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-087ef2ea-91e5-469d-aa62-a8a1ec7f3bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:29.141818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ef2ea-91e5-469d-aa62-a8a1ec7f3bff admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:29.146374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b792f-ad43-4cb5-b2c9-4d864ce32c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:29.147054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b792f-ad43-4cb5-b2c9-4d864ce32c1c service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:29.147472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b792f-ad43-4cb5-b2c9-4d864ce32c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:29.147638 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b792f-ad43-4cb5-b2c9-4d864ce32c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:29.161295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b792f-ad43-4cb5-b2c9-4d864ce32c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:29.168967 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b792f-ad43-4cb5-b2c9-4d864ce32c1c service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:29.180751 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 935/1888] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:29.471384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:29.645196 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198fca0-6969-474b-b5ec-80a295376b72 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:29.649511 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e198fca0-6969-474b-b5ec-80a295376b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:29.665395 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198fca0-6969-474b-b5ec-80a295376b72 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:29.667575 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a7650-58d7-414f-bf4e-897a4eb091e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:29.668351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a7650-58d7-414f-bf4e-897a4eb091e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:29.668692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a7650-58d7-414f-bf4e-897a4eb091e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:29.668974 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a7650-58d7-414f-bf4e-897a4eb091e8 admin admin] PATH_INFO: `/v3/users/95aed2433a364f9a9ab619d99b324d3f` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:29.670127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a7650-58d7-414f-bf4e-897a4eb091e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95aed2433a364f9a9ab619d99b324d3f)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:29.672030 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a7650-58d7-414f-bf4e-897a4eb091e8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:29.712172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b792f-ad43-4cb5-b2c9-4d864ce32c1c service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:29.713722 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3a9b792f-ad43-4cb5-b2c9-4d864ce32c1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:29.732331 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b792f-ad43-4cb5-b2c9-4d864ce32c1c service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:29.737061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c966b03-f919-42f8-9c13-b71ab037b03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:29.737903 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c966b03-f919-42f8-9c13-b71ab037b03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:29.738265 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c966b03-f919-42f8-9c13-b71ab037b03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:29.738635 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c966b03-f919-42f8-9c13-b71ab037b03a admin admin] PATH_INFO: `/v3/projects/b55510feaa504b22903dfa9d217de718` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:29.740664 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c966b03-f919-42f8-9c13-b71ab037b03a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b55510feaa504b22903dfa9d217de718)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:29.743055 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c966b03-f919-42f8-9c13-b71ab037b03a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:29.873417 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-da4a7650-58d7-414f-bf4e-897a4eb091e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95aed2433a364f9a9ab619d99b324d3f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:29.882371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2c966b03-f919-42f8-9c13-b71ab037b03a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55510feaa504b22903dfa9d217de718', 'request_id': 'req-2c966b03-f919-42f8-9c13-b71ab037b03a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:29.891287 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2c966b03-f919-42f8-9c13-b71ab037b03a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55510feaa504b22903dfa9d217de718', 'request_id': 'req-2c966b03-f919-42f8-9c13-b71ab037b03a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:29.978779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-da4a7650-58d7-414f-bf4e-897a4eb091e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95aed2433a364f9a9ab619d99b324d3f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:29.979397 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-da4a7650-58d7-414f-bf4e-897a4eb091e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95aed2433a364f9a9ab619d99b324d3f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:29.980077 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-da4a7650-58d7-414f-bf4e-897a4eb091e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95aed2433a364f9a9ab619d99b324d3f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:29.988078 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-da4a7650-58d7-414f-bf4e-897a4eb091e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95aed2433a364f9a9ab619d99b324d3f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:30.007963 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:30.008177 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 954/1889] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:29 2022] DELETE /identity/v3/users/95aed2433a364f9a9ab619d99b324d3f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:30.011455 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbb421-ab08-46f6-afbc-fdb04302ddcb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:30.011772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbb421-ab08-46f6-afbc-fdb04302ddcb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:30.012053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbbb421-ab08-46f6-afbc-fdb04302ddcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:30.024227 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2c966b03-f919-42f8-9c13-b71ab037b03a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55510feaa504b22903dfa9d217de718', 'request_id': 'req-2c966b03-f919-42f8-9c13-b71ab037b03a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:30.030938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ecbbb421-ab08-46f6-afbc-fdb04302ddcb None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:30.032293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ecbbb421-ab08-46f6-afbc-fdb04302ddcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:30.036585 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2c966b03-f919-42f8-9c13-b71ab037b03a admin admin] The token cache is being invalidate because project b55510feaa504b22903dfa9d217de718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:30.038500 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2c966b03-f919-42f8-9c13-b71ab037b03a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:30.038500 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2c966b03-f919-42f8-9c13-b71ab037b03a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:30.039261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 936/1890] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:29 2022] DELETE /identity/v3/projects/b55510feaa504b22903dfa9d217de718 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:30.043142 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c966b03-f919-42f8-9c13-b71ab037b03a admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:30.044676 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2c966b03-f919-42f8-9c13-b71ab037b03a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:30.094284 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 955/1891] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:30.105923 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbb421-ab08-46f6-afbc-fdb04302ddcb None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:30.107833 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ecbbb421-ab08-46f6-afbc-fdb04302ddcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:30.118197 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c966b03-f919-42f8-9c13-b71ab037b03a admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:30.123192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6a585-ed56-4b2d-a13f-c60bf028b01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:30.123874 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6a585-ed56-4b2d-a13f-c60bf028b01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:30.124192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6a585-ed56-4b2d-a13f-c60bf028b01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:30.124469 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6a585-ed56-4b2d-a13f-c60bf028b01b admin admin] PATH_INFO: `/v3/users/472898432b0947b99307c923f2833c88` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:30.125846 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6a585-ed56-4b2d-a13f-c60bf028b01b admin admin] RBAC: Authorizing `identity:delete_user(user_id=472898432b0947b99307c923f2833c88)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:30.128858 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6a585-ed56-4b2d-a13f-c60bf028b01b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:30.176692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbbb421-ab08-46f6-afbc-fdb04302ddcb None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:30.180850 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233ab31-7930-4d79-828d-2b85c5f116f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:30.181679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233ab31-7930-4d79-828d-2b85c5f116f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:30.182039 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233ab31-7930-4d79-828d-2b85c5f116f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:30.182252 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233ab31-7930-4d79-828d-2b85c5f116f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:30.193717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233ab31-7930-4d79-828d-2b85c5f116f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:30.195262 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233ab31-7930-4d79-828d-2b85c5f116f1 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:30.206014 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 956/1892] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:30.394698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c1c6a585-ed56-4b2d-a13f-c60bf028b01b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '472898432b0947b99307c923f2833c88'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:30.409732 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c1c6a585-ed56-4b2d-a13f-c60bf028b01b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '472898432b0947b99307c923f2833c88'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:30.410759 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c1c6a585-ed56-4b2d-a13f-c60bf028b01b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '472898432b0947b99307c923f2833c88'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:30.417922 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c1c6a585-ed56-4b2d-a13f-c60bf028b01b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '472898432b0947b99307c923f2833c88'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:30.502945 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c1c6a585-ed56-4b2d-a13f-c60bf028b01b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '472898432b0947b99307c923f2833c88'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:30.528487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 937/1893] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:30 2022] DELETE /identity/v3/users/472898432b0947b99307c923f2833c88 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:30.548770 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:30.750957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:30.860874 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233ab31-7930-4d79-828d-2b85c5f116f1 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:30.862410 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8233ab31-7930-4d79-828d-2b85c5f116f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:30.878499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233ab31-7930-4d79-828d-2b85c5f116f1 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:30.950478 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce52a7-9f6a-4236-943d-9f8c5f7efa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:30.951431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce52a7-9f6a-4236-943d-9f8c5f7efa35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:30.951431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce52a7-9f6a-4236-943d-9f8c5f7efa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:30.951727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce52a7-9f6a-4236-943d-9f8c5f7efa35 admin admin] PATH_INFO: `/v3/projects/6eef01b568ad4620a0447b9428f86ba2` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:30.952868 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce52a7-9f6a-4236-943d-9f8c5f7efa35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eef01b568ad4620a0447b9428f86ba2)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:30.955818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce52a7-9f6a-4236-943d-9f8c5f7efa35 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:31.076294 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6a585-ed56-4b2d-a13f-c60bf028b01b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:31.077783 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c1c6a585-ed56-4b2d-a13f-c60bf028b01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:31.092442 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-59ce52a7-9f6a-4236-943d-9f8c5f7efa35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eef01b568ad4620a0447b9428f86ba2', 'request_id': 'req-59ce52a7-9f6a-4236-943d-9f8c5f7efa35'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:31.095595 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6a585-ed56-4b2d-a13f-c60bf028b01b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:31.103411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-59ce52a7-9f6a-4236-943d-9f8c5f7efa35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eef01b568ad4620a0447b9428f86ba2', 'request_id': 'req-59ce52a7-9f6a-4236-943d-9f8c5f7efa35'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:31.183907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b6206-160d-4144-a3cf-0fb9d78b7e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:31.184646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b6206-160d-4144-a3cf-0fb9d78b7e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:31.185003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b6206-160d-4144-a3cf-0fb9d78b7e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:31.185348 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b6206-160d-4144-a3cf-0fb9d78b7e4e admin admin] PATH_INFO: `/v3/projects/38a07ce3faaf4d35af97285f45c00bc9` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:31.186676 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b6206-160d-4144-a3cf-0fb9d78b7e4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=38a07ce3faaf4d35af97285f45c00bc9)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:31.189382 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b6206-160d-4144-a3cf-0fb9d78b7e4e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:31.205378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-59ce52a7-9f6a-4236-943d-9f8c5f7efa35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eef01b568ad4620a0447b9428f86ba2', 'request_id': 'req-59ce52a7-9f6a-4236-943d-9f8c5f7efa35'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:31.217409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-59ce52a7-9f6a-4236-943d-9f8c5f7efa35 admin admin] The token cache is being invalidate because project 6eef01b568ad4620a0447b9428f86ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:31.217753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-59ce52a7-9f6a-4236-943d-9f8c5f7efa35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:31.218413 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-59ce52a7-9f6a-4236-943d-9f8c5f7efa35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:31.220743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 957/1894] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:30 2022] DELETE /identity/v3/projects/6eef01b568ad4620a0447b9428f86ba2 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:31.222051 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd6c26-f7ea-4cab-b2b5-4ec8fdc314a9 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:31.222339 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd6c26-f7ea-4cab-b2b5-4ec8fdc314a9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:31.225774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd6c26-f7ea-4cab-b2b5-4ec8fdc314a9 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:31.225774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 958/1895] 10.222.0.65 () {54 vars in 921 bytes} [Tue Aug 9 19:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:18:31.225774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd6c26-f7ea-4cab-b2b5-4ec8fdc314a9 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:31.227401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-39dd6c26-f7ea-4cab-b2b5-4ec8fdc314a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:31.245065 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd6c26-f7ea-4cab-b2b5-4ec8fdc314a9 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:31.249697 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0476fb-a456-4dca-baf4-6c4f72c3eb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:31.250312 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0476fb-a456-4dca-baf4-6c4f72c3eb00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:31.250592 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0476fb-a456-4dca-baf4-6c4f72c3eb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:31.250867 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0476fb-a456-4dca-baf4-6c4f72c3eb00 admin admin] PATH_INFO: `/v3/users/688a3dcbfc9d414eb9d2933d817f9ab4` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:31.252318 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0476fb-a456-4dca-baf4-6c4f72c3eb00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=688a3dcbfc9d414eb9d2933d817f9ab4)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:31.254355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0476fb-a456-4dca-baf4-6c4f72c3eb00 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:31.320954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a11b6206-160d-4144-a3cf-0fb9d78b7e4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38a07ce3faaf4d35af97285f45c00bc9', 'request_id': 'req-a11b6206-160d-4144-a3cf-0fb9d78b7e4e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:31.326585 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a11b6206-160d-4144-a3cf-0fb9d78b7e4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38a07ce3faaf4d35af97285f45c00bc9', 'request_id': 'req-a11b6206-160d-4144-a3cf-0fb9d78b7e4e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:31.425769 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a11b6206-160d-4144-a3cf-0fb9d78b7e4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38a07ce3faaf4d35af97285f45c00bc9', 'request_id': 'req-a11b6206-160d-4144-a3cf-0fb9d78b7e4e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:31.442005 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a11b6206-160d-4144-a3cf-0fb9d78b7e4e admin admin] The token cache is being invalidate because project 38a07ce3faaf4d35af97285f45c00bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:31.442005 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a11b6206-160d-4144-a3cf-0fb9d78b7e4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:31.444418 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a11b6206-160d-4144-a3cf-0fb9d78b7e4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:31.447239 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 938/1896] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:31 2022] DELETE /identity/v3/projects/38a07ce3faaf4d35af97285f45c00bc9 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:31.448484 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d319943-62de-42a9-b66f-d27c57266fb2 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:31.448787 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d319943-62de-42a9-b66f-d27c57266fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:31.449067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d319943-62de-42a9-b66f-d27c57266fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:31.476151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-8d319943-62de-42a9-b66f-d27c57266fb2 None None] MFA Rules not processed for user `2cfda1bec35145f3bbcc13fae0b7af2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:31.477365 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8d319943-62de-42a9-b66f-d27c57266fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:31.505099 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ae0476fb-a456-4dca-baf4-6c4f72c3eb00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '688a3dcbfc9d414eb9d2933d817f9ab4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:31.569421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 939/1897] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Aug 9 19:18:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:31.571122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a476eb1-b4fc-462f-8f52-2c8ade4301fb None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:31.571350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a476eb1-b4fc-462f-8f52-2c8ade4301fb None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:31.571621 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a476eb1-b4fc-462f-8f52-2c8ade4301fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:31.584443 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ae0476fb-a456-4dca-baf4-6c4f72c3eb00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '688a3dcbfc9d414eb9d2933d817f9ab4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:31.585125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ae0476fb-a456-4dca-baf4-6c4f72c3eb00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '688a3dcbfc9d414eb9d2933d817f9ab4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:31.597890 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ae0476fb-a456-4dca-baf4-6c4f72c3eb00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '688a3dcbfc9d414eb9d2933d817f9ab4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:31.598079 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9a476eb1-b4fc-462f-8f52-2c8ade4301fb None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:31.598079 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9a476eb1-b4fc-462f-8f52-2c8ade4301fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:31.598244 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ae0476fb-a456-4dca-baf4-6c4f72c3eb00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '688a3dcbfc9d414eb9d2933d817f9ab4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:31.616300 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 959/1898] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:31 2022] DELETE /identity/v3/users/688a3dcbfc9d414eb9d2933d817f9ab4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:31.617058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0476fb-a456-4dca-baf4-6c4f72c3eb00 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:31.618501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ae0476fb-a456-4dca-baf4-6c4f72c3eb00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:31.671237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 940/1899] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:31.681163 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936d2df-181d-423e-9c9b-dcdd2a2b5710 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:31.681670 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936d2df-181d-423e-9c9b-dcdd2a2b5710 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:31.682199 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936d2df-181d-423e-9c9b-dcdd2a2b5710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:31.701719 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0476fb-a456-4dca-baf4-6c4f72c3eb00 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:31.706955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1936d2df-181d-423e-9c9b-dcdd2a2b5710 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:31.708315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1936d2df-181d-423e-9c9b-dcdd2a2b5710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:31.708788 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd9135-d572-4287-a431-ba998546d68b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:31.709845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd9135-d572-4287-a431-ba998546d68b service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:31.710169 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd9135-d572-4287-a431-ba998546d68b service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:31.710443 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd9135-d572-4287-a431-ba998546d68b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:31.712775 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-79cd9135-d572-4287-a431-ba998546d68b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:31.742650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd9135-d572-4287-a431-ba998546d68b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:31.744497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd9135-d572-4287-a431-ba998546d68b service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:31.760423 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 960/1900] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:31.786425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:31.799821 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 941/1901] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:31.802254 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd9135-d572-4287-a431-ba998546d68b service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:31.815753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd9135-d572-4287-a431-ba998546d68b service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:31.820819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437aac4-6aec-4373-8a55-7552753bbd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:31.824897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437aac4-6aec-4373-8a55-7552753bbd36 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:31.824897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437aac4-6aec-4373-8a55-7552753bbd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:31.824897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437aac4-6aec-4373-8a55-7552753bbd36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:31.824897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437aac4-6aec-4373-8a55-7552753bbd36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:18:31.824897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437aac4-6aec-4373-8a55-7552753bbd36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:31.824897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437aac4-6aec-4373-8a55-7552753bbd36 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:31.836402 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:31.841701 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 961/1902] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:18:31.845208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936d2df-181d-423e-9c9b-dcdd2a2b5710 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:31.855287 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936d2df-181d-423e-9c9b-dcdd2a2b5710 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:31.860144 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71448f-6116-4904-8c6e-f784895abaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:31.861829 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71448f-6116-4904-8c6e-f784895abaff admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:31.862140 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71448f-6116-4904-8c6e-f784895abaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:31.862418 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71448f-6116-4904-8c6e-f784895abaff admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:31.863047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71448f-6116-4904-8c6e-f784895abaff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:31.865001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71448f-6116-4904-8c6e-f784895abaff admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:32.631618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 942/1903] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:31 2022] POST /identity/v3/projects => generated 367 bytes in 783 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:32.634758 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437aac4-6aec-4373-8a55-7552753bbd36 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:32.645630 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437aac4-6aec-4373-8a55-7552753bbd36 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:32.713033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a894674-1940-46d8-b6ec-5f8eb99278f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:32.713790 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894674-1940-46d8-b6ec-5f8eb99278f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:32.714148 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894674-1940-46d8-b6ec-5f8eb99278f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:32.714806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894674-1940-46d8-b6ec-5f8eb99278f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:32.715212 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a894674-1940-46d8-b6ec-5f8eb99278f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:32.717699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a894674-1940-46d8-b6ec-5f8eb99278f8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:32.908066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71448f-6116-4904-8c6e-f784895abaff admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:32.909862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2a71448f-6116-4904-8c6e-f784895abaff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:32.922757 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71448f-6116-4904-8c6e-f784895abaff admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:32.928862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da66d01-f90c-4748-972f-9ec21b0342a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:32.933685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da66d01-f90c-4748-972f-9ec21b0342a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:32.933685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da66d01-f90c-4748-972f-9ec21b0342a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:32.933685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da66d01-f90c-4748-972f-9ec21b0342a4 admin admin] PATH_INFO: `/v3/projects/3a49fa8c493d40de983aeab22fdaa656` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:32.933685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da66d01-f90c-4748-972f-9ec21b0342a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a49fa8c493d40de983aeab22fdaa656)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:32.933685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da66d01-f90c-4748-972f-9ec21b0342a4 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:32.993202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 962/1904] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:32 2022] POST /identity/v3/users => generated 284 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:32.997274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a894674-1940-46d8-b6ec-5f8eb99278f8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:33.008516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a894674-1940-46d8-b6ec-5f8eb99278f8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:33.013821 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa79c4-f1e9-4e5f-ba27-73f799bc4a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:33.014447 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa79c4-f1e9-4e5f-ba27-73f799bc4a76 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:33.014783 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa79c4-f1e9-4e5f-ba27-73f799bc4a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:33.015040 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa79c4-f1e9-4e5f-ba27-73f799bc4a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:33.015725 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa79c4-f1e9-4e5f-ba27-73f799bc4a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:33.017397 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa79c4-f1e9-4e5f-ba27-73f799bc4a76 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:33.032192 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 963/1905] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:18:33.033298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa79c4-f1e9-4e5f-ba27-73f799bc4a76 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:33.044079 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa79c4-f1e9-4e5f-ba27-73f799bc4a76 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:33.049209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a218e0-b09d-438b-90c2-5d2f45d6153b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:33.050159 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a218e0-b09d-438b-90c2-5d2f45d6153b admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:33.050447 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a218e0-b09d-438b-90c2-5d2f45d6153b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:33.050740 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a218e0-b09d-438b-90c2-5d2f45d6153b admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:33.051387 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a218e0-b09d-438b-90c2-5d2f45d6153b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:33.052988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a218e0-b09d-438b-90c2-5d2f45d6153b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:33.063503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 964/1906] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:33.068446 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a218e0-b09d-438b-90c2-5d2f45d6153b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:33.078845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a218e0-b09d-438b-90c2-5d2f45d6153b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:33.083938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21637926-cf2d-43a2-8148-c5995e26d7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:33.084593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21637926-cf2d-43a2-8148-c5995e26d7e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:33.084950 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21637926-cf2d-43a2-8148-c5995e26d7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:33.085147 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21637926-cf2d-43a2-8148-c5995e26d7e4 admin admin] PATH_INFO: `/v3/projects/b0814f1369724c808a66c53163762254/users/c377f0fc13cc43cca0504df1963d96ab/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:33.098202 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2da66d01-f90c-4748-972f-9ec21b0342a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a49fa8c493d40de983aeab22fdaa656', 'request_id': 'req-2da66d01-f90c-4748-972f-9ec21b0342a4'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:33.100614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21637926-cf2d-43a2-8148-c5995e26d7e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0814f1369724c808a66c53163762254, user_id=c377f0fc13cc43cca0504df1963d96ab, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:33.106215 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21637926-cf2d-43a2-8148-c5995e26d7e4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:33.106359 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2da66d01-f90c-4748-972f-9ec21b0342a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a49fa8c493d40de983aeab22fdaa656', 'request_id': 'req-2da66d01-f90c-4748-972f-9ec21b0342a4'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:33.194290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 965/1907] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:33 2022] PUT /identity/v3/projects/b0814f1369724c808a66c53163762254/users/c377f0fc13cc43cca0504df1963d96ab/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:33.207067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643fcc2-af5a-4648-98f3-ed6defbf320c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:33.207368 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643fcc2-af5a-4648-98f3-ed6defbf320c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:33.207653 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643fcc2-af5a-4648-98f3-ed6defbf320c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:33.208550 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2da66d01-f90c-4748-972f-9ec21b0342a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a49fa8c493d40de983aeab22fdaa656', 'request_id': 'req-2da66d01-f90c-4748-972f-9ec21b0342a4'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:33.223198 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2da66d01-f90c-4748-972f-9ec21b0342a4 admin admin] The token cache is being invalidate because project 3a49fa8c493d40de983aeab22fdaa656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:33.223561 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2da66d01-f90c-4748-972f-9ec21b0342a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:33.224445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2da66d01-f90c-4748-972f-9ec21b0342a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:33.226258 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 943/1908] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:32 2022] DELETE /identity/v3/projects/3a49fa8c493d40de983aeab22fdaa656 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:33.231038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931ae8e-8423-4148-a108-485b6fb8c31a None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:33.231319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931ae8e-8423-4148-a108-485b6fb8c31a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:33.231592 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931ae8e-8423-4148-a108-485b6fb8c31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:33.239183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f643fcc2-af5a-4648-98f3-ed6defbf320c None None] MFA Rules not processed for user `c377f0fc13cc43cca0504df1963d96ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:33.240456 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f643fcc2-af5a-4648-98f3-ed6defbf320c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:33.253481 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3931ae8e-8423-4148-a108-485b6fb8c31a None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:33.255337 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3931ae8e-8423-4148-a108-485b6fb8c31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:33.310639 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 966/1909] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:33.315980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643fcc2-af5a-4648-98f3-ed6defbf320c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:33.317280 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f643fcc2-af5a-4648-98f3-ed6defbf320c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:33.322764 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 944/1910] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:33.331691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43828af2-2b7f-472b-b8b3-d6ae430a10c9 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:33.332099 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643fcc2-af5a-4648-98f3-ed6defbf320c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:33.332384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43828af2-2b7f-472b-b8b3-d6ae430a10c9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:33.332849 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43828af2-2b7f-472b-b8b3-d6ae430a10c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:33.336821 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9576f-e205-4995-9c00-714a60baf9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:33.337435 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9576f-e205-4995-9c00-714a60baf9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:33.337745 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9576f-e205-4995-9c00-714a60baf9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:33.338020 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9576f-e205-4995-9c00-714a60baf9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:33.338646 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9576f-e205-4995-9c00-714a60baf9e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:33.340563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9576f-e205-4995-9c00-714a60baf9e8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:33.352424 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-43828af2-2b7f-472b-b8b3-d6ae430a10c9 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:33.353674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-43828af2-2b7f-472b-b8b3-d6ae430a10c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:33.361929 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 945/1911] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:33.369199 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43828af2-2b7f-472b-b8b3-d6ae430a10c9 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:33.378894 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43828af2-2b7f-472b-b8b3-d6ae430a10c9 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:33.383533 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9808575-ddf4-4e03-86d4-3323abdf93d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:33.384125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9808575-ddf4-4e03-86d4-3323abdf93d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:33.384407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9808575-ddf4-4e03-86d4-3323abdf93d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:33.384681 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9808575-ddf4-4e03-86d4-3323abdf93d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:33.385322 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9808575-ddf4-4e03-86d4-3323abdf93d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:18:33.385662 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9808575-ddf4-4e03-86d4-3323abdf93d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:33.387262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9808575-ddf4-4e03-86d4-3323abdf93d1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:33.401574 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 946/1912] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:18:33.406076 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9808575-ddf4-4e03-86d4-3323abdf93d1 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:33.417034 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9808575-ddf4-4e03-86d4-3323abdf93d1 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:33.422068 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571cf61-087a-4d9f-8c2e-baca267e5347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:33.422679 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571cf61-087a-4d9f-8c2e-baca267e5347 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:33.423967 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571cf61-087a-4d9f-8c2e-baca267e5347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:33.423967 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571cf61-087a-4d9f-8c2e-baca267e5347 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:33.424219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571cf61-087a-4d9f-8c2e-baca267e5347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:33.426267 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571cf61-087a-4d9f-8c2e-baca267e5347 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:33.433560 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 967/1913] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:33 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:33.434607 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9576f-e205-4995-9c00-714a60baf9e8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:33.436362 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5cd9576f-e205-4995-9c00-714a60baf9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:33.504309 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9576f-e205-4995-9c00-714a60baf9e8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:33.513371 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6cbaf-59bc-40c7-a20f-9bea113a36e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:33.514582 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6cbaf-59bc-40c7-a20f-9bea113a36e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:33.520741 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6cbaf-59bc-40c7-a20f-9bea113a36e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:33.520741 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6cbaf-59bc-40c7-a20f-9bea113a36e3 admin admin] PATH_INFO: `/v3/users/35bb80b172b0472baf939a3c758720dc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:33.521419 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6cbaf-59bc-40c7-a20f-9bea113a36e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35bb80b172b0472baf939a3c758720dc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:33.523720 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6cbaf-59bc-40c7-a20f-9bea113a36e3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:33.525309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 947/1914] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:33 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:18:33.526229 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571cf61-087a-4d9f-8c2e-baca267e5347 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:33.595629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571cf61-087a-4d9f-8c2e-baca267e5347 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:33.601929 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a50578-4cf5-449f-b87f-ca1c69a10e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:33.605704 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a50578-4cf5-449f-b87f-ca1c69a10e39 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:33.605704 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a50578-4cf5-449f-b87f-ca1c69a10e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:33.605704 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a50578-4cf5-449f-b87f-ca1c69a10e39 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:33.605704 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a50578-4cf5-449f-b87f-ca1c69a10e39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:33.605704 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a50578-4cf5-449f-b87f-ca1c69a10e39 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:33.722645 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 948/1915] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:33 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:33.723628 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a50578-4cf5-449f-b87f-ca1c69a10e39 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:33.733705 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a50578-4cf5-449f-b87f-ca1c69a10e39 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:33.739613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c13b73-afa4-4da9-82ef-eb056c0c811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:33.740221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c13b73-afa4-4da9-82ef-eb056c0c811c admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:33.741303 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c13b73-afa4-4da9-82ef-eb056c0c811c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:33.741621 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c13b73-afa4-4da9-82ef-eb056c0c811c admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:33.742442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c13b73-afa4-4da9-82ef-eb056c0c811c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:33.743159 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1ab6cbaf-59bc-40c7-a20f-9bea113a36e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35bb80b172b0472baf939a3c758720dc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:33.744461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c13b73-afa4-4da9-82ef-eb056c0c811c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:33.784530 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:33.807251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1ab6cbaf-59bc-40c7-a20f-9bea113a36e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35bb80b172b0472baf939a3c758720dc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:33.807874 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1ab6cbaf-59bc-40c7-a20f-9bea113a36e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35bb80b172b0472baf939a3c758720dc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:33.808512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1ab6cbaf-59bc-40c7-a20f-9bea113a36e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35bb80b172b0472baf939a3c758720dc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:33.813644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 949/1916] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:33 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:33.815318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c13b73-afa4-4da9-82ef-eb056c0c811c admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:33.817695 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f5c13b73-afa4-4da9-82ef-eb056c0c811c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:33.818142 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:33.822242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1ab6cbaf-59bc-40c7-a20f-9bea113a36e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35bb80b172b0472baf939a3c758720dc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:33.830402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c13b73-afa4-4da9-82ef-eb056c0c811c admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:33.836378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea4c2e-8c9f-4c9e-9e5c-7b78564b1743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:33.837295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea4c2e-8c9f-4c9e-9e5c-7b78564b1743 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:33.837612 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea4c2e-8c9f-4c9e-9e5c-7b78564b1743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:33.838031 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea4c2e-8c9f-4c9e-9e5c-7b78564b1743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:33.838946 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea4c2e-8c9f-4c9e-9e5c-7b78564b1743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:33.843091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea4c2e-8c9f-4c9e-9e5c-7b78564b1743 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:33.845826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 968/1917] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:33 2022] DELETE /identity/v3/users/35bb80b172b0472baf939a3c758720dc => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:33.847095 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6cbaf-59bc-40c7-a20f-9bea113a36e3 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:33.848514 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1ab6cbaf-59bc-40c7-a20f-9bea113a36e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:33.853991 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 950/1918] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:33.855295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39e878-54c6-46cc-8d87-50c060bb2282 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:33.855590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39e878-54c6-46cc-8d87-50c060bb2282 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:33.855868 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39e878-54c6-46cc-8d87-50c060bb2282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:33.878236 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9d39e878-54c6-46cc-8d87-50c060bb2282 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:33.879392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9d39e878-54c6-46cc-8d87-50c060bb2282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:33.937416 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6cbaf-59bc-40c7-a20f-9bea113a36e3 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:33.943624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ef69a-4e85-494c-ad0b-3f6805b6391d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:33.944363 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef69a-4e85-494c-ad0b-3f6805b6391d admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:33.944648 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef69a-4e85-494c-ad0b-3f6805b6391d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:33.944924 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef69a-4e85-494c-ad0b-3f6805b6391d admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:33.945785 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ef69a-4e85-494c-ad0b-3f6805b6391d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:33.947397 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ef69a-4e85-494c-ad0b-3f6805b6391d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:33.956929 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 951/1919] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:33.957839 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39e878-54c6-46cc-8d87-50c060bb2282 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:33.961221 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 969/1920] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:33.965364 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ef69a-4e85-494c-ad0b-3f6805b6391d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:33.971022 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39e878-54c6-46cc-8d87-50c060bb2282 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:33.979743 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28526e-9c3f-4b45-a633-0cba2dc3a587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:33.979907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ef69a-4e85-494c-ad0b-3f6805b6391d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:33.980010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28526e-9c3f-4b45-a633-0cba2dc3a587 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:33.980010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28526e-9c3f-4b45-a633-0cba2dc3a587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:33.980010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28526e-9c3f-4b45-a633-0cba2dc3a587 admin admin] PATH_INFO: `/v3/projects/e31352306c9e4c1f9f2c4edbee3971ae/users/5f64392091084110ba3980532ee321d7/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:33.982628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7180270-91d0-400b-b4b3-a384d2c5054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:33.983228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7180270-91d0-400b-b4b3-a384d2c5054c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:33.983505 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7180270-91d0-400b-b4b3-a384d2c5054c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:33.983776 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7180270-91d0-400b-b4b3-a384d2c5054c admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:33.984409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7180270-91d0-400b-b4b3-a384d2c5054c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:33.988772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7180270-91d0-400b-b4b3-a384d2c5054c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:33.995249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28526e-9c3f-4b45-a633-0cba2dc3a587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e31352306c9e4c1f9f2c4edbee3971ae, user_id=5f64392091084110ba3980532ee321d7, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:33.998067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28526e-9c3f-4b45-a633-0cba2dc3a587 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:34.001495 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 970/1921] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:34.002512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7180270-91d0-400b-b4b3-a384d2c5054c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:34.004287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a7180270-91d0-400b-b4b3-a384d2c5054c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:34.063302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 952/1922] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:33 2022] PUT /identity/v3/projects/e31352306c9e4c1f9f2c4edbee3971ae/users/5f64392091084110ba3980532ee321d7/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:34.065215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28526e-9c3f-4b45-a633-0cba2dc3a587 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:34.067954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7180270-91d0-400b-b4b3-a384d2c5054c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:34.128497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081eb7c-c5fa-4c0c-9c04-a0b91fff07d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:34.129107 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081eb7c-c5fa-4c0c-9c04-a0b91fff07d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:34.129390 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081eb7c-c5fa-4c0c-9c04-a0b91fff07d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:34.129729 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081eb7c-c5fa-4c0c-9c04-a0b91fff07d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:34.139382 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081eb7c-c5fa-4c0c-9c04-a0b91fff07d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:34.141573 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e081eb7c-c5fa-4c0c-9c04-a0b91fff07d8 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:34.142908 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28526e-9c3f-4b45-a633-0cba2dc3a587 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:34.147973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af9357-73b9-4b01-91c7-2c55f7926356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:34.148648 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af9357-73b9-4b01-91c7-2c55f7926356 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:34.148930 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af9357-73b9-4b01-91c7-2c55f7926356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:34.149205 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af9357-73b9-4b01-91c7-2c55f7926356 admin admin] PATH_INFO: `/v3/projects/00dc8cc5de9343559eaada5159ff65e8/users/8f95ed840f6947e1933e0c135885d1a0/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:34.152891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 971/1923] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:34.153757 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081eb7c-c5fa-4c0c-9c04-a0b91fff07d8 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:34.163363 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081eb7c-c5fa-4c0c-9c04-a0b91fff07d8 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:34.167305 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af9357-73b9-4b01-91c7-2c55f7926356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00dc8cc5de9343559eaada5159ff65e8, user_id=8f95ed840f6947e1933e0c135885d1a0, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:34.170905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af9357-73b9-4b01-91c7-2c55f7926356 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:34.177267 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf0c3b-f7ac-413a-8060-b3c0ec766f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:34.177267 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf0c3b-f7ac-413a-8060-b3c0ec766f70 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:34.177267 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf0c3b-f7ac-413a-8060-b3c0ec766f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:34.177267 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf0c3b-f7ac-413a-8060-b3c0ec766f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:34.177717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf0c3b-f7ac-413a-8060-b3c0ec766f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:34.177717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf0c3b-f7ac-413a-8060-b3c0ec766f70 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:34.188861 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 972/1924] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:34.194374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf0c3b-f7ac-413a-8060-b3c0ec766f70 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:34.206498 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf0c3b-f7ac-413a-8060-b3c0ec766f70 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:34.211444 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355a6bf-4651-4e2d-9ed2-5e36419e5040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:34.212307 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355a6bf-4651-4e2d-9ed2-5e36419e5040 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:34.212386 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355a6bf-4651-4e2d-9ed2-5e36419e5040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:34.212629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355a6bf-4651-4e2d-9ed2-5e36419e5040 admin admin] PATH_INFO: `/v3/projects/e31352306c9e4c1f9f2c4edbee3971ae/users/5f64392091084110ba3980532ee321d7/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:34.220128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355a6bf-4651-4e2d-9ed2-5e36419e5040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e31352306c9e4c1f9f2c4edbee3971ae, user_id=5f64392091084110ba3980532ee321d7, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:34.223781 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355a6bf-4651-4e2d-9ed2-5e36419e5040 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:34.241414 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 973/1925] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:34 2022] PUT /identity/v3/projects/e31352306c9e4c1f9f2c4edbee3971ae/users/5f64392091084110ba3980532ee321d7/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:34.259366 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbf72f-fbf9-416b-8a4f-34956b5356fc None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:34.260111 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbf72f-fbf9-416b-8a4f-34956b5356fc None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:34.260220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbf72f-fbf9-416b-8a4f-34956b5356fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:34.286992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 953/1926] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:34 2022] PUT /identity/v3/projects/00dc8cc5de9343559eaada5159ff65e8/users/8f95ed840f6947e1933e0c135885d1a0/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:34.292016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7accd1f-6bfc-4397-9af8-98a5419e98b3 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:34.292590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7accd1f-6bfc-4397-9af8-98a5419e98b3 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:34.292732 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-bbdbf72f-fbf9-416b-8a4f-34956b5356fc None None] MFA Rules not processed for user `5f64392091084110ba3980532ee321d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:34.297806 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7accd1f-6bfc-4397-9af8-98a5419e98b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:34.298143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bbdbf72f-fbf9-416b-8a4f-34956b5356fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:34.329320 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-e7accd1f-6bfc-4397-9af8-98a5419e98b3 None None] MFA Rules not processed for user `8f95ed840f6947e1933e0c135885d1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:34.331339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e7accd1f-6bfc-4397-9af8-98a5419e98b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:34.385273 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 974/1927] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:34.398441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbf72f-fbf9-416b-8a4f-34956b5356fc None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:34.399914 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bbdbf72f-fbf9-416b-8a4f-34956b5356fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:34.410996 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 954/1928] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:34.414511 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7accd1f-6bfc-4397-9af8-98a5419e98b3 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:34.464901 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbf72f-fbf9-416b-8a4f-34956b5356fc None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:34.468662 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea31070-b732-4e48-8ca9-02e7626e93da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:34.469275 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea31070-b732-4e48-8ca9-02e7626e93da service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:34.469588 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea31070-b732-4e48-8ca9-02e7626e93da service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:34.469950 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea31070-b732-4e48-8ca9-02e7626e93da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:34.481050 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea31070-b732-4e48-8ca9-02e7626e93da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:34.482574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea31070-b732-4e48-8ca9-02e7626e93da service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:34.492912 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7accd1f-6bfc-4397-9af8-98a5419e98b3 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:34.493933 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 975/1929] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:18:34.497854 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804613f8-9818-4f70-ad4a-bf3ccf85b8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:34.498637 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804613f8-9818-4f70-ad4a-bf3ccf85b8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:34.498918 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804613f8-9818-4f70-ad4a-bf3ccf85b8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:34.499195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804613f8-9818-4f70-ad4a-bf3ccf85b8d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:34.499966 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804613f8-9818-4f70-ad4a-bf3ccf85b8d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:34.502186 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804613f8-9818-4f70-ad4a-bf3ccf85b8d4 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:34.584853 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:34.592635 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 955/1930] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:34 2022] POST /identity/v3/projects => generated 387 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:34.599024 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea31070-b732-4e48-8ca9-02e7626e93da service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:34.611482 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea31070-b732-4e48-8ca9-02e7626e93da service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:34.684216 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255c4d9-7ffb-4fcb-abac-163efcbde179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:34.684928 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255c4d9-7ffb-4fcb-abac-163efcbde179 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:34.685209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255c4d9-7ffb-4fcb-abac-163efcbde179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:34.685598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255c4d9-7ffb-4fcb-abac-163efcbde179 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:34.686315 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255c4d9-7ffb-4fcb-abac-163efcbde179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:34.690021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255c4d9-7ffb-4fcb-abac-163efcbde179 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:34.786495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804613f8-9818-4f70-ad4a-bf3ccf85b8d4 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:34.797856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 976/1931] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:34 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:18:34.801723 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255c4d9-7ffb-4fcb-abac-163efcbde179 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:34.817093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255c4d9-7ffb-4fcb-abac-163efcbde179 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:34.823136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc55ed-8c70-4629-878d-d00b3cf5b836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:34.826177 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc55ed-8c70-4629-878d-d00b3cf5b836 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:34.826177 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc55ed-8c70-4629-878d-d00b3cf5b836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:34.826177 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc55ed-8c70-4629-878d-d00b3cf5b836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:34.836332 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc55ed-8c70-4629-878d-d00b3cf5b836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:34.838323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc55ed-8c70-4629-878d-d00b3cf5b836 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:34.847421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:34.852777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804613f8-9818-4f70-ad4a-bf3ccf85b8d4 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:34.855603 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 977/1932] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:18:34.856463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc55ed-8c70-4629-878d-d00b3cf5b836 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:34.858176 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f0dc55ed-8c70-4629-878d-d00b3cf5b836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:34.860022 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e694508-997f-4a8e-b54b-984c7bb9c177 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:34.860649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e694508-997f-4a8e-b54b-984c7bb9c177 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:34.860968 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e694508-997f-4a8e-b54b-984c7bb9c177 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:34.861248 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e694508-997f-4a8e-b54b-984c7bb9c177 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:34.863114 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9e694508-997f-4a8e-b54b-984c7bb9c177 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:34.870721 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc55ed-8c70-4629-878d-d00b3cf5b836 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:34.876077 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519efaf2-5298-4d12-b8a4-de9abb69fea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:34.877588 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519efaf2-5298-4d12-b8a4-de9abb69fea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:34.878093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519efaf2-5298-4d12-b8a4-de9abb69fea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:34.878391 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519efaf2-5298-4d12-b8a4-de9abb69fea0 admin admin] PATH_INFO: `/v3/projects/5b3b4aca3bee4aeeae9de589c777fbb1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:34.879583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519efaf2-5298-4d12-b8a4-de9abb69fea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3b4aca3bee4aeeae9de589c777fbb1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:34.882911 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519efaf2-5298-4d12-b8a4-de9abb69fea0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:34.924486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e694508-997f-4a8e-b54b-984c7bb9c177 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:34.926005 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e694508-997f-4a8e-b54b-984c7bb9c177 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:34.934858 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 956/1933] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:18:34.935640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e694508-997f-4a8e-b54b-984c7bb9c177 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:34.946802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e694508-997f-4a8e-b54b-984c7bb9c177 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:34.951423 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b744d4-d277-44d7-8a20-a93261d1e219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:34.952035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b744d4-d277-44d7-8a20-a93261d1e219 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:34.952478 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b744d4-d277-44d7-8a20-a93261d1e219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:34.952569 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b744d4-d277-44d7-8a20-a93261d1e219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:34.953205 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b744d4-d277-44d7-8a20-a93261d1e219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:34.955033 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b744d4-d277-44d7-8a20-a93261d1e219 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:34.965998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 957/1934] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:34.969767 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b744d4-d277-44d7-8a20-a93261d1e219 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:34.981350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b744d4-d277-44d7-8a20-a93261d1e219 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:34.988743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-519efaf2-5298-4d12-b8a4-de9abb69fea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3b4aca3bee4aeeae9de589c777fbb1', 'request_id': 'req-519efaf2-5298-4d12-b8a4-de9abb69fea0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:34.994785 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-519efaf2-5298-4d12-b8a4-de9abb69fea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3b4aca3bee4aeeae9de589c777fbb1', 'request_id': 'req-519efaf2-5298-4d12-b8a4-de9abb69fea0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:35.056351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5e378-e425-475d-a46c-38beed93f479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:35.056351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5e378-e425-475d-a46c-38beed93f479 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:35.056351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5e378-e425-475d-a46c-38beed93f479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:35.056351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5e378-e425-475d-a46c-38beed93f479 admin admin] PATH_INFO: `/v3/projects/3974cc39446f47c38f5a181fc6b0b61d/users/92e50a43b8004e97906d34b719c4963a/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:35.070055 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5e378-e425-475d-a46c-38beed93f479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3974cc39446f47c38f5a181fc6b0b61d, user_id=92e50a43b8004e97906d34b719c4963a, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:35.075283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5e378-e425-475d-a46c-38beed93f479 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:35.076433 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-519efaf2-5298-4d12-b8a4-de9abb69fea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3b4aca3bee4aeeae9de589c777fbb1', 'request_id': 'req-519efaf2-5298-4d12-b8a4-de9abb69fea0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:35.097381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-519efaf2-5298-4d12-b8a4-de9abb69fea0 admin admin] The token cache is being invalidate because project 5b3b4aca3bee4aeeae9de589c777fbb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:35.097713 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-519efaf2-5298-4d12-b8a4-de9abb69fea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:35.100295 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-519efaf2-5298-4d12-b8a4-de9abb69fea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:35.103512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 978/1935] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:34 2022] DELETE /identity/v3/projects/5b3b4aca3bee4aeeae9de589c777fbb1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:35.109653 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519efaf2-5298-4d12-b8a4-de9abb69fea0 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:35.113782 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-519efaf2-5298-4d12-b8a4-de9abb69fea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:35.137088 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:35.144856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519efaf2-5298-4d12-b8a4-de9abb69fea0 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:35.152184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af244d-cac8-44df-bc08-25e06c471d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:35.153005 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af244d-cac8-44df-bc08-25e06c471d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:35.153391 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af244d-cac8-44df-bc08-25e06c471d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:35.157125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af244d-cac8-44df-bc08-25e06c471d65 admin admin] PATH_INFO: `/v3/users/61c2a107b9f749b1b9643b17967393b9` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:35.157125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af244d-cac8-44df-bc08-25e06c471d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c2a107b9f749b1b9643b17967393b9)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:35.159937 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af244d-cac8-44df-bc08-25e06c471d65 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:35.199117 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 958/1936] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:34 2022] PUT /identity/v3/projects/3974cc39446f47c38f5a181fc6b0b61d/users/92e50a43b8004e97906d34b719c4963a/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:35.216286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4521b6-e2f4-4655-b677-5b4948f06fac None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:35.216628 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4521b6-e2f4-4655-b677-5b4948f06fac None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:35.216875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4521b6-e2f4-4655-b677-5b4948f06fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:35.258278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-0c4521b6-e2f4-4655-b677-5b4948f06fac None None] MFA Rules not processed for user `92e50a43b8004e97906d34b719c4963a`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:35.259480 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0c4521b6-e2f4-4655-b677-5b4948f06fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:35.354142 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 959/1937] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:35.356294 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4521b6-e2f4-4655-b677-5b4948f06fac None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:35.357728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0c4521b6-e2f4-4655-b677-5b4948f06fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:35.388151 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f2af244d-cac8-44df-bc08-25e06c471d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c2a107b9f749b1b9643b17967393b9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:35.460403 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f2af244d-cac8-44df-bc08-25e06c471d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c2a107b9f749b1b9643b17967393b9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:35.461586 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f2af244d-cac8-44df-bc08-25e06c471d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c2a107b9f749b1b9643b17967393b9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:35.461904 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f2af244d-cac8-44df-bc08-25e06c471d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c2a107b9f749b1b9643b17967393b9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:35.477161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4521b6-e2f4-4655-b677-5b4948f06fac None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:35.478391 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-f2af244d-cac8-44df-bc08-25e06c471d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c2a107b9f749b1b9643b17967393b9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:35.489476 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b525b03-c395-499e-8a92-89e03a3718d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:35.495612 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b525b03-c395-499e-8a92-89e03a3718d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:35.495612 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b525b03-c395-499e-8a92-89e03a3718d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:35.495612 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b525b03-c395-499e-8a92-89e03a3718d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:35.495612 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b525b03-c395-499e-8a92-89e03a3718d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:35.497917 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b525b03-c395-499e-8a92-89e03a3718d8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:35.518362 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 979/1938] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:35 2022] DELETE /identity/v3/users/61c2a107b9f749b1b9643b17967393b9 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:35.543573 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:35.621113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 960/1939] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:35 2022] POST /identity/v3/projects => generated 387 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:35.622416 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af244d-cac8-44df-bc08-25e06c471d65 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:35.624035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f2af244d-cac8-44df-bc08-25e06c471d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:35.690391 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af244d-cac8-44df-bc08-25e06c471d65 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:35.782468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689fefa-8c3a-4e63-b551-58d33890ffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:35.783136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689fefa-8c3a-4e63-b551-58d33890ffd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:35.783436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689fefa-8c3a-4e63-b551-58d33890ffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:35.784637 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689fefa-8c3a-4e63-b551-58d33890ffd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:35.784637 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689fefa-8c3a-4e63-b551-58d33890ffd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:35.790979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689fefa-8c3a-4e63-b551-58d33890ffd5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:35.856883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:35.889447 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 980/1940] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:35 2022] POST /identity/v3/users => generated 300 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:35.890767 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b525b03-c395-499e-8a92-89e03a3718d8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:35.904003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b525b03-c395-499e-8a92-89e03a3718d8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:35.909748 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d939035-0d4e-4b54-a6ee-10bdd0d5700d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:35.910625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d939035-0d4e-4b54-a6ee-10bdd0d5700d admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:35.910990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d939035-0d4e-4b54-a6ee-10bdd0d5700d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:35.911336 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d939035-0d4e-4b54-a6ee-10bdd0d5700d admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:35.912190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d939035-0d4e-4b54-a6ee-10bdd0d5700d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:35.914014 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d939035-0d4e-4b54-a6ee-10bdd0d5700d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:35.927854 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 961/1941] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:35.931315 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689fefa-8c3a-4e63-b551-58d33890ffd5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:35.943016 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689fefa-8c3a-4e63-b551-58d33890ffd5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:35.963950 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d9a5b-8d73-4439-95ac-823aebb2a033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:35.964723 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d9a5b-8d73-4439-95ac-823aebb2a033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:35.965094 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d9a5b-8d73-4439-95ac-823aebb2a033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:35.965520 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d9a5b-8d73-4439-95ac-823aebb2a033 admin admin] PATH_INFO: `/v3/projects/24e0df44888f420fb02c0b730beae042/users/ddcf502182ac4534b93f053a5e1c540d/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:35.982993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d9a5b-8d73-4439-95ac-823aebb2a033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e0df44888f420fb02c0b730beae042, user_id=ddcf502182ac4534b93f053a5e1c540d, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:35.986029 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d9a5b-8d73-4439-95ac-823aebb2a033 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:36.071260 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d939035-0d4e-4b54-a6ee-10bdd0d5700d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:36.073066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2d939035-0d4e-4b54-a6ee-10bdd0d5700d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:36.087155 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d939035-0d4e-4b54-a6ee-10bdd0d5700d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:36.097153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 981/1942] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:35 2022] PUT /identity/v3/projects/24e0df44888f420fb02c0b730beae042/users/ddcf502182ac4534b93f053a5e1c540d/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:36.101322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d9a5b-8d73-4439-95ac-823aebb2a033 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:36.160345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2343e-95c5-46a9-a852-af6e1b2f46f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:36.161333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2343e-95c5-46a9-a852-af6e1b2f46f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:36.161736 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2343e-95c5-46a9-a852-af6e1b2f46f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:36.162435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2343e-95c5-46a9-a852-af6e1b2f46f7 admin admin] PATH_INFO: `/v3/projects/76015df7bb63434280e894b6b91e062c` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:36.163390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2343e-95c5-46a9-a852-af6e1b2f46f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76015df7bb63434280e894b6b91e062c)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:36.165953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2343e-95c5-46a9-a852-af6e1b2f46f7 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:36.201490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d9a5b-8d73-4439-95ac-823aebb2a033 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:36.208028 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266cedd-6147-4f91-af09-31b6d7843d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:36.208645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266cedd-6147-4f91-af09-31b6d7843d84 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:36.208922 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266cedd-6147-4f91-af09-31b6d7843d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:36.209800 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266cedd-6147-4f91-af09-31b6d7843d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:36.210024 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266cedd-6147-4f91-af09-31b6d7843d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:36.212667 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266cedd-6147-4f91-af09-31b6d7843d84 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:36.225817 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 982/1943] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:18:36.228818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266cedd-6147-4f91-af09-31b6d7843d84 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:36.239875 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266cedd-6147-4f91-af09-31b6d7843d84 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:36.244919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67baa4-b126-4908-abb0-3cd4e2dc619e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:36.245945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67baa4-b126-4908-abb0-3cd4e2dc619e admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:36.245945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67baa4-b126-4908-abb0-3cd4e2dc619e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:36.246233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67baa4-b126-4908-abb0-3cd4e2dc619e admin admin] PATH_INFO: `/v3/projects/24e0df44888f420fb02c0b730beae042/users/ddcf502182ac4534b93f053a5e1c540d/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:36.248480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67baa4-b126-4908-abb0-3cd4e2dc619e admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e0df44888f420fb02c0b730beae042, user_id=ddcf502182ac4534b93f053a5e1c540d, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:36.251433 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67baa4-b126-4908-abb0-3cd4e2dc619e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:36.263023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 983/1944] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:36 2022] PUT /identity/v3/projects/24e0df44888f420fb02c0b730beae042/users/ddcf502182ac4534b93f053a5e1c540d/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:36.275261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59625d58-1977-4317-993d-45169ea8489a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:36.275576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59625d58-1977-4317-993d-45169ea8489a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:36.275804 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59625d58-1977-4317-993d-45169ea8489a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:36.323172 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-59625d58-1977-4317-993d-45169ea8489a None None] MFA Rules not processed for user `ddcf502182ac4534b93f053a5e1c540d`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:36.324376 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-59625d58-1977-4317-993d-45169ea8489a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:36.334425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2fd2343e-95c5-46a9-a852-af6e1b2f46f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76015df7bb63434280e894b6b91e062c', 'request_id': 'req-2fd2343e-95c5-46a9-a852-af6e1b2f46f7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:36.350746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2fd2343e-95c5-46a9-a852-af6e1b2f46f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76015df7bb63434280e894b6b91e062c', 'request_id': 'req-2fd2343e-95c5-46a9-a852-af6e1b2f46f7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:36.449652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 984/1945] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:36.458334 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59625d58-1977-4317-993d-45169ea8489a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:36.461940 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-59625d58-1977-4317-993d-45169ea8489a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:36.503078 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2fd2343e-95c5-46a9-a852-af6e1b2f46f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76015df7bb63434280e894b6b91e062c', 'request_id': 'req-2fd2343e-95c5-46a9-a852-af6e1b2f46f7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:36.530517 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2fd2343e-95c5-46a9-a852-af6e1b2f46f7 admin admin] The token cache is being invalidate because project 76015df7bb63434280e894b6b91e062c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:36.530815 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2fd2343e-95c5-46a9-a852-af6e1b2f46f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:36.532273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2fd2343e-95c5-46a9-a852-af6e1b2f46f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:36.534119 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 962/1946] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:36 2022] DELETE /identity/v3/projects/76015df7bb63434280e894b6b91e062c => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:36.538795 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f11de-6593-4f1c-8069-c07af3e30a78 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:36.539726 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f11de-6593-4f1c-8069-c07af3e30a78 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:36.540112 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f11de-6593-4f1c-8069-c07af3e30a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:36.548945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59625d58-1977-4317-993d-45169ea8489a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:36.553388 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658dbde-13e3-4c5e-b3a7-b3e86829f9c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:36.554209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658dbde-13e3-4c5e-b3a7-b3e86829f9c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:36.554706 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658dbde-13e3-4c5e-b3a7-b3e86829f9c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:36.555328 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658dbde-13e3-4c5e-b3a7-b3e86829f9c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:36.556870 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4658dbde-13e3-4c5e-b3a7-b3e86829f9c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:36.568804 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a61f11de-6593-4f1c-8069-c07af3e30a78 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:36.569844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a61f11de-6593-4f1c-8069-c07af3e30a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:36.570981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658dbde-13e3-4c5e-b3a7-b3e86829f9c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:36.572484 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658dbde-13e3-4c5e-b3a7-b3e86829f9c7 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:36.583658 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 985/1947] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:18:36.659329 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 963/1948] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:36.667188 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b05d1-4a15-4500-a9c0-a0aed66dd733 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:36.667513 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b05d1-4a15-4500-a9c0-a0aed66dd733 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:36.667779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b05d1-4a15-4500-a9c0-a0aed66dd733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:36.715393 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e46b05d1-4a15-4500-a9c0-a0aed66dd733 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:36.716781 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e46b05d1-4a15-4500-a9c0-a0aed66dd733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:36.730473 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 986/1949] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:36.735325 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f11de-6593-4f1c-8069-c07af3e30a78 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:36.748887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f11de-6593-4f1c-8069-c07af3e30a78 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:36.755204 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53553168-4430-4a6c-ad5d-762c25338141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:36.756174 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53553168-4430-4a6c-ad5d-762c25338141 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:36.756559 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53553168-4430-4a6c-ad5d-762c25338141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:36.756930 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53553168-4430-4a6c-ad5d-762c25338141 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:36.757736 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53553168-4430-4a6c-ad5d-762c25338141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:18:36.758134 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53553168-4430-4a6c-ad5d-762c25338141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:36.760205 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53553168-4430-4a6c-ad5d-762c25338141 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:36.777805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 964/1950] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:18:36.783497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b05d1-4a15-4500-a9c0-a0aed66dd733 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:36.794795 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b05d1-4a15-4500-a9c0-a0aed66dd733 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:36.804094 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450e5d0-861f-4121-bf5f-55cf5858d332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:36.804094 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450e5d0-861f-4121-bf5f-55cf5858d332 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:36.804094 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450e5d0-861f-4121-bf5f-55cf5858d332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:36.804094 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450e5d0-861f-4121-bf5f-55cf5858d332 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:36.805186 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450e5d0-861f-4121-bf5f-55cf5858d332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:36.806571 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450e5d0-861f-4121-bf5f-55cf5858d332 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:37.021866 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 987/1951] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:36 2022] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:37.022909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53553168-4430-4a6c-ad5d-762c25338141 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:37.033373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53553168-4430-4a6c-ad5d-762c25338141 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:37.117621 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1a275-00ca-4099-9131-aa9d4df8f9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:37.118245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a275-00ca-4099-9131-aa9d4df8f9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:37.118524 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a275-00ca-4099-9131-aa9d4df8f9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:37.118796 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a275-00ca-4099-9131-aa9d4df8f9d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:37.120509 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1a275-00ca-4099-9131-aa9d4df8f9d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:37.121435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1a275-00ca-4099-9131-aa9d4df8f9d4 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:37.237346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 965/1952] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:37 2022] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:18:37.242421 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450e5d0-861f-4121-bf5f-55cf5858d332 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:37.252911 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450e5d0-861f-4121-bf5f-55cf5858d332 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:37.257512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8af28f-e917-4ebb-8ff2-fda3b154708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:37.258097 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8af28f-e917-4ebb-8ff2-fda3b154708c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:37.258379 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8af28f-e917-4ebb-8ff2-fda3b154708c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:37.258655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8af28f-e917-4ebb-8ff2-fda3b154708c admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:37.259296 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8af28f-e917-4ebb-8ff2-fda3b154708c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:37.260880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8af28f-e917-4ebb-8ff2-fda3b154708c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:37.270666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 988/1953] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:37.274705 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1a275-00ca-4099-9131-aa9d4df8f9d4 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:37.285319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1a275-00ca-4099-9131-aa9d4df8f9d4 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:37.289988 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2027940-7fb7-4dc0-9836-2a463601e02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:37.290599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2027940-7fb7-4dc0-9836-2a463601e02b admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:37.290885 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2027940-7fb7-4dc0-9836-2a463601e02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:37.291160 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2027940-7fb7-4dc0-9836-2a463601e02b admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:37.291798 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2027940-7fb7-4dc0-9836-2a463601e02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:37.293413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2027940-7fb7-4dc0-9836-2a463601e02b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:37.306058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 966/1954] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:37.309410 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8af28f-e917-4ebb-8ff2-fda3b154708c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:37.320153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8af28f-e917-4ebb-8ff2-fda3b154708c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:37.325058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ce9d2-e13b-4b31-acc8-79c3821e84cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:37.325791 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ce9d2-e13b-4b31-acc8-79c3821e84cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:37.326220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ce9d2-e13b-4b31-acc8-79c3821e84cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:37.326494 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ce9d2-e13b-4b31-acc8-79c3821e84cd admin admin] PATH_INFO: `/v3/projects/e33acc6b3d074277a1d1f7da19769e7a/users/3fd72504a35d4524836c8e4bae2f63ea/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:37.342345 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ce9d2-e13b-4b31-acc8-79c3821e84cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33acc6b3d074277a1d1f7da19769e7a, user_id=3fd72504a35d4524836c8e4bae2f63ea, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:37.345873 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ce9d2-e13b-4b31-acc8-79c3821e84cd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:37.422942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:37.431173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 989/1955] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:37 2022] PUT /identity/v3/projects/e33acc6b3d074277a1d1f7da19769e7a/users/3fd72504a35d4524836c8e4bae2f63ea/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:37.442730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73e8a4-e9b9-46aa-8520-af67cc55e6df None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:37.443005 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73e8a4-e9b9-46aa-8520-af67cc55e6df None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:37.443280 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73e8a4-e9b9-46aa-8520-af67cc55e6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:37.471299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-cb73e8a4-e9b9-46aa-8520-af67cc55e6df None None] MFA Rules not processed for user `3fd72504a35d4524836c8e4bae2f63ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:37.472606 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cb73e8a4-e9b9-46aa-8520-af67cc55e6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:37.551421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 967/1956] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:37.552049 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ce9d2-e13b-4b31-acc8-79c3821e84cd admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:37.641081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ce9d2-e13b-4b31-acc8-79c3821e84cd admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:37.651614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f3fd3-57b9-4e0a-8065-74bed2567413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:37.653007 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f3fd3-57b9-4e0a-8065-74bed2567413 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:37.653761 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f3fd3-57b9-4e0a-8065-74bed2567413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:37.654177 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f3fd3-57b9-4e0a-8065-74bed2567413 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:37.655605 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f3fd3-57b9-4e0a-8065-74bed2567413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:37.658990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f3fd3-57b9-4e0a-8065-74bed2567413 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:37.781532 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 990/1957] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:37 2022] POST /identity/v3/projects => generated 373 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:18:37.783113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73e8a4-e9b9-46aa-8520-af67cc55e6df None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:37.797053 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73e8a4-e9b9-46aa-8520-af67cc55e6df None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:37.878664 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f962f-fe42-4578-bb1f-cb48bcfa66b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:37.879348 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f962f-fe42-4578-bb1f-cb48bcfa66b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:37.879742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f962f-fe42-4578-bb1f-cb48bcfa66b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:37.879906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f962f-fe42-4578-bb1f-cb48bcfa66b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:37.880607 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f962f-fe42-4578-bb1f-cb48bcfa66b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:37.882601 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f962f-fe42-4578-bb1f-cb48bcfa66b2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:38.008448 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 968/1958] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:37 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:18:38.012591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f3fd3-57b9-4e0a-8065-74bed2567413 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:38.033698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f3fd3-57b9-4e0a-8065-74bed2567413 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:38.045106 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db0b9d-afd5-4056-bc3d-0e532b661008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:38.046042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db0b9d-afd5-4056-bc3d-0e532b661008 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:38.050036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db0b9d-afd5-4056-bc3d-0e532b661008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:38.050554 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db0b9d-afd5-4056-bc3d-0e532b661008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:38.057742 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db0b9d-afd5-4056-bc3d-0e532b661008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:38.059251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db0b9d-afd5-4056-bc3d-0e532b661008 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:38.093207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 991/1959] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:38.101187 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f962f-fe42-4578-bb1f-cb48bcfa66b2 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:38.101813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:38.122428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f962f-fe42-4578-bb1f-cb48bcfa66b2 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:38.131027 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11539aad-abe0-40e6-9f44-b79b7dddd35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:38.132275 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11539aad-abe0-40e6-9f44-b79b7dddd35e admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:38.132983 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11539aad-abe0-40e6-9f44-b79b7dddd35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:38.133470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11539aad-abe0-40e6-9f44-b79b7dddd35e admin admin] PATH_INFO: `/v3/projects/d29d5cec67e04bc9994e539c7987d8ab/users/35dd52035a3d4167a8f7946c994e3056/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:38.155961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11539aad-abe0-40e6-9f44-b79b7dddd35e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29d5cec67e04bc9994e539c7987d8ab, user_id=35dd52035a3d4167a8f7946c994e3056, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:38.159741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11539aad-abe0-40e6-9f44-b79b7dddd35e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:38.206013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db0b9d-afd5-4056-bc3d-0e532b661008 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:38.207723 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-95db0b9d-afd5-4056-bc3d-0e532b661008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:38.242553 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 969/1960] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:38 2022] PUT /identity/v3/projects/d29d5cec67e04bc9994e539c7987d8ab/users/35dd52035a3d4167a8f7946c994e3056/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:38.246369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11539aad-abe0-40e6-9f44-b79b7dddd35e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:38.275081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db0b9d-afd5-4056-bc3d-0e532b661008 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:38.313297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11539aad-abe0-40e6-9f44-b79b7dddd35e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:38.319263 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58c2d2-cbc1-44dc-a597-aa1d38d44995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:38.320118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58c2d2-cbc1-44dc-a597-aa1d38d44995 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:38.320474 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58c2d2-cbc1-44dc-a597-aa1d38d44995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:38.320819 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58c2d2-cbc1-44dc-a597-aa1d38d44995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:38.321660 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58c2d2-cbc1-44dc-a597-aa1d38d44995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:38.323467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58c2d2-cbc1-44dc-a597-aa1d38d44995 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:38.335808 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 970/1961] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:18:38.336961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659723b-8338-412c-9e5c-ef289583f36a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:38.337621 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659723b-8338-412c-9e5c-ef289583f36a service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:38.337901 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659723b-8338-412c-9e5c-ef289583f36a service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:38.338174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659723b-8338-412c-9e5c-ef289583f36a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:38.340140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5659723b-8338-412c-9e5c-ef289583f36a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:38.340508 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58c2d2-cbc1-44dc-a597-aa1d38d44995 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:38.352773 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58c2d2-cbc1-44dc-a597-aa1d38d44995 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:38.360117 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4187c-475c-4bfb-8bbe-e2ad46b9b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:38.361526 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4187c-475c-4bfb-8bbe-e2ad46b9b366 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:38.361953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4187c-475c-4bfb-8bbe-e2ad46b9b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:38.364490 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4187c-475c-4bfb-8bbe-e2ad46b9b366 admin admin] PATH_INFO: `/v3/projects/d29d5cec67e04bc9994e539c7987d8ab/users/35dd52035a3d4167a8f7946c994e3056/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:38.366717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4187c-475c-4bfb-8bbe-e2ad46b9b366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29d5cec67e04bc9994e539c7987d8ab, user_id=35dd52035a3d4167a8f7946c994e3056, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:38.370496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4187c-475c-4bfb-8bbe-e2ad46b9b366 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:38.393566 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 971/1962] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:38 2022] PUT /identity/v3/projects/d29d5cec67e04bc9994e539c7987d8ab/users/35dd52035a3d4167a8f7946c994e3056/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:38.396947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d260c11-0dd4-42fd-b4a0-94bf5fb3d452 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:38.397233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d260c11-0dd4-42fd-b4a0-94bf5fb3d452 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:38.397543 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d260c11-0dd4-42fd-b4a0-94bf5fb3d452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:38.421480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659723b-8338-412c-9e5c-ef289583f36a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:38.423175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659723b-8338-412c-9e5c-ef289583f36a service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:38.426490 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-6d260c11-0dd4-42fd-b4a0-94bf5fb3d452 None None] MFA Rules not processed for user `35dd52035a3d4167a8f7946c994e3056`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:38.428374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6d260c11-0dd4-42fd-b4a0-94bf5fb3d452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:38.432795 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 992/1963] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:38.524423 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 972/1964] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:38.657205 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659723b-8338-412c-9e5c-ef289583f36a service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:38.660033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5659723b-8338-412c-9e5c-ef289583f36a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:38.674633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659723b-8338-412c-9e5c-ef289583f36a service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:38.727219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938627f-a477-4a07-8e95-60c5f8053fcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:38.727848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938627f-a477-4a07-8e95-60c5f8053fcd service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:38.728109 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938627f-a477-4a07-8e95-60c5f8053fcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:38.728376 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938627f-a477-4a07-8e95-60c5f8053fcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:38.783959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938627f-a477-4a07-8e95-60c5f8053fcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:38.785412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938627f-a477-4a07-8e95-60c5f8053fcd service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:38.794823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 993/1965] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:40.058672 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:DELETE=4,keystone:SELECT=88,keystone:INSERT=8 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:40.716955 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:41.782685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:41.999202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:42.630581 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:42.690558 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d260c11-0dd4-42fd-b4a0-94bf5fb3d452 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:42.692291 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6d260c11-0dd4-42fd-b4a0-94bf5fb3d452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:42.765283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d260c11-0dd4-42fd-b4a0-94bf5fb3d452 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:42.770686 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cfb06-ae82-4557-92a7-c71623c29454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:42.772073 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cfb06-ae82-4557-92a7-c71623c29454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:42.772073 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cfb06-ae82-4557-92a7-c71623c29454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:42.772242 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cfb06-ae82-4557-92a7-c71623c29454 admin admin] PATH_INFO: `/v3/users/c377f0fc13cc43cca0504df1963d96ab` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:42.773302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cfb06-ae82-4557-92a7-c71623c29454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c377f0fc13cc43cca0504df1963d96ab)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:42.775344 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cfb06-ae82-4557-92a7-c71623c29454 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:42.985122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2a7cfb06-ae82-4557-92a7-c71623c29454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c377f0fc13cc43cca0504df1963d96ab'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:42.992658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2a7cfb06-ae82-4557-92a7-c71623c29454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c377f0fc13cc43cca0504df1963d96ab'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:42.993599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2a7cfb06-ae82-4557-92a7-c71623c29454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c377f0fc13cc43cca0504df1963d96ab'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:42.994297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2a7cfb06-ae82-4557-92a7-c71623c29454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c377f0fc13cc43cca0504df1963d96ab'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:43.028450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:43.099501 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2a7cfb06-ae82-4557-92a7-c71623c29454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c377f0fc13cc43cca0504df1963d96ab'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:43.148759 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 973/1966] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:42 2022] DELETE /identity/v3/users/c377f0fc13cc43cca0504df1963d96ab => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:43.152978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9f2ce-ced1-4ef1-82b9-9584e38462bd None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:43.153293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9f2ce-ced1-4ef1-82b9-9584e38462bd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:43.153717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9f2ce-ced1-4ef1-82b9-9584e38462bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:43.178268 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-caf9f2ce-ced1-4ef1-82b9-9584e38462bd None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:43.179800 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-caf9f2ce-ced1-4ef1-82b9-9584e38462bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:43.257392 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 994/1967] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:43.267142 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cfb06-ae82-4557-92a7-c71623c29454 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:43.269358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2a7cfb06-ae82-4557-92a7-c71623c29454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:43.326607 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cfb06-ae82-4557-92a7-c71623c29454 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:43.330350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06039741-7263-40d1-860b-5fea8d21a18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:43.331876 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06039741-7263-40d1-860b-5fea8d21a18d service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:43.332318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06039741-7263-40d1-860b-5fea8d21a18d service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:43.332523 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06039741-7263-40d1-860b-5fea8d21a18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:43.345844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06039741-7263-40d1-860b-5fea8d21a18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:43.347905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06039741-7263-40d1-860b-5fea8d21a18d service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:43.359818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 974/1968] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:43.477969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9f2ce-ced1-4ef1-82b9-9584e38462bd None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:43.480029 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-caf9f2ce-ced1-4ef1-82b9-9584e38462bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:43.493084 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9f2ce-ced1-4ef1-82b9-9584e38462bd None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:43.498341 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13f7ac-5771-4672-8e6e-2703f8fb51c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:43.498690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13f7ac-5771-4672-8e6e-2703f8fb51c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:43.498946 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13f7ac-5771-4672-8e6e-2703f8fb51c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:43.499355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13f7ac-5771-4672-8e6e-2703f8fb51c8 admin admin] PATH_INFO: `/v3/users/3fd72504a35d4524836c8e4bae2f63ea` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:43.500655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13f7ac-5771-4672-8e6e-2703f8fb51c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd72504a35d4524836c8e4bae2f63ea)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:43.503452 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13f7ac-5771-4672-8e6e-2703f8fb51c8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:43.792446 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-de13f7ac-5771-4672-8e6e-2703f8fb51c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd72504a35d4524836c8e4bae2f63ea'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:43.877260 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06039741-7263-40d1-860b-5fea8d21a18d service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:43.878794 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-06039741-7263-40d1-860b-5fea8d21a18d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:43.893224 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06039741-7263-40d1-860b-5fea8d21a18d service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:43.899857 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9459f-715a-46d3-ad3f-183e8bb52907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:43.900808 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9459f-715a-46d3-ad3f-183e8bb52907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:43.901150 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9459f-715a-46d3-ad3f-183e8bb52907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:43.901524 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9459f-715a-46d3-ad3f-183e8bb52907 admin admin] PATH_INFO: `/v3/projects/b0814f1369724c808a66c53163762254` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:43.902732 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9459f-715a-46d3-ad3f-183e8bb52907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0814f1369724c808a66c53163762254)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:43.905407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9459f-715a-46d3-ad3f-183e8bb52907 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:43.936094 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-de13f7ac-5771-4672-8e6e-2703f8fb51c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd72504a35d4524836c8e4bae2f63ea'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:43.937321 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-de13f7ac-5771-4672-8e6e-2703f8fb51c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd72504a35d4524836c8e4bae2f63ea'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:43.938038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-de13f7ac-5771-4672-8e6e-2703f8fb51c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd72504a35d4524836c8e4bae2f63ea'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:43.946203 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-de13f7ac-5771-4672-8e6e-2703f8fb51c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd72504a35d4524836c8e4bae2f63ea'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:43.966700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 995/1969] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:43 2022] DELETE /identity/v3/users/3fd72504a35d4524836c8e4bae2f63ea => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:43.971822 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5e3f5-7a8f-4a6b-926e-ba3ede355822 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:43.972109 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5e3f5-7a8f-4a6b-926e-ba3ede355822 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:43.972387 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5e3f5-7a8f-4a6b-926e-ba3ede355822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:43.991850 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e0a5e3f5-7a8f-4a6b-926e-ba3ede355822 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:43.993087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e0a5e3f5-7a8f-4a6b-926e-ba3ede355822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:44.043956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b1e9459f-715a-46d3-ad3f-183e8bb52907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0814f1369724c808a66c53163762254', 'request_id': 'req-b1e9459f-715a-46d3-ad3f-183e8bb52907'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:44.050900 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b1e9459f-715a-46d3-ad3f-183e8bb52907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0814f1369724c808a66c53163762254', 'request_id': 'req-b1e9459f-715a-46d3-ad3f-183e8bb52907'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:44.055031 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 996/1970] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:44.069618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5e3f5-7a8f-4a6b-926e-ba3ede355822 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:44.069618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e0a5e3f5-7a8f-4a6b-926e-ba3ede355822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:44.121074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b1e9459f-715a-46d3-ad3f-183e8bb52907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0814f1369724c808a66c53163762254', 'request_id': 'req-b1e9459f-715a-46d3-ad3f-183e8bb52907'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:44.124853 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5e3f5-7a8f-4a6b-926e-ba3ede355822 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:44.132434 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:44.136903 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b1e9459f-715a-46d3-ad3f-183e8bb52907 admin admin] The token cache is being invalidate because project b0814f1369724c808a66c53163762254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:44.137202 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b1e9459f-715a-46d3-ad3f-183e8bb52907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:44.137948 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b1e9459f-715a-46d3-ad3f-183e8bb52907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:44.139607 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 975/1971] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:43 2022] DELETE /identity/v3/projects/b0814f1369724c808a66c53163762254 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:44.144618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9459f-715a-46d3-ad3f-183e8bb52907 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:44.146293 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b1e9459f-715a-46d3-ad3f-183e8bb52907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:44.183513 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b210fb-c60e-4434-b410-01aa36e369fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:44.184737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b210fb-c60e-4434-b410-01aa36e369fd service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:44.185173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b210fb-c60e-4434-b410-01aa36e369fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:44.189346 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b210fb-c60e-4434-b410-01aa36e369fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:44.189346 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d7b210fb-c60e-4434-b410-01aa36e369fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:44.245176 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9459f-715a-46d3-ad3f-183e8bb52907 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:44.253296 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4123bb8-7166-4e71-b8d3-95eb7cd13a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:44.253957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4123bb8-7166-4e71-b8d3-95eb7cd13a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:44.254246 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4123bb8-7166-4e71-b8d3-95eb7cd13a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:44.254522 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4123bb8-7166-4e71-b8d3-95eb7cd13a3d admin admin] PATH_INFO: `/v3/users/5f64392091084110ba3980532ee321d7` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:44.255810 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4123bb8-7166-4e71-b8d3-95eb7cd13a3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f64392091084110ba3980532ee321d7)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:44.258371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4123bb8-7166-4e71-b8d3-95eb7cd13a3d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:44.261511 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b210fb-c60e-4434-b410-01aa36e369fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:44.263724 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b210fb-c60e-4434-b410-01aa36e369fd service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:44.278314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 997/1972] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:18:44.496626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a4123bb8-7166-4e71-b8d3-95eb7cd13a3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f64392091084110ba3980532ee321d7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:44.506910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a4123bb8-7166-4e71-b8d3-95eb7cd13a3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f64392091084110ba3980532ee321d7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:44.507785 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a4123bb8-7166-4e71-b8d3-95eb7cd13a3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f64392091084110ba3980532ee321d7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:44.508774 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a4123bb8-7166-4e71-b8d3-95eb7cd13a3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f64392091084110ba3980532ee321d7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:44.602114 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a4123bb8-7166-4e71-b8d3-95eb7cd13a3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f64392091084110ba3980532ee321d7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:44.641212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 976/1973] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:44 2022] DELETE /identity/v3/users/5f64392091084110ba3980532ee321d7 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:44.786267 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b210fb-c60e-4434-b410-01aa36e369fd service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:44.787730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d7b210fb-c60e-4434-b410-01aa36e369fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:44.813206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b210fb-c60e-4434-b410-01aa36e369fd service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:44.843863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:44.932109 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671adfe-8bd9-4815-bef4-698b2079d403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:44.932854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671adfe-8bd9-4815-bef4-698b2079d403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:44.933136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671adfe-8bd9-4815-bef4-698b2079d403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:44.933409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671adfe-8bd9-4815-bef4-698b2079d403 admin admin] PATH_INFO: `/v3/projects/e33acc6b3d074277a1d1f7da19769e7a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:44.935182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671adfe-8bd9-4815-bef4-698b2079d403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e33acc6b3d074277a1d1f7da19769e7a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:44.937976 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671adfe-8bd9-4815-bef4-698b2079d403 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:45.036319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:45.088818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3671adfe-8bd9-4815-bef4-698b2079d403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e33acc6b3d074277a1d1f7da19769e7a', 'request_id': 'req-3671adfe-8bd9-4815-bef4-698b2079d403'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:45.094358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3671adfe-8bd9-4815-bef4-698b2079d403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e33acc6b3d074277a1d1f7da19769e7a', 'request_id': 'req-3671adfe-8bd9-4815-bef4-698b2079d403'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:45.183507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3671adfe-8bd9-4815-bef4-698b2079d403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e33acc6b3d074277a1d1f7da19769e7a', 'request_id': 'req-3671adfe-8bd9-4815-bef4-698b2079d403'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:45.195890 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3671adfe-8bd9-4815-bef4-698b2079d403 admin admin] The token cache is being invalidate because project e33acc6b3d074277a1d1f7da19769e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:45.196184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3671adfe-8bd9-4815-bef4-698b2079d403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:45.196829 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3671adfe-8bd9-4815-bef4-698b2079d403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:45.198373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 998/1974] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:44 2022] DELETE /identity/v3/projects/e33acc6b3d074277a1d1f7da19769e7a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:45.202367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4123bb8-7166-4e71-b8d3-95eb7cd13a3d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:45.203808 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a4123bb8-7166-4e71-b8d3-95eb7cd13a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:45.217130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4123bb8-7166-4e71-b8d3-95eb7cd13a3d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:45.263523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671adfe-8bd9-4815-bef4-698b2079d403 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:45.266560 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3671adfe-8bd9-4815-bef4-698b2079d403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:45.294814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d41b8-407f-4f9a-b27f-ada9f35cdc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:45.295617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d41b8-407f-4f9a-b27f-ada9f35cdc72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:45.295900 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d41b8-407f-4f9a-b27f-ada9f35cdc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:45.296216 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d41b8-407f-4f9a-b27f-ada9f35cdc72 admin admin] PATH_INFO: `/v3/users/35dd52035a3d4167a8f7946c994e3056` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:45.297372 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d41b8-407f-4f9a-b27f-ada9f35cdc72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35dd52035a3d4167a8f7946c994e3056)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:45.300215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d41b8-407f-4f9a-b27f-ada9f35cdc72 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:45.332937 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671adfe-8bd9-4815-bef4-698b2079d403 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:45.337763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5e541-7f04-4119-b127-889b9b9b16db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:45.338396 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5e541-7f04-4119-b127-889b9b9b16db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:45.338680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5e541-7f04-4119-b127-889b9b9b16db admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:45.338961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5e541-7f04-4119-b127-889b9b9b16db admin admin] PATH_INFO: `/v3/projects/e31352306c9e4c1f9f2c4edbee3971ae` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:45.340091 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5e541-7f04-4119-b127-889b9b9b16db admin admin] RBAC: Authorizing `identity:delete_project(project_id=e31352306c9e4c1f9f2c4edbee3971ae)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:45.342060 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5e541-7f04-4119-b127-889b9b9b16db admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:45.482307 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4ca5e541-7f04-4119-b127-889b9b9b16db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e31352306c9e4c1f9f2c4edbee3971ae', 'request_id': 'req-4ca5e541-7f04-4119-b127-889b9b9b16db'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:45.482551 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9a6d41b8-407f-4f9a-b27f-ada9f35cdc72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35dd52035a3d4167a8f7946c994e3056'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:45.488533 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4ca5e541-7f04-4119-b127-889b9b9b16db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e31352306c9e4c1f9f2c4edbee3971ae', 'request_id': 'req-4ca5e541-7f04-4119-b127-889b9b9b16db'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:45.489997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9a6d41b8-407f-4f9a-b27f-ada9f35cdc72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35dd52035a3d4167a8f7946c994e3056'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:45.490703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9a6d41b8-407f-4f9a-b27f-ada9f35cdc72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35dd52035a3d4167a8f7946c994e3056'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:45.491317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9a6d41b8-407f-4f9a-b27f-ada9f35cdc72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35dd52035a3d4167a8f7946c994e3056'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:45.570471 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4ca5e541-7f04-4119-b127-889b9b9b16db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e31352306c9e4c1f9f2c4edbee3971ae', 'request_id': 'req-4ca5e541-7f04-4119-b127-889b9b9b16db'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:45.582000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4ca5e541-7f04-4119-b127-889b9b9b16db admin admin] The token cache is being invalidate because project e31352306c9e4c1f9f2c4edbee3971ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:45.582291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4ca5e541-7f04-4119-b127-889b9b9b16db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:45.582944 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4ca5e541-7f04-4119-b127-889b9b9b16db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:45.584591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 999/1975] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:45 2022] DELETE /identity/v3/projects/e31352306c9e4c1f9f2c4edbee3971ae => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:45.589775 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee5c05-be07-45a9-866a-f0d25fb0cdba None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:45.590058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee5c05-be07-45a9-866a-f0d25fb0cdba None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:45.590333 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee5c05-be07-45a9-866a-f0d25fb0cdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:45.610095 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-93ee5c05-be07-45a9-866a-f0d25fb0cdba None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:45.612067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-93ee5c05-be07-45a9-866a-f0d25fb0cdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:45.639185 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9a6d41b8-407f-4f9a-b27f-ada9f35cdc72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35dd52035a3d4167a8f7946c994e3056'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:45.669169 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 977/1976] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:45 2022] DELETE /identity/v3/users/35dd52035a3d4167a8f7946c994e3056 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:45.686058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1000/1977] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:45.695217 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f8885-2849-4101-a872-efb6be8a1f7f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:45.695589 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f8885-2849-4101-a872-efb6be8a1f7f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:45.695786 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f8885-2849-4101-a872-efb6be8a1f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:45.717006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ed5f8885-2849-4101-a872-efb6be8a1f7f None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:45.718547 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ed5f8885-2849-4101-a872-efb6be8a1f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:45.817491 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 978/1978] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:45.820776 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee5c05-be07-45a9-866a-f0d25fb0cdba None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:45.839713 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee5c05-be07-45a9-866a-f0d25fb0cdba None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:45.853819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31482def-e5a2-43fb-a8fb-a364b65c2a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:45.857290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31482def-e5a2-43fb-a8fb-a364b65c2a53 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:45.861607 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=78,keystone:INSERT=5,keystone:DELETE=17 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:45.863010 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31482def-e5a2-43fb-a8fb-a364b65c2a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:45.863387 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31482def-e5a2-43fb-a8fb-a364b65c2a53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:45.864430 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31482def-e5a2-43fb-a8fb-a364b65c2a53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:18:45.864565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31482def-e5a2-43fb-a8fb-a364b65c2a53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:45.866903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31482def-e5a2-43fb-a8fb-a364b65c2a53 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:45.898855 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1001/1979] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:18:45.904329 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f8885-2849-4101-a872-efb6be8a1f7f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:45.916778 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f8885-2849-4101-a872-efb6be8a1f7f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:45.922532 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db862b49-e853-4629-8b81-dae9a3e1c5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:45.923816 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db862b49-e853-4629-8b81-dae9a3e1c5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:45.924818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db862b49-e853-4629-8b81-dae9a3e1c5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:45.925332 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db862b49-e853-4629-8b81-dae9a3e1c5a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:45.926035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db862b49-e853-4629-8b81-dae9a3e1c5a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:45.928045 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db862b49-e853-4629-8b81-dae9a3e1c5a5 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:46.038320 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 979/1980] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:45 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:46.042877 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31482def-e5a2-43fb-a8fb-a364b65c2a53 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:46.060227 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31482def-e5a2-43fb-a8fb-a364b65c2a53 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:46.204838 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d46fb-07b3-4c74-911d-386af021f6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:46.205882 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d46fb-07b3-4c74-911d-386af021f6df admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:46.206211 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d46fb-07b3-4c74-911d-386af021f6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:46.206489 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d46fb-07b3-4c74-911d-386af021f6df admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:46.207335 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d46fb-07b3-4c74-911d-386af021f6df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:46.209498 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d46fb-07b3-4c74-911d-386af021f6df admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:46.332577 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db862b49-e853-4629-8b81-dae9a3e1c5a5 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:46.334568 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-db862b49-e853-4629-8b81-dae9a3e1c5a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:46.350740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db862b49-e853-4629-8b81-dae9a3e1c5a5 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:46.363080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a49218-0a2a-42ba-934b-5bbe70577830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:46.363790 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a49218-0a2a-42ba-934b-5bbe70577830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:46.364662 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a49218-0a2a-42ba-934b-5bbe70577830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:46.365024 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a49218-0a2a-42ba-934b-5bbe70577830 admin admin] PATH_INFO: `/v3/projects/d29d5cec67e04bc9994e539c7987d8ab` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:46.366874 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a49218-0a2a-42ba-934b-5bbe70577830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29d5cec67e04bc9994e539c7987d8ab)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:46.371107 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a49218-0a2a-42ba-934b-5bbe70577830 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:46.391687 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1002/1981] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:46 2022] POST /identity/v3/users => generated 291 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:46.392957 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d46fb-07b3-4c74-911d-386af021f6df admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:46.403391 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d46fb-07b3-4c74-911d-386af021f6df admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:46.408947 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02174bc7-f751-42ed-9b7d-0bffa109c2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:46.409589 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02174bc7-f751-42ed-9b7d-0bffa109c2de admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:46.409870 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02174bc7-f751-42ed-9b7d-0bffa109c2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:46.410140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02174bc7-f751-42ed-9b7d-0bffa109c2de admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:46.410803 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02174bc7-f751-42ed-9b7d-0bffa109c2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:46.412508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02174bc7-f751-42ed-9b7d-0bffa109c2de admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:46.425475 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1003/1982] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:18:46.426417 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02174bc7-f751-42ed-9b7d-0bffa109c2de admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:46.428214 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-02174bc7-f751-42ed-9b7d-0bffa109c2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:46.490744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02174bc7-f751-42ed-9b7d-0bffa109c2de admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:46.494538 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4a144-7ec4-477f-b36b-5a69107e481f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:46.498817 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4a144-7ec4-477f-b36b-5a69107e481f service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:46.498817 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4a144-7ec4-477f-b36b-5a69107e481f service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:46.498817 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4a144-7ec4-477f-b36b-5a69107e481f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:46.498817 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9fc4a144-7ec4-477f-b36b-5a69107e481f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:46.499144 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:46.522812 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-40a49218-0a2a-42ba-934b-5bbe70577830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29d5cec67e04bc9994e539c7987d8ab', 'request_id': 'req-40a49218-0a2a-42ba-934b-5bbe70577830'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:46.528557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-40a49218-0a2a-42ba-934b-5bbe70577830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29d5cec67e04bc9994e539c7987d8ab', 'request_id': 'req-40a49218-0a2a-42ba-934b-5bbe70577830'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:46.561647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4a144-7ec4-477f-b36b-5a69107e481f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:46.563213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4a144-7ec4-477f-b36b-5a69107e481f service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:46.573279 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1004/1983] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:46.574165 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4a144-7ec4-477f-b36b-5a69107e481f service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:46.584523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4a144-7ec4-477f-b36b-5a69107e481f service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:46.599103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-40a49218-0a2a-42ba-934b-5bbe70577830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29d5cec67e04bc9994e539c7987d8ab', 'request_id': 'req-40a49218-0a2a-42ba-934b-5bbe70577830'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:46.615045 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-40a49218-0a2a-42ba-934b-5bbe70577830 admin admin] The token cache is being invalidate because project d29d5cec67e04bc9994e539c7987d8ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:46.615494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-40a49218-0a2a-42ba-934b-5bbe70577830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:46.616534 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-40a49218-0a2a-42ba-934b-5bbe70577830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:46.618336 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 980/1984] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:46 2022] DELETE /identity/v3/projects/d29d5cec67e04bc9994e539c7987d8ab => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:46.623639 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f13b2-fa9c-4cf2-bbf2-3427ae8ed5ab None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:46.624034 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f13b2-fa9c-4cf2-bbf2-3427ae8ed5ab None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:46.625489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f13b2-fa9c-4cf2-bbf2-3427ae8ed5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:46.649655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512588a2-d78e-4beb-9424-ddc05d4521d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:46.650037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-861f13b2-fa9c-4cf2-bbf2-3427ae8ed5ab None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:46.650270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512588a2-d78e-4beb-9424-ddc05d4521d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:46.650561 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512588a2-d78e-4beb-9424-ddc05d4521d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:46.650820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512588a2-d78e-4beb-9424-ddc05d4521d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:46.651459 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512588a2-d78e-4beb-9424-ddc05d4521d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:46.652148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-861f13b2-fa9c-4cf2-bbf2-3427ae8ed5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:46.653045 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512588a2-d78e-4beb-9424-ddc05d4521d8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:46.664490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1005/1985] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:46.665186 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 981/1986] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:46.668395 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512588a2-d78e-4beb-9424-ddc05d4521d8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:46.670084 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-512588a2-d78e-4beb-9424-ddc05d4521d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:46.674921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13494efd-b12c-4cd0-8120-7b28a3aa3f1b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:46.675205 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13494efd-b12c-4cd0-8120-7b28a3aa3f1b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:46.675476 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13494efd-b12c-4cd0-8120-7b28a3aa3f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:46.683403 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512588a2-d78e-4beb-9424-ddc05d4521d8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:46.688174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a616f-7df6-4014-9a28-02ba15c2338b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:46.688847 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a616f-7df6-4014-9a28-02ba15c2338b admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:46.689853 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a616f-7df6-4014-9a28-02ba15c2338b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:46.690127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a616f-7df6-4014-9a28-02ba15c2338b admin admin] PATH_INFO: `/v3/projects/3b88f1622ec04aaebb0980e575e4ec2e/users/d3259e0991be454dbf4e0563418ed709/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:46.697126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-13494efd-b12c-4cd0-8120-7b28a3aa3f1b None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:46.698611 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-13494efd-b12c-4cd0-8120-7b28a3aa3f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:46.708192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 982/1987] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:46.712188 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a616f-7df6-4014-9a28-02ba15c2338b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b88f1622ec04aaebb0980e575e4ec2e, user_id=d3259e0991be454dbf4e0563418ed709, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:46.714551 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13494efd-b12c-4cd0-8120-7b28a3aa3f1b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:46.715880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a616f-7df6-4014-9a28-02ba15c2338b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:46.726102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13494efd-b12c-4cd0-8120-7b28a3aa3f1b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:46.731431 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efd718-90c5-41ba-8951-88ec0ebe3f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:46.732118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efd718-90c5-41ba-8951-88ec0ebe3f90 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:46.732468 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efd718-90c5-41ba-8951-88ec0ebe3f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:46.732741 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efd718-90c5-41ba-8951-88ec0ebe3f90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:46.733392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efd718-90c5-41ba-8951-88ec0ebe3f90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:18:46.733725 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efd718-90c5-41ba-8951-88ec0ebe3f90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:46.736890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efd718-90c5-41ba-8951-88ec0ebe3f90 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:46.765127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 983/1988] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:18:46.771965 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efd718-90c5-41ba-8951-88ec0ebe3f90 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:46.784389 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efd718-90c5-41ba-8951-88ec0ebe3f90 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:46.787074 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1006/1989] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:46 2022] PUT /identity/v3/projects/3b88f1622ec04aaebb0980e575e4ec2e/users/d3259e0991be454dbf4e0563418ed709/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:46.801931 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cc9ef-93af-4f43-b31d-8e298ba91040 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:46.802429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cc9ef-93af-4f43-b31d-8e298ba91040 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:46.802853 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304cc9ef-93af-4f43-b31d-8e298ba91040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:46.844599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-304cc9ef-93af-4f43-b31d-8e298ba91040 None None] MFA Rules not processed for user `d3259e0991be454dbf4e0563418ed709`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:46.846971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-304cc9ef-93af-4f43-b31d-8e298ba91040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:46.914626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8810edc-2ea5-4a3d-b005-c4ee79e685a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:46.915251 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8810edc-2ea5-4a3d-b005-c4ee79e685a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:46.915531 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8810edc-2ea5-4a3d-b005-c4ee79e685a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:46.915979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8810edc-2ea5-4a3d-b005-c4ee79e685a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:46.917229 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8810edc-2ea5-4a3d-b005-c4ee79e685a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:46.919187 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8810edc-2ea5-4a3d-b005-c4ee79e685a0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:46.949394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1007/1990] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:46.953971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cc9ef-93af-4f43-b31d-8e298ba91040 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:46.965802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304cc9ef-93af-4f43-b31d-8e298ba91040 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:46.971213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f710f-0a69-464d-bd06-cd6229673e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:46.971959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f710f-0a69-464d-bd06-cd6229673e40 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:46.972714 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f710f-0a69-464d-bd06-cd6229673e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:46.972714 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f710f-0a69-464d-bd06-cd6229673e40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:46.973230 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f710f-0a69-464d-bd06-cd6229673e40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:46.976229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f710f-0a69-464d-bd06-cd6229673e40 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:47.019976 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 984/1991] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:46 2022] POST /identity/v3/projects => generated 375 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:18:47.023928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8810edc-2ea5-4a3d-b005-c4ee79e685a0 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:47.096334 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1008/1992] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:46 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:47.096567 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8810edc-2ea5-4a3d-b005-c4ee79e685a0 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:47.097773 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f710f-0a69-464d-bd06-cd6229673e40 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:47.174318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b66a8-2cc8-4c33-9bec-8165ebe8813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:47.174950 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b66a8-2cc8-4c33-9bec-8165ebe8813f admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:47.175228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b66a8-2cc8-4c33-9bec-8165ebe8813f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:47.175499 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b66a8-2cc8-4c33-9bec-8165ebe8813f admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:47.176182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b66a8-2cc8-4c33-9bec-8165ebe8813f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:47.178367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b66a8-2cc8-4c33-9bec-8165ebe8813f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:47.186053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f710f-0a69-464d-bd06-cd6229673e40 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:47.198228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741c917-f751-4dff-b350-1dafe03af513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:47.198896 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741c917-f751-4dff-b350-1dafe03af513 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:47.199244 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741c917-f751-4dff-b350-1dafe03af513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:47.204949 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741c917-f751-4dff-b350-1dafe03af513 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:47.204949 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741c917-f751-4dff-b350-1dafe03af513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:47.204949 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741c917-f751-4dff-b350-1dafe03af513 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:47.233696 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:47.334537 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 985/1993] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:47 2022] POST /identity/v3/users => generated 288 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:18:47.337777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b66a8-2cc8-4c33-9bec-8165ebe8813f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:47.349320 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b66a8-2cc8-4c33-9bec-8165ebe8813f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:47.363197 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1009/1994] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:47 2022] POST /identity/v3/users => generated 296 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:47.365871 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f92ac-3dc2-4391-8677-edf11fca0497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:47.366696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f92ac-3dc2-4391-8677-edf11fca0497 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:47.367219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f92ac-3dc2-4391-8677-edf11fca0497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:47.367836 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f92ac-3dc2-4391-8677-edf11fca0497 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:47.368731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741c917-f751-4dff-b350-1dafe03af513 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:47.368912 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f92ac-3dc2-4391-8677-edf11fca0497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:47.370947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f92ac-3dc2-4391-8677-edf11fca0497 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:47.381956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 986/1995] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:18:47.386279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f92ac-3dc2-4391-8677-edf11fca0497 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:47.386517 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741c917-f751-4dff-b350-1dafe03af513 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:47.391518 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41158e2-ad89-44b0-89e2-07293b0c944c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:47.392780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41158e2-ad89-44b0-89e2-07293b0c944c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:47.392920 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41158e2-ad89-44b0-89e2-07293b0c944c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:47.394357 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41158e2-ad89-44b0-89e2-07293b0c944c admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:47.394357 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41158e2-ad89-44b0-89e2-07293b0c944c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:47.396048 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41158e2-ad89-44b0-89e2-07293b0c944c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:47.401009 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f92ac-3dc2-4391-8677-edf11fca0497 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:47.406441 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec2fcc-c3c9-4f70-9763-81a22d162a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:47.407056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec2fcc-c3c9-4f70-9763-81a22d162a36 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:47.407305 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1010/1996] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:47.408327 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec2fcc-c3c9-4f70-9763-81a22d162a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:47.408607 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec2fcc-c3c9-4f70-9763-81a22d162a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:47.409328 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec2fcc-c3c9-4f70-9763-81a22d162a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:47.411014 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec2fcc-c3c9-4f70-9763-81a22d162a36 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:47.412289 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41158e2-ad89-44b0-89e2-07293b0c944c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:47.423113 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41158e2-ad89-44b0-89e2-07293b0c944c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:47.429151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 987/1997] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:47.429281 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dfc73-b702-4cb4-958b-e0b237b27195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:47.429846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dfc73-b702-4cb4-958b-e0b237b27195 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:47.430137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dfc73-b702-4cb4-958b-e0b237b27195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:47.430415 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dfc73-b702-4cb4-958b-e0b237b27195 admin admin] PATH_INFO: `/v3/projects/1f2cbfb3535b46f183f4a5b2f19d1c77/users/55f98ee8dc8a42bfb5474e975ec4885a/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:47.433701 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec2fcc-c3c9-4f70-9763-81a22d162a36 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:47.449141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec2fcc-c3c9-4f70-9763-81a22d162a36 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:47.451999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13dfc73-b702-4cb4-958b-e0b237b27195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f2cbfb3535b46f183f4a5b2f19d1c77, user_id=55f98ee8dc8a42bfb5474e975ec4885a, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:47.453384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06f9ac-53a7-4c03-a7f9-c01bd2b8a095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:47.454204 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06f9ac-53a7-4c03-a7f9-c01bd2b8a095 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:47.455366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06f9ac-53a7-4c03-a7f9-c01bd2b8a095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:47.455664 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13dfc73-b702-4cb4-958b-e0b237b27195 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:47.455881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06f9ac-53a7-4c03-a7f9-c01bd2b8a095 admin admin] PATH_INFO: `/v3/projects/197fcb000fd844aa8c8692eb123c3d21/users/1237f479740c43b59c423a5533359c85/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:47.475020 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06f9ac-53a7-4c03-a7f9-c01bd2b8a095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=197fcb000fd844aa8c8692eb123c3d21, user_id=1237f479740c43b59c423a5533359c85, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:47.475656 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06f9ac-53a7-4c03-a7f9-c01bd2b8a095 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:47.515470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:47.523530 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1011/1998] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:47 2022] PUT /identity/v3/projects/1f2cbfb3535b46f183f4a5b2f19d1c77/users/55f98ee8dc8a42bfb5474e975ec4885a/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:47.528260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dfc73-b702-4cb4-958b-e0b237b27195 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:47.578765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 988/1999] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:47 2022] PUT /identity/v3/projects/197fcb000fd844aa8c8692eb123c3d21/users/1237f479740c43b59c423a5533359c85/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:47.590210 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793722d6-cf7c-4612-984e-b4969f5b7bd9 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:47.591932 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793722d6-cf7c-4612-984e-b4969f5b7bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:47.592712 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793722d6-cf7c-4612-984e-b4969f5b7bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:47.618553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dfc73-b702-4cb4-958b-e0b237b27195 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:47.654963 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-793722d6-cf7c-4612-984e-b4969f5b7bd9 None None] MFA Rules not processed for user `1237f479740c43b59c423a5533359c85`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:47.656245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-793722d6-cf7c-4612-984e-b4969f5b7bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:47.700385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33aba48-935c-488a-abc0-b5dfa7e3c77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:47.700883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33aba48-935c-488a-abc0-b5dfa7e3c77a admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:47.701227 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33aba48-935c-488a-abc0-b5dfa7e3c77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:47.701615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33aba48-935c-488a-abc0-b5dfa7e3c77a admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:47.702248 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33aba48-935c-488a-abc0-b5dfa7e3c77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:47.703889 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33aba48-935c-488a-abc0-b5dfa7e3c77a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:47.717447 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1012/2000] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:18:47.721438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33aba48-935c-488a-abc0-b5dfa7e3c77a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:47.721438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a33aba48-935c-488a-abc0-b5dfa7e3c77a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:47.734615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33aba48-935c-488a-abc0-b5dfa7e3c77a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:47.739378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67005159-a358-48bb-b78c-dad61d665dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:47.740001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67005159-a358-48bb-b78c-dad61d665dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:47.740278 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67005159-a358-48bb-b78c-dad61d665dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:47.740549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67005159-a358-48bb-b78c-dad61d665dae admin admin] PATH_INFO: `/v3/users/8c91c4fcf6a8477a94c5760c9140bce9` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:47.741692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67005159-a358-48bb-b78c-dad61d665dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c91c4fcf6a8477a94c5760c9140bce9)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:47.743711 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67005159-a358-48bb-b78c-dad61d665dae admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:47.744768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 989/2001] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:47.746282 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793722d6-cf7c-4612-984e-b4969f5b7bd9 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:47.757056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793722d6-cf7c-4612-984e-b4969f5b7bd9 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:47.762523 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5553c76-c79c-4fe4-b22a-aac1a77c9377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:47.764366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5553c76-c79c-4fe4-b22a-aac1a77c9377 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:47.764366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5553c76-c79c-4fe4-b22a-aac1a77c9377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:47.764366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5553c76-c79c-4fe4-b22a-aac1a77c9377 admin admin] PATH_INFO: `/v3/projects/1f2cbfb3535b46f183f4a5b2f19d1c77/users/55f98ee8dc8a42bfb5474e975ec4885a/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:47.765989 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5553c76-c79c-4fe4-b22a-aac1a77c9377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f2cbfb3535b46f183f4a5b2f19d1c77, user_id=55f98ee8dc8a42bfb5474e975ec4885a, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:47.769218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5553c76-c79c-4fe4-b22a-aac1a77c9377 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:47.780676 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 990/2002] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:47 2022] PUT /identity/v3/projects/1f2cbfb3535b46f183f4a5b2f19d1c77/users/55f98ee8dc8a42bfb5474e975ec4885a/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:47.789939 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5553c76-c79c-4fe4-b22a-aac1a77c9377 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:47.858182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5553c76-c79c-4fe4-b22a-aac1a77c9377 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:47.863058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aacd56-cbed-4fca-a8b5-f0f468ff7477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:47.863663 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aacd56-cbed-4fca-a8b5-f0f468ff7477 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:47.863940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aacd56-cbed-4fca-a8b5-f0f468ff7477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:47.864241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aacd56-cbed-4fca-a8b5-f0f468ff7477 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:47.864864 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aacd56-cbed-4fca-a8b5-f0f468ff7477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:47.866793 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aacd56-cbed-4fca-a8b5-f0f468ff7477 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:47.964465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 991/2003] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:47 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:47.969026 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e78d9-bd13-45c9-8ec5-08e234665bbd None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:47.969403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e78d9-bd13-45c9-8ec5-08e234665bbd None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:47.969775 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e78d9-bd13-45c9-8ec5-08e234665bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:47.977943 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-67005159-a358-48bb-b78c-dad61d665dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c91c4fcf6a8477a94c5760c9140bce9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:48.001430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-6b1e78d9-bd13-45c9-8ec5-08e234665bbd None None] MFA Rules not processed for user `55f98ee8dc8a42bfb5474e975ec4885a`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:48.003123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6b1e78d9-bd13-45c9-8ec5-08e234665bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:48.064402 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-67005159-a358-48bb-b78c-dad61d665dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c91c4fcf6a8477a94c5760c9140bce9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:48.065045 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-67005159-a358-48bb-b78c-dad61d665dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c91c4fcf6a8477a94c5760c9140bce9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:48.065756 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-67005159-a358-48bb-b78c-dad61d665dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c91c4fcf6a8477a94c5760c9140bce9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:48.073347 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-67005159-a358-48bb-b78c-dad61d665dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c91c4fcf6a8477a94c5760c9140bce9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:48.085661 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 992/2004] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:48.085661 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e78d9-bd13-45c9-8ec5-08e234665bbd None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:48.097134 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1013/2005] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:47 2022] DELETE /identity/v3/users/8c91c4fcf6a8477a94c5760c9140bce9 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:48.098341 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67005159-a358-48bb-b78c-dad61d665dae admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:48.099947 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-67005159-a358-48bb-b78c-dad61d665dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:48.158648 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e78d9-bd13-45c9-8ec5-08e234665bbd None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:48.162864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67005159-a358-48bb-b78c-dad61d665dae admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:48.166703 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de552e-8692-46a0-abe3-8bf5dd96e9d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:48.167367 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de552e-8692-46a0-abe3-8bf5dd96e9d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:48.167652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de552e-8692-46a0-abe3-8bf5dd96e9d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:48.168104 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de552e-8692-46a0-abe3-8bf5dd96e9d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:48.170194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c5de552e-8692-46a0-abe3-8bf5dd96e9d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:48.227545 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b60d0-d10b-4465-9bc9-269b45fd2388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:48.228386 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b60d0-d10b-4465-9bc9-269b45fd2388 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:48.228718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b60d0-d10b-4465-9bc9-269b45fd2388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:48.228973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b60d0-d10b-4465-9bc9-269b45fd2388 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:48.231381 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b60d0-d10b-4465-9bc9-269b45fd2388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:48.232065 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b60d0-d10b-4465-9bc9-269b45fd2388 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:48.245293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de552e-8692-46a0-abe3-8bf5dd96e9d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:48.246783 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de552e-8692-46a0-abe3-8bf5dd96e9d1 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:48.258106 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1014/2006] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:48.259553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba15547-1627-4a75-acf3-8edd110035bb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:48.260110 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba15547-1627-4a75-acf3-8edd110035bb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:48.260570 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba15547-1627-4a75-acf3-8edd110035bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:48.281145 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:48.284497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2ba15547-1627-4a75-acf3-8edd110035bb None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:48.286278 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2ba15547-1627-4a75-acf3-8edd110035bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:48.294763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1015/2007] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:48.304933 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba15547-1627-4a75-acf3-8edd110035bb None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:48.306452 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2ba15547-1627-4a75-acf3-8edd110035bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:48.367696 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba15547-1627-4a75-acf3-8edd110035bb None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:48.371420 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719867a-222c-48c7-b703-e1d761d5d9b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:48.372069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719867a-222c-48c7-b703-e1d761d5d9b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:48.372354 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719867a-222c-48c7-b703-e1d761d5d9b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:48.372627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719867a-222c-48c7-b703-e1d761d5d9b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:48.399110 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719867a-222c-48c7-b703-e1d761d5d9b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:48.401018 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719867a-222c-48c7-b703-e1d761d5d9b8 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:48.413065 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1016/2008] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:18:48.466665 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 993/2009] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:48 2022] POST /identity/v3/users => generated 289 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:48.471175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719867a-222c-48c7-b703-e1d761d5d9b8 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:48.473353 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f719867a-222c-48c7-b703-e1d761d5d9b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:48.491656 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719867a-222c-48c7-b703-e1d761d5d9b8 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:48.498105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b44878-e843-4416-aa1f-0dec61c9f946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:48.499078 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b44878-e843-4416-aa1f-0dec61c9f946 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:48.499500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b44878-e843-4416-aa1f-0dec61c9f946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:48.499871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b44878-e843-4416-aa1f-0dec61c9f946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:48.500649 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b44878-e843-4416-aa1f-0dec61c9f946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:48.503298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b44878-e843-4416-aa1f-0dec61c9f946 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:48.529960 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1017/2010] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:48.534147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b60d0-d10b-4465-9bc9-269b45fd2388 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:48.541107 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:48.552807 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b60d0-d10b-4465-9bc9-269b45fd2388 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:48.558479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b079501-2373-499d-b9a2-fb6fcfa5ef22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:48.559216 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b079501-2373-499d-b9a2-fb6fcfa5ef22 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:48.559596 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b079501-2373-499d-b9a2-fb6fcfa5ef22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:48.559971 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b079501-2373-499d-b9a2-fb6fcfa5ef22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:48.560823 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b079501-2373-499d-b9a2-fb6fcfa5ef22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:48.562564 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b079501-2373-499d-b9a2-fb6fcfa5ef22 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:48.577814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 994/2011] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:48.581180 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b44878-e843-4416-aa1f-0dec61c9f946 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:48.591833 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b44878-e843-4416-aa1f-0dec61c9f946 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:48.597876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d085a-6609-4a56-aafa-6ba9ad614c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:48.603179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d085a-6609-4a56-aafa-6ba9ad614c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:48.603179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d085a-6609-4a56-aafa-6ba9ad614c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:48.603179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d085a-6609-4a56-aafa-6ba9ad614c99 admin admin] PATH_INFO: `/v3/projects/869a928458b442d2ac37ef089c96d280/users/7a89f9cddf6843438f18b57256e51e77/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:48.615437 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d085a-6609-4a56-aafa-6ba9ad614c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869a928458b442d2ac37ef089c96d280, user_id=7a89f9cddf6843438f18b57256e51e77, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:48.618372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d085a-6609-4a56-aafa-6ba9ad614c99 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:48.684345 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1018/2012] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:48 2022] PUT /identity/v3/projects/869a928458b442d2ac37ef089c96d280/users/7a89f9cddf6843438f18b57256e51e77/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:48.695001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b40fb-1bbd-41fc-b1af-045f3d3f2905 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:48.695295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b40fb-1bbd-41fc-b1af-045f3d3f2905 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:48.695790 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b40fb-1bbd-41fc-b1af-045f3d3f2905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:48.736886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c62b40fb-1bbd-41fc-b1af-045f3d3f2905 None None] MFA Rules not processed for user `7a89f9cddf6843438f18b57256e51e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:48.738292 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c62b40fb-1bbd-41fc-b1af-045f3d3f2905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:48.820155 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 995/2013] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:48.824538 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d085a-6609-4a56-aafa-6ba9ad614c99 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:48.877170 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:48.923585 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d085a-6609-4a56-aafa-6ba9ad614c99 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:48.943362 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152e6eb-8c86-4bea-b9cc-afaaed301b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:48.945277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e6eb-8c86-4bea-b9cc-afaaed301b79 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:48.945277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e6eb-8c86-4bea-b9cc-afaaed301b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:48.945277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e6eb-8c86-4bea-b9cc-afaaed301b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:48.945277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152e6eb-8c86-4bea-b9cc-afaaed301b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:48.947224 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152e6eb-8c86-4bea-b9cc-afaaed301b79 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:48.963202 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b40fb-1bbd-41fc-b1af-045f3d3f2905 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:48.964820 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c62b40fb-1bbd-41fc-b1af-045f3d3f2905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:48.981898 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b40fb-1bbd-41fc-b1af-045f3d3f2905 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:48.997023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a13807-7582-46f8-a169-52fae4a815f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:49.027081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a13807-7582-46f8-a169-52fae4a815f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:49.027269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a13807-7582-46f8-a169-52fae4a815f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:49.027551 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a13807-7582-46f8-a169-52fae4a815f2 admin admin] PATH_INFO: `/v3/projects/2b4fb7ea1ff949678ecb538b7c84dd6d` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:49.030249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a13807-7582-46f8-a169-52fae4a815f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4fb7ea1ff949678ecb538b7c84dd6d)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:49.032313 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a13807-7582-46f8-a169-52fae4a815f2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:49.119618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1019/2014] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:48 2022] POST /identity/v3/projects => generated 375 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:49.121686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152e6eb-8c86-4bea-b9cc-afaaed301b79 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:49.209252 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152e6eb-8c86-4bea-b9cc-afaaed301b79 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:49.210328 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-17a13807-7582-46f8-a169-52fae4a815f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4fb7ea1ff949678ecb538b7c84dd6d', 'request_id': 'req-17a13807-7582-46f8-a169-52fae4a815f2'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:49.220855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-17a13807-7582-46f8-a169-52fae4a815f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4fb7ea1ff949678ecb538b7c84dd6d', 'request_id': 'req-17a13807-7582-46f8-a169-52fae4a815f2'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:49.276951 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687e674-3371-4a40-af02-b1ca53236571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:49.277665 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687e674-3371-4a40-af02-b1ca53236571 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:49.277944 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687e674-3371-4a40-af02-b1ca53236571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:49.278213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687e674-3371-4a40-af02-b1ca53236571 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:49.278845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687e674-3371-4a40-af02-b1ca53236571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:49.280787 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687e674-3371-4a40-af02-b1ca53236571 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:49.365216 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-17a13807-7582-46f8-a169-52fae4a815f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4fb7ea1ff949678ecb538b7c84dd6d', 'request_id': 'req-17a13807-7582-46f8-a169-52fae4a815f2'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:49.379939 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-17a13807-7582-46f8-a169-52fae4a815f2 admin admin] The token cache is being invalidate because project 2b4fb7ea1ff949678ecb538b7c84dd6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:49.380307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-17a13807-7582-46f8-a169-52fae4a815f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:49.381168 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-17a13807-7582-46f8-a169-52fae4a815f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:49.382837 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 996/2015] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:48 2022] DELETE /identity/v3/projects/2b4fb7ea1ff949678ecb538b7c84dd6d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:49.386844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a13807-7582-46f8-a169-52fae4a815f2 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:49.388365 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-17a13807-7582-46f8-a169-52fae4a815f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:49.396516 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1020/2016] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:49 2022] POST /identity/v3/users => generated 294 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:49.401310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687e674-3371-4a40-af02-b1ca53236571 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:49.403085 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9687e674-3371-4a40-af02-b1ca53236571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:49.403660 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a13807-7582-46f8-a169-52fae4a815f2 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:49.409757 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7605e97-772b-4b97-b288-4d4ddd9c879e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:49.410542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7605e97-772b-4b97-b288-4d4ddd9c879e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:49.410829 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7605e97-772b-4b97-b288-4d4ddd9c879e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:49.411105 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7605e97-772b-4b97-b288-4d4ddd9c879e admin admin] PATH_INFO: `/v3/users/a6a787b1c4cf418d83d8a923b011d6ae` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:49.412386 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7605e97-772b-4b97-b288-4d4ddd9c879e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a787b1c4cf418d83d8a923b011d6ae)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:49.414416 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7605e97-772b-4b97-b288-4d4ddd9c879e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:49.416130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687e674-3371-4a40-af02-b1ca53236571 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:49.421201 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2691146-9a9b-4c17-bfcb-815bf1766179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:49.422099 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2691146-9a9b-4c17-bfcb-815bf1766179 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:49.422393 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2691146-9a9b-4c17-bfcb-815bf1766179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:49.422664 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2691146-9a9b-4c17-bfcb-815bf1766179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:49.423313 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2691146-9a9b-4c17-bfcb-815bf1766179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:49.425596 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2691146-9a9b-4c17-bfcb-815bf1766179 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:49.443250 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1021/2017] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:18:49.447427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2691146-9a9b-4c17-bfcb-815bf1766179 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:49.460695 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2691146-9a9b-4c17-bfcb-815bf1766179 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:49.465663 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d53d26-6a28-4697-8356-970504d5a976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:49.466228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53d26-6a28-4697-8356-970504d5a976 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:49.466512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53d26-6a28-4697-8356-970504d5a976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:49.466784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53d26-6a28-4697-8356-970504d5a976 admin admin] PATH_INFO: `/v3/projects/f8c39052ea044ed89cd3b3d254e2851d/users/8499173f962a48f19826f58e637bb315/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:49.481752 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d53d26-6a28-4697-8356-970504d5a976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c39052ea044ed89cd3b3d254e2851d, user_id=8499173f962a48f19826f58e637bb315, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:49.484442 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d53d26-6a28-4697-8356-970504d5a976 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:49.558357 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:49.607147 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1022/2018] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:49 2022] PUT /identity/v3/projects/f8c39052ea044ed89cd3b3d254e2851d/users/8499173f962a48f19826f58e637bb315/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:49.608055 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d53d26-6a28-4697-8356-970504d5a976 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:49.609621 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c9d53d26-6a28-4697-8356-970504d5a976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:49.674998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f7605e97-772b-4b97-b288-4d4ddd9c879e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a787b1c4cf418d83d8a923b011d6ae'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:49.676497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d53d26-6a28-4697-8356-970504d5a976 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:49.681926 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d2790-bd5a-4a0f-9c83-4a2f5e14ea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:49.682083 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f7605e97-772b-4b97-b288-4d4ddd9c879e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a787b1c4cf418d83d8a923b011d6ae'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:49.682658 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d2790-bd5a-4a0f-9c83-4a2f5e14ea57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:49.682766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f7605e97-772b-4b97-b288-4d4ddd9c879e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a787b1c4cf418d83d8a923b011d6ae'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:49.682961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d2790-bd5a-4a0f-9c83-4a2f5e14ea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:49.683208 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d2790-bd5a-4a0f-9c83-4a2f5e14ea57 admin admin] PATH_INFO: `/v3/users/d3259e0991be454dbf4e0563418ed709` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:49.683479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f7605e97-772b-4b97-b288-4d4ddd9c879e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a787b1c4cf418d83d8a923b011d6ae'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:49.684350 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d2790-bd5a-4a0f-9c83-4a2f5e14ea57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3259e0991be454dbf4e0563418ed709)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:49.686427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d2790-bd5a-4a0f-9c83-4a2f5e14ea57 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:49.738684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:49.778609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-f7605e97-772b-4b97-b288-4d4ddd9c879e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a787b1c4cf418d83d8a923b011d6ae'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:49.801591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 997/2019] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:49 2022] DELETE /identity/v3/users/a6a787b1c4cf418d83d8a923b011d6ae => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:49.802495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7605e97-772b-4b97-b288-4d4ddd9c879e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:49.803832 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f7605e97-772b-4b97-b288-4d4ddd9c879e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:49.872708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7605e97-772b-4b97-b288-4d4ddd9c879e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:49.874589 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-942d2790-bd5a-4a0f-9c83-4a2f5e14ea57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3259e0991be454dbf4e0563418ed709'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:49.878091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ad3ad-1042-490b-b487-37329a869396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:49.878928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ad3ad-1042-490b-b487-37329a869396 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:49.879123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ad3ad-1042-490b-b487-37329a869396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:49.879465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ad3ad-1042-490b-b487-37329a869396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:49.882147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ad3ad-1042-490b-b487-37329a869396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:49.884918 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ad3ad-1042-490b-b487-37329a869396 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:49.896174 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 998/2020] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:49.900569 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ad3ad-1042-490b-b487-37329a869396 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:49.911065 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ad3ad-1042-490b-b487-37329a869396 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:49.915883 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e9261-980a-44cb-939f-5ad6ebc5c27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:49.916523 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e9261-980a-44cb-939f-5ad6ebc5c27f admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:49.916800 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e9261-980a-44cb-939f-5ad6ebc5c27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:49.917071 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e9261-980a-44cb-939f-5ad6ebc5c27f admin admin] PATH_INFO: `/v3/projects/f8c39052ea044ed89cd3b3d254e2851d/users/8499173f962a48f19826f58e637bb315/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:49.919025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e9261-980a-44cb-939f-5ad6ebc5c27f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c39052ea044ed89cd3b3d254e2851d, user_id=8499173f962a48f19826f58e637bb315, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:49.922038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e9261-980a-44cb-939f-5ad6ebc5c27f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:49.932229 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 999/2021] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:49 2022] PUT /identity/v3/projects/f8c39052ea044ed89cd3b3d254e2851d/users/8499173f962a48f19826f58e637bb315/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:49.943964 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba20362-3e0a-4463-9038-c170522050de None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:49.944259 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba20362-3e0a-4463-9038-c170522050de None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:49.947184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba20362-3e0a-4463-9038-c170522050de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:49.967772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-942d2790-bd5a-4a0f-9c83-4a2f5e14ea57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3259e0991be454dbf4e0563418ed709'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:49.968456 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-942d2790-bd5a-4a0f-9c83-4a2f5e14ea57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3259e0991be454dbf4e0563418ed709'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:49.969246 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-942d2790-bd5a-4a0f-9c83-4a2f5e14ea57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3259e0991be454dbf4e0563418ed709'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:49.982625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-942d2790-bd5a-4a0f-9c83-4a2f5e14ea57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3259e0991be454dbf4e0563418ed709'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:50.007588 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1023/2022] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:49 2022] DELETE /identity/v3/users/d3259e0991be454dbf4e0563418ed709 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:50.014783 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2c861-4647-46f4-878f-44faf164d491 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:50.015229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2c861-4647-46f4-878f-44faf164d491 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:50.015575 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2c861-4647-46f4-878f-44faf164d491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:50.023354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-aba20362-3e0a-4463-9038-c170522050de None None] MFA Rules not processed for user `8499173f962a48f19826f58e637bb315`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:50.024855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-aba20362-3e0a-4463-9038-c170522050de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:50.059540 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2cc2c861-4647-46f4-878f-44faf164d491 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:50.063163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2cc2c861-4647-46f4-878f-44faf164d491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:50.133933 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1000/2023] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:50.151448 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1024/2024] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:50.171356 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba20362-3e0a-4463-9038-c170522050de None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:50.172978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-aba20362-3e0a-4463-9038-c170522050de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:50.175452 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2c861-4647-46f4-878f-44faf164d491 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:50.178716 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2cc2c861-4647-46f4-878f-44faf164d491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:50.260051 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2c861-4647-46f4-878f-44faf164d491 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:50.260424 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba20362-3e0a-4463-9038-c170522050de None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:50.265017 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca62ea5-91ee-4ecf-83cd-9975bdb9e5bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:50.265821 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca62ea5-91ee-4ecf-83cd-9975bdb9e5bf service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:50.266394 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca62ea5-91ee-4ecf-83cd-9975bdb9e5bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:50.266394 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca62ea5-91ee-4ecf-83cd-9975bdb9e5bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:50.268133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d7f8a-06e8-445a-a3ca-32bbaa3dc8a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:50.269091 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d7f8a-06e8-445a-a3ca-32bbaa3dc8a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:50.269493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d7f8a-06e8-445a-a3ca-32bbaa3dc8a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:50.269871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d7f8a-06e8-445a-a3ca-32bbaa3dc8a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:50.271710 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1c4d7f8a-06e8-445a-a3ca-32bbaa3dc8a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:50.276788 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca62ea5-91ee-4ecf-83cd-9975bdb9e5bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:50.278263 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca62ea5-91ee-4ecf-83cd-9975bdb9e5bf service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:50.289079 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1001/2025] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:50.331148 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d7f8a-06e8-445a-a3ca-32bbaa3dc8a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:50.332596 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d7f8a-06e8-445a-a3ca-32bbaa3dc8a8 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:50.341376 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1025/2026] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:50.374934 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca62ea5-91ee-4ecf-83cd-9975bdb9e5bf service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:50.376603 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9ca62ea5-91ee-4ecf-83cd-9975bdb9e5bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:50.398961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca62ea5-91ee-4ecf-83cd-9975bdb9e5bf service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:50.414036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bbff4-cd11-42ce-a6f5-af2d9a255400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:50.414738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bbff4-cd11-42ce-a6f5-af2d9a255400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:50.415178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bbff4-cd11-42ce-a6f5-af2d9a255400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:50.415513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910bbff4-cd11-42ce-a6f5-af2d9a255400 admin admin] PATH_INFO: `/v3/projects/e37f9cb00b2e4b3490b4353f601312b1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:50.418257 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910bbff4-cd11-42ce-a6f5-af2d9a255400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e37f9cb00b2e4b3490b4353f601312b1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:50.421180 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910bbff4-cd11-42ce-a6f5-af2d9a255400 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:50.564677 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-910bbff4-cd11-42ce-a6f5-af2d9a255400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e37f9cb00b2e4b3490b4353f601312b1', 'request_id': 'req-910bbff4-cd11-42ce-a6f5-af2d9a255400'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:50.571335 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-910bbff4-cd11-42ce-a6f5-af2d9a255400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e37f9cb00b2e4b3490b4353f601312b1', 'request_id': 'req-910bbff4-cd11-42ce-a6f5-af2d9a255400'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:50.673768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-910bbff4-cd11-42ce-a6f5-af2d9a255400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e37f9cb00b2e4b3490b4353f601312b1', 'request_id': 'req-910bbff4-cd11-42ce-a6f5-af2d9a255400'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:50.686480 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-910bbff4-cd11-42ce-a6f5-af2d9a255400 admin admin] The token cache is being invalidate because project e37f9cb00b2e4b3490b4353f601312b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:50.686705 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-910bbff4-cd11-42ce-a6f5-af2d9a255400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:50.687408 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-910bbff4-cd11-42ce-a6f5-af2d9a255400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:50.688980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1002/2027] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:50 2022] DELETE /identity/v3/projects/e37f9cb00b2e4b3490b4353f601312b1 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:50.694986 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821dcf3-2192-4968-bc26-ede7fb17392e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:50.695236 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821dcf3-2192-4968-bc26-ede7fb17392e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:50.695508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821dcf3-2192-4968-bc26-ede7fb17392e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:50.714919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f821dcf3-2192-4968-bc26-ede7fb17392e None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:50.716118 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f821dcf3-2192-4968-bc26-ede7fb17392e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:50.743908 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:50.750981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bbff4-cd11-42ce-a6f5-af2d9a255400 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:50.753726 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-910bbff4-cd11-42ce-a6f5-af2d9a255400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:50.807763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1026/2028] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:50.809392 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301440be-ba21-4f2f-b467-7dc776a75f98 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:50.809853 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301440be-ba21-4f2f-b467-7dc776a75f98 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:50.811269 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301440be-ba21-4f2f-b467-7dc776a75f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:50.831362 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-301440be-ba21-4f2f-b467-7dc776a75f98 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:50.832698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-301440be-ba21-4f2f-b467-7dc776a75f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:50.843735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910bbff4-cd11-42ce-a6f5-af2d9a255400 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:50.845442 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1027/2029] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:50.846940 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301440be-ba21-4f2f-b467-7dc776a75f98 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:50.849232 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00321cfd-d860-49a8-8de4-32297ca7cbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:50.850251 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00321cfd-d860-49a8-8de4-32297ca7cbac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:50.855238 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00321cfd-d860-49a8-8de4-32297ca7cbac admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:50.855238 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00321cfd-d860-49a8-8de4-32297ca7cbac admin admin] PATH_INFO: `/v3/projects/3b88f1622ec04aaebb0980e575e4ec2e` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:50.855238 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00321cfd-d860-49a8-8de4-32297ca7cbac admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b88f1622ec04aaebb0980e575e4ec2e)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:50.855238 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00321cfd-d860-49a8-8de4-32297ca7cbac admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:50.856757 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301440be-ba21-4f2f-b467-7dc776a75f98 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:50.861535 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed08e69-0706-48b2-9d28-af6ae3e73ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:50.862431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed08e69-0706-48b2-9d28-af6ae3e73ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:50.862717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed08e69-0706-48b2-9d28-af6ae3e73ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:50.862992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed08e69-0706-48b2-9d28-af6ae3e73ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:50.863647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed08e69-0706-48b2-9d28-af6ae3e73ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:18:50.863952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed08e69-0706-48b2-9d28-af6ae3e73ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:50.865847 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed08e69-0706-48b2-9d28-af6ae3e73ea2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:50.877883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1028/2030] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:18:50.882266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed08e69-0706-48b2-9d28-af6ae3e73ea2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:50.888709 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:50.894137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed08e69-0706-48b2-9d28-af6ae3e73ea2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:50.898882 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe2f76-804f-4617-adf2-90fb639a5161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:50.899463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe2f76-804f-4617-adf2-90fb639a5161 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:50.899750 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe2f76-804f-4617-adf2-90fb639a5161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:50.900023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe2f76-804f-4617-adf2-90fb639a5161 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:50.900641 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe2f76-804f-4617-adf2-90fb639a5161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:50.902614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe2f76-804f-4617-adf2-90fb639a5161 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:50.949864 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-00321cfd-d860-49a8-8de4-32297ca7cbac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b88f1622ec04aaebb0980e575e4ec2e', 'request_id': 'req-00321cfd-d860-49a8-8de4-32297ca7cbac'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:50.955341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-00321cfd-d860-49a8-8de4-32297ca7cbac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b88f1622ec04aaebb0980e575e4ec2e', 'request_id': 'req-00321cfd-d860-49a8-8de4-32297ca7cbac'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:51.008067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1029/2031] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:50 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:18:51.012277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe2f76-804f-4617-adf2-90fb639a5161 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:51.025190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-00321cfd-d860-49a8-8de4-32297ca7cbac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b88f1622ec04aaebb0980e575e4ec2e', 'request_id': 'req-00321cfd-d860-49a8-8de4-32297ca7cbac'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:51.039666 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-00321cfd-d860-49a8-8de4-32297ca7cbac admin admin] The token cache is being invalidate because project 3b88f1622ec04aaebb0980e575e4ec2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:51.039996 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-00321cfd-d860-49a8-8de4-32297ca7cbac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:51.040707 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-00321cfd-d860-49a8-8de4-32297ca7cbac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:51.042339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1003/2032] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:50 2022] DELETE /identity/v3/projects/3b88f1622ec04aaebb0980e575e4ec2e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:51.046195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00321cfd-d860-49a8-8de4-32297ca7cbac admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:51.048472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-00321cfd-d860-49a8-8de4-32297ca7cbac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:51.085427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe2f76-804f-4617-adf2-90fb639a5161 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:51.090381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bcd62-fb2f-4ccf-8665-d04f57bcd568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:51.090990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bcd62-fb2f-4ccf-8665-d04f57bcd568 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:51.091388 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bcd62-fb2f-4ccf-8665-d04f57bcd568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:51.091664 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bcd62-fb2f-4ccf-8665-d04f57bcd568 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:51.092314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bcd62-fb2f-4ccf-8665-d04f57bcd568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:51.094414 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bcd62-fb2f-4ccf-8665-d04f57bcd568 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:51.117030 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00321cfd-d860-49a8-8de4-32297ca7cbac admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:51.121725 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d9753-5347-40ab-a11c-7e4994bdc83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:51.122361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d9753-5347-40ab-a11c-7e4994bdc83e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:51.122641 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d9753-5347-40ab-a11c-7e4994bdc83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:51.122917 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d9753-5347-40ab-a11c-7e4994bdc83e admin admin] PATH_INFO: `/v3/users/55f98ee8dc8a42bfb5474e975ec4885a` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:51.124061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d9753-5347-40ab-a11c-7e4994bdc83e admin admin] RBAC: Authorizing `identity:delete_user(user_id=55f98ee8dc8a42bfb5474e975ec4885a)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:51.126026 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d9753-5347-40ab-a11c-7e4994bdc83e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:51.184604 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1030/2033] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:51 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:51.188763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bcd62-fb2f-4ccf-8665-d04f57bcd568 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:51.191204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a66bcd62-fb2f-4ccf-8665-d04f57bcd568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:51.204160 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bcd62-fb2f-4ccf-8665-d04f57bcd568 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:51.209166 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e0ad1-9423-4d09-ad1e-60264960c72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:51.209806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e0ad1-9423-4d09-ad1e-60264960c72c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:51.210084 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e0ad1-9423-4d09-ad1e-60264960c72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:51.210352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e0ad1-9423-4d09-ad1e-60264960c72c admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:51.210994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e0ad1-9423-4d09-ad1e-60264960c72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:51.212930 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e0ad1-9423-4d09-ad1e-60264960c72c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:51.223463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1031/2034] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:18:51.231639 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e0ad1-9423-4d09-ad1e-60264960c72c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:51.243237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e0ad1-9423-4d09-ad1e-60264960c72c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:51.253681 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59a6b7-8b7d-4a1f-98b4-3913bff800e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:51.253681 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59a6b7-8b7d-4a1f-98b4-3913bff800e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:51.253681 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59a6b7-8b7d-4a1f-98b4-3913bff800e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:51.253681 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59a6b7-8b7d-4a1f-98b4-3913bff800e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:51.254184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59a6b7-8b7d-4a1f-98b4-3913bff800e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:51.255827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59a6b7-8b7d-4a1f-98b4-3913bff800e8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:51.271206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1032/2035] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:18:51.272264 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59a6b7-8b7d-4a1f-98b4-3913bff800e8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:51.284185 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59a6b7-8b7d-4a1f-98b4-3913bff800e8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:51.290332 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6b07c-a0d1-4fe3-8d72-8ce64c00388b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:51.291585 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6b07c-a0d1-4fe3-8d72-8ce64c00388b admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:51.291878 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6b07c-a0d1-4fe3-8d72-8ce64c00388b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:51.292150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6b07c-a0d1-4fe3-8d72-8ce64c00388b admin admin] PATH_INFO: `/v3/projects/92ff8ceeebf84b30bfc49d9baf983cd7/users/69c2955c84084f4a92f1d7c867f00497/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:51.309322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6b07c-a0d1-4fe3-8d72-8ce64c00388b admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ff8ceeebf84b30bfc49d9baf983cd7, user_id=69c2955c84084f4a92f1d7c867f00497, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:51.312055 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6b07c-a0d1-4fe3-8d72-8ce64c00388b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:51.403403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-257d9753-5347-40ab-a11c-7e4994bdc83e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55f98ee8dc8a42bfb5474e975ec4885a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:51.411582 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-257d9753-5347-40ab-a11c-7e4994bdc83e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55f98ee8dc8a42bfb5474e975ec4885a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:51.412337 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-257d9753-5347-40ab-a11c-7e4994bdc83e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55f98ee8dc8a42bfb5474e975ec4885a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:51.412940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-257d9753-5347-40ab-a11c-7e4994bdc83e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55f98ee8dc8a42bfb5474e975ec4885a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:51.440186 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1033/2036] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:51 2022] PUT /identity/v3/projects/92ff8ceeebf84b30bfc49d9baf983cd7/users/69c2955c84084f4a92f1d7c867f00497/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:51.450469 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b920f7-9530-4220-aefe-e828987adc33 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:51.450786 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b920f7-9530-4220-aefe-e828987adc33 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:51.451057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b920f7-9530-4220-aefe-e828987adc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:51.479355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-84b920f7-9530-4220-aefe-e828987adc33 None None] MFA Rules not processed for user `69c2955c84084f4a92f1d7c867f00497`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:51.480578 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-84b920f7-9530-4220-aefe-e828987adc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:51.521754 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-257d9753-5347-40ab-a11c-7e4994bdc83e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55f98ee8dc8a42bfb5474e975ec4885a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:51.541818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1004/2037] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:51 2022] DELETE /identity/v3/users/55f98ee8dc8a42bfb5474e975ec4885a => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:51.550357 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1034/2038] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:51.555249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d9753-5347-40ab-a11c-7e4994bdc83e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:51.556703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-257d9753-5347-40ab-a11c-7e4994bdc83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:51.616920 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:51.622056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d9753-5347-40ab-a11c-7e4994bdc83e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:51.626647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3137cd-9566-46c6-92c2-81fed7e40cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:51.627902 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3137cd-9566-46c6-92c2-81fed7e40cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:51.628185 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3137cd-9566-46c6-92c2-81fed7e40cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:51.628549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3137cd-9566-46c6-92c2-81fed7e40cd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:51.629181 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3137cd-9566-46c6-92c2-81fed7e40cd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:51.631148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3137cd-9566-46c6-92c2-81fed7e40cd8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:51.748939 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1005/2039] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:51 2022] POST /identity/v3/projects => generated 375 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:51.750345 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b920f7-9530-4220-aefe-e828987adc33 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:51.818629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b920f7-9530-4220-aefe-e828987adc33 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:51.831375 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:51.875347 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a416be-c2e6-4f1e-9e08-941743590972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:51.875962 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a416be-c2e6-4f1e-9e08-941743590972 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:51.876238 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a416be-c2e6-4f1e-9e08-941743590972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:51.876575 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a416be-c2e6-4f1e-9e08-941743590972 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:51.877381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a416be-c2e6-4f1e-9e08-941743590972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:51.879441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a416be-c2e6-4f1e-9e08-941743590972 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:51.988074 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1035/2040] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:51 2022] POST /identity/v3/users => generated 294 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:51.989944 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3137cd-9566-46c6-92c2-81fed7e40cd8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:51.990424 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a416be-c2e6-4f1e-9e08-941743590972 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:51.992731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c9a416be-c2e6-4f1e-9e08-941743590972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:52.007297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3137cd-9566-46c6-92c2-81fed7e40cd8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:52.011736 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a416be-c2e6-4f1e-9e08-941743590972 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:52.013855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf5c07-d2fa-433a-b849-27aa6ddf9ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:52.014605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf5c07-d2fa-433a-b849-27aa6ddf9ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:52.014990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf5c07-d2fa-433a-b849-27aa6ddf9ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:52.015416 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf5c07-d2fa-433a-b849-27aa6ddf9ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:52.016174 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf5c07-d2fa-433a-b849-27aa6ddf9ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:52.018680 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf5c07-d2fa-433a-b849-27aa6ddf9ca3 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:52.031890 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6cb5a-0256-4c45-80db-b8fc7b62ce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:52.033179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6cb5a-0256-4c45-80db-b8fc7b62ce0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:52.034880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6cb5a-0256-4c45-80db-b8fc7b62ce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:52.035565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6cb5a-0256-4c45-80db-b8fc7b62ce0e admin admin] PATH_INFO: `/v3/projects/1f2cbfb3535b46f183f4a5b2f19d1c77` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:52.038297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1006/2041] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:52.038563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6cb5a-0256-4c45-80db-b8fc7b62ce0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f2cbfb3535b46f183f4a5b2f19d1c77)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:52.039437 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf5c07-d2fa-433a-b849-27aa6ddf9ca3 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:52.040569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6cb5a-0256-4c45-80db-b8fc7b62ce0e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:52.053181 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf5c07-d2fa-433a-b849-27aa6ddf9ca3 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:52.058306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cd61f-5c9a-48ff-b399-2030105ede28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:52.058969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cd61f-5c9a-48ff-b399-2030105ede28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:52.059248 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cd61f-5c9a-48ff-b399-2030105ede28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:52.059590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cd61f-5c9a-48ff-b399-2030105ede28 admin admin] PATH_INFO: `/v3/projects/239862323f2b4a5cb2bf4d835a36e0a6/users/8bc7df3c42954b488705121ef46211a8/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:52.074981 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cd61f-5c9a-48ff-b399-2030105ede28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=239862323f2b4a5cb2bf4d835a36e0a6, user_id=8bc7df3c42954b488705121ef46211a8, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:52.077700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cd61f-5c9a-48ff-b399-2030105ede28 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:52.187591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1007/2042] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:52 2022] PUT /identity/v3/projects/239862323f2b4a5cb2bf4d835a36e0a6/users/8bc7df3c42954b488705121ef46211a8/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:52.190390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cd61f-5c9a-48ff-b399-2030105ede28 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:52.190994 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-373cd61f-5c9a-48ff-b399-2030105ede28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:52.200398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-62f6cb5a-0256-4c45-80db-b8fc7b62ce0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f2cbfb3535b46f183f4a5b2f19d1c77', 'request_id': 'req-62f6cb5a-0256-4c45-80db-b8fc7b62ce0e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:52.208121 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-62f6cb5a-0256-4c45-80db-b8fc7b62ce0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f2cbfb3535b46f183f4a5b2f19d1c77', 'request_id': 'req-62f6cb5a-0256-4c45-80db-b8fc7b62ce0e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:52.259687 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cd61f-5c9a-48ff-b399-2030105ede28 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:52.317062 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052450d9-d450-4470-9d8d-75e06070b62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:52.317659 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052450d9-d450-4470-9d8d-75e06070b62e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:52.317966 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052450d9-d450-4470-9d8d-75e06070b62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:52.318239 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052450d9-d450-4470-9d8d-75e06070b62e admin admin] PATH_INFO: `/v3/users/8f95ed840f6947e1933e0c135885d1a0` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:52.319364 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052450d9-d450-4470-9d8d-75e06070b62e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f95ed840f6947e1933e0c135885d1a0)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:52.321285 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052450d9-d450-4470-9d8d-75e06070b62e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:52.327524 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-62f6cb5a-0256-4c45-80db-b8fc7b62ce0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f2cbfb3535b46f183f4a5b2f19d1c77', 'request_id': 'req-62f6cb5a-0256-4c45-80db-b8fc7b62ce0e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:52.340290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-62f6cb5a-0256-4c45-80db-b8fc7b62ce0e admin admin] The token cache is being invalidate because project 1f2cbfb3535b46f183f4a5b2f19d1c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:52.340583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-62f6cb5a-0256-4c45-80db-b8fc7b62ce0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:52.341240 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-62f6cb5a-0256-4c45-80db-b8fc7b62ce0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:52.342819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1036/2043] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:51 2022] DELETE /identity/v3/projects/1f2cbfb3535b46f183f4a5b2f19d1c77 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:52.343581 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6cb5a-0256-4c45-80db-b8fc7b62ce0e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:52.344909 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-62f6cb5a-0256-4c45-80db-b8fc7b62ce0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:52.358409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6cb5a-0256-4c45-80db-b8fc7b62ce0e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:52.363923 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02e919-e0e9-4cd4-a066-5bbb8bd6a374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:52.364520 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02e919-e0e9-4cd4-a066-5bbb8bd6a374 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:52.364798 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02e919-e0e9-4cd4-a066-5bbb8bd6a374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:52.365069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02e919-e0e9-4cd4-a066-5bbb8bd6a374 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:52.365772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02e919-e0e9-4cd4-a066-5bbb8bd6a374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:52.367395 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02e919-e0e9-4cd4-a066-5bbb8bd6a374 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:52.377574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1037/2044] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:52.384075 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:52.384218 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a722ad-39f9-48a8-9a48-79428b882e0f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:52.384218 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a722ad-39f9-48a8-9a48-79428b882e0f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:52.384218 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a722ad-39f9-48a8-9a48-79428b882e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:52.399633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c6a722ad-39f9-48a8-9a48-79428b882e0f None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:52.401064 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c6a722ad-39f9-48a8-9a48-79428b882e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:52.409664 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1038/2045] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:52.410409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a722ad-39f9-48a8-9a48-79428b882e0f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:52.419396 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a722ad-39f9-48a8-9a48-79428b882e0f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:52.423906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce073643-c41d-4a9e-8f8a-25b7b346c010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:52.424814 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce073643-c41d-4a9e-8f8a-25b7b346c010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:52.425182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce073643-c41d-4a9e-8f8a-25b7b346c010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:52.425481 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce073643-c41d-4a9e-8f8a-25b7b346c010 admin admin] PATH_INFO: `/v3/projects/239862323f2b4a5cb2bf4d835a36e0a6/users/8bc7df3c42954b488705121ef46211a8/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:52.427355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce073643-c41d-4a9e-8f8a-25b7b346c010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=239862323f2b4a5cb2bf4d835a36e0a6, user_id=8bc7df3c42954b488705121ef46211a8, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:52.430044 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce073643-c41d-4a9e-8f8a-25b7b346c010 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:52.440564 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1039/2046] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:52 2022] PUT /identity/v3/projects/239862323f2b4a5cb2bf4d835a36e0a6/users/8bc7df3c42954b488705121ef46211a8/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:52.441771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ef733-cb91-4244-8ffb-0189b68ed548 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:52.442156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ef733-cb91-4244-8ffb-0189b68ed548 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:52.442460 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ef733-cb91-4244-8ffb-0189b68ed548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:52.463209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-852ef733-cb91-4244-8ffb-0189b68ed548 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:52.464411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-852ef733-cb91-4244-8ffb-0189b68ed548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:52.476547 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:52.528115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1040/2047] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:52.529631 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190dfd0-8057-44cf-9a5e-616425f0d75d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:52.529903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190dfd0-8057-44cf-9a5e-616425f0d75d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:52.530248 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190dfd0-8057-44cf-9a5e-616425f0d75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:52.560180 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5190dfd0-8057-44cf-9a5e-616425f0d75d None None] MFA Rules not processed for user `8bc7df3c42954b488705121ef46211a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:52.561396 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5190dfd0-8057-44cf-9a5e-616425f0d75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:52.587395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-052450d9-d450-4470-9d8d-75e06070b62e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f95ed840f6947e1933e0c135885d1a0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:52.594530 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-052450d9-d450-4470-9d8d-75e06070b62e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f95ed840f6947e1933e0c135885d1a0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:52.595239 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-052450d9-d450-4470-9d8d-75e06070b62e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f95ed840f6947e1933e0c135885d1a0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:52.595854 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-052450d9-d450-4470-9d8d-75e06070b62e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f95ed840f6947e1933e0c135885d1a0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:52.634078 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1041/2048] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:52.634993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190dfd0-8057-44cf-9a5e-616425f0d75d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:52.636257 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5190dfd0-8057-44cf-9a5e-616425f0d75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:52.650025 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190dfd0-8057-44cf-9a5e-616425f0d75d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:52.654549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec056afd-8e63-4a54-a56f-e26e7c3d1295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:52.655335 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec056afd-8e63-4a54-a56f-e26e7c3d1295 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:52.655510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec056afd-8e63-4a54-a56f-e26e7c3d1295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:52.655786 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec056afd-8e63-4a54-a56f-e26e7c3d1295 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:52.656463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec056afd-8e63-4a54-a56f-e26e7c3d1295 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:18:52.656766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec056afd-8e63-4a54-a56f-e26e7c3d1295 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:52.658399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec056afd-8e63-4a54-a56f-e26e7c3d1295 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:52.673143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1042/2049] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:18:52.674161 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec056afd-8e63-4a54-a56f-e26e7c3d1295 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:52.676038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ec056afd-8e63-4a54-a56f-e26e7c3d1295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:52.685241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-052450d9-d450-4470-9d8d-75e06070b62e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f95ed840f6947e1933e0c135885d1a0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:52.703157 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1008/2050] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:52 2022] DELETE /identity/v3/users/8f95ed840f6947e1933e0c135885d1a0 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:52.703953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052450d9-d450-4470-9d8d-75e06070b62e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:52.735037 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec056afd-8e63-4a54-a56f-e26e7c3d1295 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:52.768595 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052450d9-d450-4470-9d8d-75e06070b62e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:52.773321 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ccd29-1a62-462c-9e71-a58c13c4a065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:52.774045 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ccd29-1a62-462c-9e71-a58c13c4a065 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:52.774351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ccd29-1a62-462c-9e71-a58c13c4a065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:52.774644 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ccd29-1a62-462c-9e71-a58c13c4a065 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:52.775311 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ccd29-1a62-462c-9e71-a58c13c4a065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:52.777194 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ccd29-1a62-462c-9e71-a58c13c4a065 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:52.784824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831d56e-fb07-40a3-839a-7408a4bc4ce0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:52.785373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831d56e-fb07-40a3-839a-7408a4bc4ce0 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:52.785682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831d56e-fb07-40a3-839a-7408a4bc4ce0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:52.785954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831d56e-fb07-40a3-839a-7408a4bc4ce0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:52.787778 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d831d56e-fb07-40a3-839a-7408a4bc4ce0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:52.848825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831d56e-fb07-40a3-839a-7408a4bc4ce0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:52.850546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831d56e-fb07-40a3-839a-7408a4bc4ce0 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:52.859265 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1043/2051] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:52.860603 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e677aa-5b41-402c-9ff9-9ab2975cfdb0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:52.860910 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e677aa-5b41-402c-9ff9-9ab2975cfdb0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:52.861171 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e677aa-5b41-402c-9ff9-9ab2975cfdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:52.871080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1009/2052] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:52 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:52.872016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ccd29-1a62-462c-9e71-a58c13c4a065 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:52.881953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-29e677aa-5b41-402c-9ff9-9ab2975cfdb0 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:52.883166 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-29e677aa-5b41-402c-9ff9-9ab2975cfdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:52.947544 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1044/2053] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:52.957916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e677aa-5b41-402c-9ff9-9ab2975cfdb0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:52.959446 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-29e677aa-5b41-402c-9ff9-9ab2975cfdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:52.960389 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ccd29-1a62-462c-9e71-a58c13c4a065 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:52.965396 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04e54e-d11e-4902-8547-bf36fc8dc103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:52.969079 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04e54e-d11e-4902-8547-bf36fc8dc103 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:52.969079 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04e54e-d11e-4902-8547-bf36fc8dc103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:52.969079 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04e54e-d11e-4902-8547-bf36fc8dc103 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:52.969079 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04e54e-d11e-4902-8547-bf36fc8dc103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:52.969626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04e54e-d11e-4902-8547-bf36fc8dc103 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:53.025150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e677aa-5b41-402c-9ff9-9ab2975cfdb0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:53.028834 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597b5d0-077e-4ac6-84e2-d1bf922ace4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:53.029433 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597b5d0-077e-4ac6-84e2-d1bf922ace4b service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:53.030086 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597b5d0-077e-4ac6-84e2-d1bf922ace4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:53.030359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597b5d0-077e-4ac6-84e2-d1bf922ace4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:53.040028 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597b5d0-077e-4ac6-84e2-d1bf922ace4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:53.041492 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597b5d0-077e-4ac6-84e2-d1bf922ace4b service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:53.055340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1045/2054] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:18:53.079074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:53.087314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1010/2055] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:52 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:53.092138 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597b5d0-077e-4ac6-84e2-d1bf922ace4b service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:53.103152 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597b5d0-077e-4ac6-84e2-d1bf922ace4b service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:53.108813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2864ae-84d8-411a-babc-69db31a35996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:53.109446 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2864ae-84d8-411a-babc-69db31a35996 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:53.110067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2864ae-84d8-411a-babc-69db31a35996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:53.110067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2864ae-84d8-411a-babc-69db31a35996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:53.110705 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2864ae-84d8-411a-babc-69db31a35996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:53.112529 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2864ae-84d8-411a-babc-69db31a35996 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:53.125497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1046/2056] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:53.129978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04e54e-d11e-4902-8547-bf36fc8dc103 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:53.144427 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04e54e-d11e-4902-8547-bf36fc8dc103 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:53.151240 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5b777-1342-4d6a-9736-880c3479f273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:53.152151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5b777-1342-4d6a-9736-880c3479f273 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:53.153118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5b777-1342-4d6a-9736-880c3479f273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:53.153586 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5b777-1342-4d6a-9736-880c3479f273 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:53.154406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5b777-1342-4d6a-9736-880c3479f273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:53.156881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5b777-1342-4d6a-9736-880c3479f273 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:53.170740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1011/2057] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:18:53.175766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2864ae-84d8-411a-babc-69db31a35996 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:53.188678 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2864ae-84d8-411a-babc-69db31a35996 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:53.194020 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97640d3-ef68-4ff7-b895-b155f6115307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:53.194695 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97640d3-ef68-4ff7-b895-b155f6115307 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:53.194977 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97640d3-ef68-4ff7-b895-b155f6115307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:53.195245 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97640d3-ef68-4ff7-b895-b155f6115307 admin admin] PATH_INFO: `/v3/projects/ce5d9936076d4e83ae5db7fe9a0d909b/users/b13695af76fe4746890bb74b3012d009/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:53.212374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97640d3-ef68-4ff7-b895-b155f6115307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5d9936076d4e83ae5db7fe9a0d909b, user_id=b13695af76fe4746890bb74b3012d009, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:53.215089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97640d3-ef68-4ff7-b895-b155f6115307 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:53.329863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1047/2058] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:53 2022] PUT /identity/v3/projects/ce5d9936076d4e83ae5db7fe9a0d909b/users/b13695af76fe4746890bb74b3012d009/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:53.335700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34064e7e-e215-4adb-a712-a320613d6355 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:53.335991 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34064e7e-e215-4adb-a712-a320613d6355 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:53.336599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34064e7e-e215-4adb-a712-a320613d6355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:53.356531 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-34064e7e-e215-4adb-a712-a320613d6355 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:53.357818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-34064e7e-e215-4adb-a712-a320613d6355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:53.425613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1012/2059] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:53.432993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97640d3-ef68-4ff7-b895-b155f6115307 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:53.488639 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97640d3-ef68-4ff7-b895-b155f6115307 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:53.492501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469c9ce-ad1a-47bb-92da-3af85ddabe7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:53.493097 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469c9ce-ad1a-47bb-92da-3af85ddabe7f service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:53.493377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469c9ce-ad1a-47bb-92da-3af85ddabe7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:53.493684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469c9ce-ad1a-47bb-92da-3af85ddabe7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:53.508036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34064e7e-e215-4adb-a712-a320613d6355 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:53.511736 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-34064e7e-e215-4adb-a712-a320613d6355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:53.525529 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469c9ce-ad1a-47bb-92da-3af85ddabe7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:53.525529 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469c9ce-ad1a-47bb-92da-3af85ddabe7f service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:53.533053 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34064e7e-e215-4adb-a712-a320613d6355 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:53.539383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:53.547744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1048/2060] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:53.569780 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab59d4-2955-4bc9-9de0-a482dd155c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:53.570450 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab59d4-2955-4bc9-9de0-a482dd155c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:53.570737 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab59d4-2955-4bc9-9de0-a482dd155c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:53.571013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab59d4-2955-4bc9-9de0-a482dd155c29 admin admin] PATH_INFO: `/v3/projects/00dc8cc5de9343559eaada5159ff65e8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:53.591233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab59d4-2955-4bc9-9de0-a482dd155c29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00dc8cc5de9343559eaada5159ff65e8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:53.594751 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab59d4-2955-4bc9-9de0-a482dd155c29 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:53.727866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:53.774486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d4ab59d4-2955-4bc9-9de0-a482dd155c29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00dc8cc5de9343559eaada5159ff65e8', 'request_id': 'req-d4ab59d4-2955-4bc9-9de0-a482dd155c29'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:53.794659 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d4ab59d4-2955-4bc9-9de0-a482dd155c29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00dc8cc5de9343559eaada5159ff65e8', 'request_id': 'req-d4ab59d4-2955-4bc9-9de0-a482dd155c29'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:53.922142 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469c9ce-ad1a-47bb-92da-3af85ddabe7f service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:53.946497 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d4ab59d4-2955-4bc9-9de0-a482dd155c29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00dc8cc5de9343559eaada5159ff65e8', 'request_id': 'req-d4ab59d4-2955-4bc9-9de0-a482dd155c29'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:53.965047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d4ab59d4-2955-4bc9-9de0-a482dd155c29 admin admin] The token cache is being invalidate because project 00dc8cc5de9343559eaada5159ff65e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:53.965345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d4ab59d4-2955-4bc9-9de0-a482dd155c29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:53.966529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-d4ab59d4-2955-4bc9-9de0-a482dd155c29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:53.968677 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1013/2061] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:53 2022] DELETE /identity/v3/projects/00dc8cc5de9343559eaada5159ff65e8 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:53.973986 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab59d4-2955-4bc9-9de0-a482dd155c29 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:53.975694 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d4ab59d4-2955-4bc9-9de0-a482dd155c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:53.995775 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469c9ce-ad1a-47bb-92da-3af85ddabe7f service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:54.049888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b38a84-ca09-45b4-84e4-f8c0dec9b3a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:54.050399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b38a84-ca09-45b4-84e4-f8c0dec9b3a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:54.050681 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b38a84-ca09-45b4-84e4-f8c0dec9b3a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:54.050953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b38a84-ca09-45b4-84e4-f8c0dec9b3a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:54.052255 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab59d4-2955-4bc9-9de0-a482dd155c29 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:54.052749 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-88b38a84-ca09-45b4-84e4-f8c0dec9b3a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:54.057035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae6ec3-7ac3-4d53-a2fe-22f965f57f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:54.057760 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae6ec3-7ac3-4d53-a2fe-22f965f57f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:54.058224 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae6ec3-7ac3-4d53-a2fe-22f965f57f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:54.058504 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae6ec3-7ac3-4d53-a2fe-22f965f57f42 admin admin] PATH_INFO: `/v3/users/92e50a43b8004e97906d34b719c4963a` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:54.063832 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae6ec3-7ac3-4d53-a2fe-22f965f57f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92e50a43b8004e97906d34b719c4963a)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:54.063832 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae6ec3-7ac3-4d53-a2fe-22f965f57f42 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:54.123721 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b38a84-ca09-45b4-84e4-f8c0dec9b3a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:54.125164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b38a84-ca09-45b4-84e4-f8c0dec9b3a1 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:54.135510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1049/2062] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:54.137323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:54.285805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0eae6ec3-7ac3-4d53-a2fe-22f965f57f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92e50a43b8004e97906d34b719c4963a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:54.292958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0eae6ec3-7ac3-4d53-a2fe-22f965f57f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92e50a43b8004e97906d34b719c4963a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:54.293754 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0eae6ec3-7ac3-4d53-a2fe-22f965f57f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92e50a43b8004e97906d34b719c4963a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:54.294416 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0eae6ec3-7ac3-4d53-a2fe-22f965f57f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92e50a43b8004e97906d34b719c4963a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:54.452155 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0eae6ec3-7ac3-4d53-a2fe-22f965f57f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92e50a43b8004e97906d34b719c4963a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:54.472405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1014/2063] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:53 2022] DELETE /identity/v3/users/92e50a43b8004e97906d34b719c4963a => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:54.654348 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:54.792011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:54.964875 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92fa6a-429e-4f7a-88c8-e23d5f1cc29f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:54.965241 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92fa6a-429e-4f7a-88c8-e23d5f1cc29f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:54.965730 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92fa6a-429e-4f7a-88c8-e23d5f1cc29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:54.991234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae6ec3-7ac3-4d53-a2fe-22f965f57f42 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:54.993528 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0eae6ec3-7ac3-4d53-a2fe-22f965f57f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:55.010329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-df92fa6a-429e-4f7a-88c8-e23d5f1cc29f None None] MFA Rules not processed for user `b13695af76fe4746890bb74b3012d009`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:55.012024 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-df92fa6a-429e-4f7a-88c8-e23d5f1cc29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:55.073599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae6ec3-7ac3-4d53-a2fe-22f965f57f42 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:55.080210 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f9917-bf6e-455b-8018-82b4fde2676f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:55.081063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f9917-bf6e-455b-8018-82b4fde2676f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:55.081590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f9917-bf6e-455b-8018-82b4fde2676f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:55.082183 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f9917-bf6e-455b-8018-82b4fde2676f admin admin] PATH_INFO: `/v3/projects/3974cc39446f47c38f5a181fc6b0b61d` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:55.086684 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f9917-bf6e-455b-8018-82b4fde2676f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3974cc39446f47c38f5a181fc6b0b61d)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:55.086684 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f9917-bf6e-455b-8018-82b4fde2676f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:55.154164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1050/2064] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:55.158462 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92fa6a-429e-4f7a-88c8-e23d5f1cc29f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:55.159815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-df92fa6a-429e-4f7a-88c8-e23d5f1cc29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:55.172658 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92fa6a-429e-4f7a-88c8-e23d5f1cc29f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:55.177242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdd0d8-3570-41d2-8ec4-37a8ade987ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:55.177868 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdd0d8-3570-41d2-8ec4-37a8ade987ee admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:55.178230 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdd0d8-3570-41d2-8ec4-37a8ade987ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:55.178418 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdd0d8-3570-41d2-8ec4-37a8ade987ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:55.179056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdd0d8-3570-41d2-8ec4-37a8ade987ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:55.180994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdd0d8-3570-41d2-8ec4-37a8ade987ee admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:55.209930 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-767f9917-bf6e-455b-8018-82b4fde2676f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3974cc39446f47c38f5a181fc6b0b61d', 'request_id': 'req-767f9917-bf6e-455b-8018-82b4fde2676f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:55.215901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-767f9917-bf6e-455b-8018-82b4fde2676f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3974cc39446f47c38f5a181fc6b0b61d', 'request_id': 'req-767f9917-bf6e-455b-8018-82b4fde2676f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:55.282765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-767f9917-bf6e-455b-8018-82b4fde2676f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3974cc39446f47c38f5a181fc6b0b61d', 'request_id': 'req-767f9917-bf6e-455b-8018-82b4fde2676f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:55.292515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1051/2065] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:55 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:18:55.295661 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdd0d8-3570-41d2-8ec4-37a8ade987ee admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:55.297677 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-767f9917-bf6e-455b-8018-82b4fde2676f admin admin] The token cache is being invalidate because project 3974cc39446f47c38f5a181fc6b0b61d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:55.298075 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-767f9917-bf6e-455b-8018-82b4fde2676f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:55.298925 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-767f9917-bf6e-455b-8018-82b4fde2676f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:55.300911 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1015/2066] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:54 2022] DELETE /identity/v3/projects/3974cc39446f47c38f5a181fc6b0b61d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:55.304862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f9917-bf6e-455b-8018-82b4fde2676f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:55.306439 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-767f9917-bf6e-455b-8018-82b4fde2676f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:55.365739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdd0d8-3570-41d2-8ec4-37a8ade987ee admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:55.371120 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5486a-1817-4a7a-be8f-dd1a07b1b671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:55.371914 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5486a-1817-4a7a-be8f-dd1a07b1b671 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:55.372347 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5486a-1817-4a7a-be8f-dd1a07b1b671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:55.372812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5486a-1817-4a7a-be8f-dd1a07b1b671 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:55.373467 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5486a-1817-4a7a-be8f-dd1a07b1b671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:55.374347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f9917-bf6e-455b-8018-82b4fde2676f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:55.375413 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5486a-1817-4a7a-be8f-dd1a07b1b671 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:55.383495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1a708-b7aa-464c-b1bb-dddf8e7c4801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:55.384593 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1a708-b7aa-464c-b1bb-dddf8e7c4801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:55.385656 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1a708-b7aa-464c-b1bb-dddf8e7c4801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:55.386432 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1a708-b7aa-464c-b1bb-dddf8e7c4801 admin admin] PATH_INFO: `/v3/users/ddcf502182ac4534b93f053a5e1c540d` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:55.388675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1a708-b7aa-464c-b1bb-dddf8e7c4801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddcf502182ac4534b93f053a5e1c540d)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:55.391123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1a708-b7aa-464c-b1bb-dddf8e7c4801 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:55.510116 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1052/2067] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:55 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:55.513880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5486a-1817-4a7a-be8f-dd1a07b1b671 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:55.515526 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c8f5486a-1817-4a7a-be8f-dd1a07b1b671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:55.527649 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5486a-1817-4a7a-be8f-dd1a07b1b671 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:55.532327 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acc6f7-19b2-4cb0-9a97-a49972ca7ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:55.532916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acc6f7-19b2-4cb0-9a97-a49972ca7ecf admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:55.533194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acc6f7-19b2-4cb0-9a97-a49972ca7ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:55.533483 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acc6f7-19b2-4cb0-9a97-a49972ca7ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:55.534120 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acc6f7-19b2-4cb0-9a97-a49972ca7ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:55.536140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acc6f7-19b2-4cb0-9a97-a49972ca7ecf admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:55.547603 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1053/2068] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:18:55.553192 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acc6f7-19b2-4cb0-9a97-a49972ca7ecf admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:55.562807 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acc6f7-19b2-4cb0-9a97-a49972ca7ecf admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:55.568295 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8503fe-24b2-4444-854f-f845583fdfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:55.568935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8503fe-24b2-4444-854f-f845583fdfa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:55.569211 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8503fe-24b2-4444-854f-f845583fdfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:55.570373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8503fe-24b2-4444-854f-f845583fdfa3 admin admin] PATH_INFO: `/v3/projects/6b1719f9295d4679bc7f232a994073fa/users/028bb53b9ec34ab38bf146dcbdd2b101/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:55.583752 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8503fe-24b2-4444-854f-f845583fdfa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1719f9295d4679bc7f232a994073fa, user_id=028bb53b9ec34ab38bf146dcbdd2b101, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:55.586537 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8503fe-24b2-4444-854f-f845583fdfa3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:55.660863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1054/2069] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:55 2022] PUT /identity/v3/projects/6b1719f9295d4679bc7f232a994073fa/users/028bb53b9ec34ab38bf146dcbdd2b101/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:55.662519 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-71a1a708-b7aa-464c-b1bb-dddf8e7c4801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddcf502182ac4534b93f053a5e1c540d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:55.669816 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-71a1a708-b7aa-464c-b1bb-dddf8e7c4801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddcf502182ac4534b93f053a5e1c540d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:55.670481 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8503fe-24b2-4444-854f-f845583fdfa3 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:55.670610 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-71a1a708-b7aa-464c-b1bb-dddf8e7c4801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddcf502182ac4534b93f053a5e1c540d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:55.671144 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-71a1a708-b7aa-464c-b1bb-dddf8e7c4801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddcf502182ac4534b93f053a5e1c540d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:55.672264 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3d8503fe-24b2-4444-854f-f845583fdfa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:55.740606 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:55.751791 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8503fe-24b2-4444-854f-f845583fdfa3 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:55.757717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b93d0-2be4-4932-9a82-dc959e356425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:55.758418 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b93d0-2be4-4932-9a82-dc959e356425 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:55.758596 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b93d0-2be4-4932-9a82-dc959e356425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:55.758869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b93d0-2be4-4932-9a82-dc959e356425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:55.759559 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b93d0-2be4-4932-9a82-dc959e356425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:55.761216 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b93d0-2be4-4932-9a82-dc959e356425 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:55.771496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1055/2070] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:55.774512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-71a1a708-b7aa-464c-b1bb-dddf8e7c4801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddcf502182ac4534b93f053a5e1c540d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:55.787079 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b93d0-2be4-4932-9a82-dc959e356425 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:55.798474 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1016/2071] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:55 2022] DELETE /identity/v3/users/ddcf502182ac4534b93f053a5e1c540d => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:18:55.800876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b93d0-2be4-4932-9a82-dc959e356425 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:55.840342 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1a708-b7aa-464c-b1bb-dddf8e7c4801 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:55.841811 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-71a1a708-b7aa-464c-b1bb-dddf8e7c4801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:55.886787 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ae6dc-e105-4ee8-b3e2-cd098a81919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:55.887451 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ae6dc-e105-4ee8-b3e2-cd098a81919e admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:55.887856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ae6dc-e105-4ee8-b3e2-cd098a81919e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:55.888127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ae6dc-e105-4ee8-b3e2-cd098a81919e admin admin] PATH_INFO: `/v3/projects/6b1719f9295d4679bc7f232a994073fa/users/028bb53b9ec34ab38bf146dcbdd2b101/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:55.890217 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ae6dc-e105-4ee8-b3e2-cd098a81919e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1719f9295d4679bc7f232a994073fa, user_id=028bb53b9ec34ab38bf146dcbdd2b101, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:55.892888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ae6dc-e105-4ee8-b3e2-cd098a81919e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:55.904966 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1056/2072] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:55 2022] PUT /identity/v3/projects/6b1719f9295d4679bc7f232a994073fa/users/028bb53b9ec34ab38bf146dcbdd2b101/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:55.905647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1a708-b7aa-464c-b1bb-dddf8e7c4801 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:55.956690 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ad0c60-8d49-44db-a5cf-e382117f4f4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:55.957329 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad0c60-8d49-44db-a5cf-e382117f4f4c service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:55.957646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad0c60-8d49-44db-a5cf-e382117f4f4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:55.957955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad0c60-8d49-44db-a5cf-e382117f4f4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:55.959772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-02ad0c60-8d49-44db-a5cf-e382117f4f4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:56.022203 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad0c60-8d49-44db-a5cf-e382117f4f4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:56.023687 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ad0c60-8d49-44db-a5cf-e382117f4f4c service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:56.033421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1017/2073] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:18:56.323254 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ae6dc-e105-4ee8-b3e2-cd098a81919e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:56.329344 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-902ae6dc-e105-4ee8-b3e2-cd098a81919e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:56.334389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:56.406731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ae6dc-e105-4ee8-b3e2-cd098a81919e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:56.415552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a35f4a-9f9d-4e5b-819b-71366e80dcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:56.416775 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a35f4a-9f9d-4e5b-819b-71366e80dcbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:56.417062 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a35f4a-9f9d-4e5b-819b-71366e80dcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:56.417342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a35f4a-9f9d-4e5b-819b-71366e80dcbd admin admin] PATH_INFO: `/v3/projects/24e0df44888f420fb02c0b730beae042` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:56.418556 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a35f4a-9f9d-4e5b-819b-71366e80dcbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=24e0df44888f420fb02c0b730beae042)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:56.420523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a35f4a-9f9d-4e5b-819b-71366e80dcbd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:56.547431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-13a35f4a-9f9d-4e5b-819b-71366e80dcbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24e0df44888f420fb02c0b730beae042', 'request_id': 'req-13a35f4a-9f9d-4e5b-819b-71366e80dcbd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:56.560587 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-13a35f4a-9f9d-4e5b-819b-71366e80dcbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24e0df44888f420fb02c0b730beae042', 'request_id': 'req-13a35f4a-9f9d-4e5b-819b-71366e80dcbd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:56.631596 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-13a35f4a-9f9d-4e5b-819b-71366e80dcbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24e0df44888f420fb02c0b730beae042', 'request_id': 'req-13a35f4a-9f9d-4e5b-819b-71366e80dcbd'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:56.645160 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-13a35f4a-9f9d-4e5b-819b-71366e80dcbd admin admin] The token cache is being invalidate because project 24e0df44888f420fb02c0b730beae042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:18:56.645496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-13a35f4a-9f9d-4e5b-819b-71366e80dcbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:56.646206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-13a35f4a-9f9d-4e5b-819b-71366e80dcbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:56.652528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1057/2074] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:18:56 2022] DELETE /identity/v3/projects/24e0df44888f420fb02c0b730beae042 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:56.654303 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5954c1-29a9-4708-b44e-de73131015fc None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:56.654617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5954c1-29a9-4708-b44e-de73131015fc None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:56.654899 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5954c1-29a9-4708-b44e-de73131015fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:56.681138 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-fd5954c1-29a9-4708-b44e-de73131015fc None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:56.682432 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fd5954c1-29a9-4708-b44e-de73131015fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:56.749235 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1018/2075] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:56.758233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce436fab-7a6b-43fb-a256-bb5909152d72 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:56.758550 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce436fab-7a6b-43fb-a256-bb5909152d72 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:56.758968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce436fab-7a6b-43fb-a256-bb5909152d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:56.792026 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ce436fab-7a6b-43fb-a256-bb5909152d72 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:56.793989 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ce436fab-7a6b-43fb-a256-bb5909152d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:56.802844 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1058/2076] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:56.808090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5954c1-29a9-4708-b44e-de73131015fc None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:56.820436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5954c1-29a9-4708-b44e-de73131015fc None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:56.826296 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99b5f5-5863-433d-9728-b52dbc1421f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:56.827193 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99b5f5-5863-433d-9728-b52dbc1421f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:56.827577 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99b5f5-5863-433d-9728-b52dbc1421f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:56.828056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99b5f5-5863-433d-9728-b52dbc1421f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:56.828905 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99b5f5-5863-433d-9728-b52dbc1421f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:18:56.829337 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99b5f5-5863-433d-9728-b52dbc1421f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:56.832935 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99b5f5-5863-433d-9728-b52dbc1421f8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:56.849963 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1019/2077] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:18:56.854623 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce436fab-7a6b-43fb-a256-bb5909152d72 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:56.864815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce436fab-7a6b-43fb-a256-bb5909152d72 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:56.871164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911dea68-352c-4e47-ab57-e66730bbd79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:56.871778 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911dea68-352c-4e47-ab57-e66730bbd79d admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:56.872056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911dea68-352c-4e47-ab57-e66730bbd79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:56.872330 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911dea68-352c-4e47-ab57-e66730bbd79d admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:56.872957 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911dea68-352c-4e47-ab57-e66730bbd79d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:56.874912 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911dea68-352c-4e47-ab57-e66730bbd79d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:56.982343 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1059/2078] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:56 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:56.987131 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99b5f5-5863-433d-9728-b52dbc1421f8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:56.998272 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99b5f5-5863-433d-9728-b52dbc1421f8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:57.057096 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea83e2-23b3-438f-a2e9-635ec0519652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:57.057863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea83e2-23b3-438f-a2e9-635ec0519652 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:57.057999 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea83e2-23b3-438f-a2e9-635ec0519652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:57.058270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea83e2-23b3-438f-a2e9-635ec0519652 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:57.058928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea83e2-23b3-438f-a2e9-635ec0519652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:57.060830 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea83e2-23b3-438f-a2e9-635ec0519652 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:57.184529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1020/2079] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:56 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:18:57.188929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911dea68-352c-4e47-ab57-e66730bbd79d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:57.200066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911dea68-352c-4e47-ab57-e66730bbd79d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:57.205119 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6e0e4-dc23-485d-a85c-4fe19ff49bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:57.205744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6e0e4-dc23-485d-a85c-4fe19ff49bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:57.206072 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6e0e4-dc23-485d-a85c-4fe19ff49bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:57.206305 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6e0e4-dc23-485d-a85c-4fe19ff49bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:57.207742 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6e0e4-dc23-485d-a85c-4fe19ff49bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:57.210476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6e0e4-dc23-485d-a85c-4fe19ff49bd8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:57.219899 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1060/2080] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:57.224308 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea83e2-23b3-438f-a2e9-635ec0519652 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:57.238161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea83e2-23b3-438f-a2e9-635ec0519652 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:57.239995 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80336e5-0b1c-4a46-b75e-45a81fa4ae1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:57.240600 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80336e5-0b1c-4a46-b75e-45a81fa4ae1f admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:57.240886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80336e5-0b1c-4a46-b75e-45a81fa4ae1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:57.241161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80336e5-0b1c-4a46-b75e-45a81fa4ae1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:57.241837 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80336e5-0b1c-4a46-b75e-45a81fa4ae1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:57.243483 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80336e5-0b1c-4a46-b75e-45a81fa4ae1f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:57.254969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1021/2081] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:57.259214 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6e0e4-dc23-485d-a85c-4fe19ff49bd8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:57.269057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6e0e4-dc23-485d-a85c-4fe19ff49bd8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:57.274153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbae05-9633-4dfa-83f8-acaf1b87201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:57.274796 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbae05-9633-4dfa-83f8-acaf1b87201f admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:57.275079 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbae05-9633-4dfa-83f8-acaf1b87201f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:57.275351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbae05-9633-4dfa-83f8-acaf1b87201f admin admin] PATH_INFO: `/v3/projects/18faa87aebd14fe7abaf43c0a5fcd2da/users/2ddfe226191d48e685291af568629e45/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:57.289487 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbae05-9633-4dfa-83f8-acaf1b87201f admin admin] RBAC: Authorizing `identity:create_grant(project_id=18faa87aebd14fe7abaf43c0a5fcd2da, user_id=2ddfe226191d48e685291af568629e45, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:57.292160 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbae05-9633-4dfa-83f8-acaf1b87201f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:57.409745 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80336e5-0b1c-4a46-b75e-45a81fa4ae1f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:57.411844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a80336e5-0b1c-4a46-b75e-45a81fa4ae1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:57.443920 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1061/2082] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:57 2022] PUT /identity/v3/projects/18faa87aebd14fe7abaf43c0a5fcd2da/users/2ddfe226191d48e685291af568629e45/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:57.456492 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7d421-4b34-4739-b044-ef440dfa4879 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:57.457075 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7d421-4b34-4739-b044-ef440dfa4879 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:57.457562 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7d421-4b34-4739-b044-ef440dfa4879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:57.489875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80336e5-0b1c-4a46-b75e-45a81fa4ae1f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:57.506192 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-22f7d421-4b34-4739-b044-ef440dfa4879 None None] MFA Rules not processed for user `2ddfe226191d48e685291af568629e45`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:57.510112 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-22f7d421-4b34-4739-b044-ef440dfa4879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:57.528458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:57.585723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2dcaa-c3de-4f4a-95e9-9c28c6511d8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:57.586617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2dcaa-c3de-4f4a-95e9-9c28c6511d8c service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:57.587123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2dcaa-c3de-4f4a-95e9-9c28c6511d8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:57.587630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2dcaa-c3de-4f4a-95e9-9c28c6511d8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:57.589776 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2ff2dcaa-c3de-4f4a-95e9-9c28c6511d8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:57.606322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1062/2083] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:57.607743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c975ea-b8ff-4f42-9674-caa3008478b8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:57.608033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c975ea-b8ff-4f42-9674-caa3008478b8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:57.608479 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c975ea-b8ff-4f42-9674-caa3008478b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:57.649101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:57.662020 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-83c975ea-b8ff-4f42-9674-caa3008478b8 None None] MFA Rules not processed for user `028bb53b9ec34ab38bf146dcbdd2b101`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:57.663551 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-83c975ea-b8ff-4f42-9674-caa3008478b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:57.680903 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2dcaa-c3de-4f4a-95e9-9c28c6511d8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:57.682976 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2dcaa-c3de-4f4a-95e9-9c28c6511d8c service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:57.704942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1022/2084] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:18:57.705953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2dcaa-c3de-4f4a-95e9-9c28c6511d8c service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:57.757231 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1063/2085] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:57.767696 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c1ad0-4655-4cb2-b438-1dfb2f14b35f None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:57.767981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c1ad0-4655-4cb2-b438-1dfb2f14b35f None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:57.768255 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c1ad0-4655-4cb2-b438-1dfb2f14b35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:57.787073 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a23c1ad0-4655-4cb2-b438-1dfb2f14b35f None None] MFA Rules not processed for user `b13695af76fe4746890bb74b3012d009`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:57.788266 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a23c1ad0-4655-4cb2-b438-1dfb2f14b35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:57.789575 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2dcaa-c3de-4f4a-95e9-9c28c6511d8c service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:57.794738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477af32-53c3-4344-aa77-80ce68609b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:57.795530 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477af32-53c3-4344-aa77-80ce68609b4e admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:57.795806 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477af32-53c3-4344-aa77-80ce68609b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:57.796076 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477af32-53c3-4344-aa77-80ce68609b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:57.796700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477af32-53c3-4344-aa77-80ce68609b4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:57.798646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477af32-53c3-4344-aa77-80ce68609b4e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:57.846982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1064/2086] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:57.857145 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c1ad0-4655-4cb2-b438-1dfb2f14b35f None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:57.858602 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a23c1ad0-4655-4cb2-b438-1dfb2f14b35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:57.919094 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1023/2087] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:57 2022] POST /identity/v3/projects => generated 379 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:57.920725 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477af32-53c3-4344-aa77-80ce68609b4e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:57.967750 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c1ad0-4655-4cb2-b438-1dfb2f14b35f None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:58.018434 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477af32-53c3-4344-aa77-80ce68609b4e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:58.026200 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405984d-c9c2-4fdf-a2c0-2767bcc7ae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:58.027203 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405984d-c9c2-4fdf-a2c0-2767bcc7ae6d admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:58.027691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405984d-c9c2-4fdf-a2c0-2767bcc7ae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:58.028193 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405984d-c9c2-4fdf-a2c0-2767bcc7ae6d admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:58.028900 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405984d-c9c2-4fdf-a2c0-2767bcc7ae6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:58.031173 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405984d-c9c2-4fdf-a2c0-2767bcc7ae6d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:58.058811 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3e5ec-c8de-4797-b4c7-35990ee1b594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:58.067111 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3e5ec-c8de-4797-b4c7-35990ee1b594 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:58.070220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3e5ec-c8de-4797-b4c7-35990ee1b594 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:58.070220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3e5ec-c8de-4797-b4c7-35990ee1b594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:58.070220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-dae3e5ec-c8de-4797-b4c7-35990ee1b594 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:58.130731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3e5ec-c8de-4797-b4c7-35990ee1b594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:58.132309 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3e5ec-c8de-4797-b4c7-35990ee1b594 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:58.141904 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1065/2088] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:18:58.165575 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1024/2089] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:57 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:58.168232 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3e5ec-c8de-4797-b4c7-35990ee1b594 service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:58.198176 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3e5ec-c8de-4797-b4c7-35990ee1b594 service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:58.211919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e95641-12d2-4a25-93c0-d71d36a469aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:58.213599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e95641-12d2-4a25-93c0-d71d36a469aa admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:58.214287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e95641-12d2-4a25-93c0-d71d36a469aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:58.214909 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e95641-12d2-4a25-93c0-d71d36a469aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:58.215699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e95641-12d2-4a25-93c0-d71d36a469aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:58.217914 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e95641-12d2-4a25-93c0-d71d36a469aa admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:58.246886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405984d-c9c2-4fdf-a2c0-2767bcc7ae6d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:58.255440 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1066/2090] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:58.260191 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405984d-c9c2-4fdf-a2c0-2767bcc7ae6d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:58.266090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77450225-ab75-4ebe-9d65-dd1159daee96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:58.302275 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77450225-ab75-4ebe-9d65-dd1159daee96 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:58.302275 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77450225-ab75-4ebe-9d65-dd1159daee96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:58.302275 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77450225-ab75-4ebe-9d65-dd1159daee96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:58.302275 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77450225-ab75-4ebe-9d65-dd1159daee96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:58.302275 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77450225-ab75-4ebe-9d65-dd1159daee96 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:58.302275 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1025/2091] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:58.303747 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e95641-12d2-4a25-93c0-d71d36a469aa admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:58.318981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e95641-12d2-4a25-93c0-d71d36a469aa admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:58.324384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe4be9-f3ff-4c92-a60e-0ec543ef6f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:58.325128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe4be9-f3ff-4c92-a60e-0ec543ef6f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:58.325419 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe4be9-f3ff-4c92-a60e-0ec543ef6f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:58.325776 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe4be9-f3ff-4c92-a60e-0ec543ef6f38 admin admin] PATH_INFO: `/v3/projects/4c93975eede94add84e92e26a0506b15/users/0a6b8e3e17904b6d949d16f600bc10d9/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:58.342315 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe4be9-f3ff-4c92-a60e-0ec543ef6f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c93975eede94add84e92e26a0506b15, user_id=0a6b8e3e17904b6d949d16f600bc10d9, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:58.345168 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe4be9-f3ff-4c92-a60e-0ec543ef6f38 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:58.742026 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1067/2092] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:58 2022] PUT /identity/v3/projects/4c93975eede94add84e92e26a0506b15/users/0a6b8e3e17904b6d949d16f600bc10d9/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:58.753351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a6a7-a1d6-4c1f-a7b3-1e1bb7471896 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:58.754673 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a6a7-a1d6-4c1f-a7b3-1e1bb7471896 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:58.757997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a6a7-a1d6-4c1f-a7b3-1e1bb7471896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:58.788003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-43e8a6a7-a1d6-4c1f-a7b3-1e1bb7471896 None None] MFA Rules not processed for user `0a6b8e3e17904b6d949d16f600bc10d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:58.789225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-43e8a6a7-a1d6-4c1f-a7b3-1e1bb7471896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:58.857674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1026/2093] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:18:58.862618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe4be9-f3ff-4c92-a60e-0ec543ef6f38 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:58.929871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe4be9-f3ff-4c92-a60e-0ec543ef6f38 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:58.935022 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15a4a5-bbd3-48f1-8144-9ba03e4c5ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:58.935216 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15a4a5-bbd3-48f1-8144-9ba03e4c5ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:58.935622 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15a4a5-bbd3-48f1-8144-9ba03e4c5ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:58.936013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15a4a5-bbd3-48f1-8144-9ba03e4c5ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:58.936869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15a4a5-bbd3-48f1-8144-9ba03e4c5ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:58.939093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15a4a5-bbd3-48f1-8144-9ba03e4c5ee8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:59.105500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1068/2094] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:18:58 2022] POST /identity/v3/projects => generated 373 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:59.106381 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8a6a7-a1d6-4c1f-a7b3-1e1bb7471896 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:59.118546 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8a6a7-a1d6-4c1f-a7b3-1e1bb7471896 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:59.202533 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf11ad4-2ce0-4e4b-9aaf-126f4818d127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:59.203390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf11ad4-2ce0-4e4b-9aaf-126f4818d127 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:59.203770 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf11ad4-2ce0-4e4b-9aaf-126f4818d127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:59.204133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf11ad4-2ce0-4e4b-9aaf-126f4818d127 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:59.205819 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf11ad4-2ce0-4e4b-9aaf-126f4818d127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:59.208955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf11ad4-2ce0-4e4b-9aaf-126f4818d127 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:59.287366 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15a4a5-bbd3-48f1-8144-9ba03e4c5ee8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:59.289951 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ed15a4a5-bbd3-48f1-8144-9ba03e4c5ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:59.303274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15a4a5-bbd3-48f1-8144-9ba03e4c5ee8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:59.312375 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1027/2095] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:18:59 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:18:59.317598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1731dd-945a-4f25-9638-c675e132a4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:59.318582 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1731dd-945a-4f25-9638-c675e132a4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:59.319092 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1731dd-945a-4f25-9638-c675e132a4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:59.319526 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1731dd-945a-4f25-9638-c675e132a4b8 admin admin] PATH_INFO: `/v3/users/38d5eee0f6884b65ac78368b4302bbcb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:59.320398 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf11ad4-2ce0-4e4b-9aaf-126f4818d127 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:59.320797 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1731dd-945a-4f25-9638-c675e132a4b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38d5eee0f6884b65ac78368b4302bbcb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:59.322888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1731dd-945a-4f25-9638-c675e132a4b8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:59.336018 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf11ad4-2ce0-4e4b-9aaf-126f4818d127 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:59.342939 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8558484-1629-402a-8983-76347ae0380f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:59.343686 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8558484-1629-402a-8983-76347ae0380f admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:59.344033 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8558484-1629-402a-8983-76347ae0380f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:59.344371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8558484-1629-402a-8983-76347ae0380f admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:59.345564 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8558484-1629-402a-8983-76347ae0380f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:59.347527 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8558484-1629-402a-8983-76347ae0380f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:59.361369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1028/2096] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:18:59.366772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8558484-1629-402a-8983-76347ae0380f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:59.379015 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8558484-1629-402a-8983-76347ae0380f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:59.384837 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af42d99-f07b-460f-bda5-9e991cba68af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:59.385728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af42d99-f07b-460f-bda5-9e991cba68af admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:59.386161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af42d99-f07b-460f-bda5-9e991cba68af admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:59.386439 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af42d99-f07b-460f-bda5-9e991cba68af admin admin] PATH_INFO: `/v3/projects/1afd64b4a4a042f1bf304094c0c37970/users/b2dfefa09bd14fb0bbb54db465da73e0/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:59.403793 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af42d99-f07b-460f-bda5-9e991cba68af admin admin] RBAC: Authorizing `identity:create_grant(project_id=1afd64b4a4a042f1bf304094c0c37970, user_id=b2dfefa09bd14fb0bbb54db465da73e0, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:59.406798 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af42d99-f07b-460f-bda5-9e991cba68af admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:59.472137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1029/2097] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:59 2022] PUT /identity/v3/projects/1afd64b4a4a042f1bf304094c0c37970/users/b2dfefa09bd14fb0bbb54db465da73e0/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:59.476764 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af42d99-f07b-460f-bda5-9e991cba68af admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:59.542383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af42d99-f07b-460f-bda5-9e991cba68af admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:59.547861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec0370-29bd-4940-a4f3-68e9902aa6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:59.548576 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec0370-29bd-4940-a4f3-68e9902aa6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:59.548860 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec0370-29bd-4940-a4f3-68e9902aa6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:59.549134 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec0370-29bd-4940-a4f3-68e9902aa6f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:59.549840 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec0370-29bd-4940-a4f3-68e9902aa6f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:59.553386 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec0370-29bd-4940-a4f3-68e9902aa6f6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:59.555640 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:59.566333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1030/2098] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:18:59.570066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-df1731dd-945a-4f25-9638-c675e132a4b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38d5eee0f6884b65ac78368b4302bbcb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:59.570623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec0370-29bd-4940-a4f3-68e9902aa6f6 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:59.580347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec0370-29bd-4940-a4f3-68e9902aa6f6 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:59.585683 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9815f57-840e-486a-b77f-863b8cee2e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:59.586327 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9815f57-840e-486a-b77f-863b8cee2e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:59.591047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9815f57-840e-486a-b77f-863b8cee2e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:59.591047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9815f57-840e-486a-b77f-863b8cee2e71 admin admin] PATH_INFO: `/v3/projects/1afd64b4a4a042f1bf304094c0c37970/users/b2dfefa09bd14fb0bbb54db465da73e0/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:59.591047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9815f57-840e-486a-b77f-863b8cee2e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1afd64b4a4a042f1bf304094c0c37970, user_id=b2dfefa09bd14fb0bbb54db465da73e0, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:59.591409 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9815f57-840e-486a-b77f-863b8cee2e71 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:59.601388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1031/2099] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:18:59 2022] PUT /identity/v3/projects/1afd64b4a4a042f1bf304094c0c37970/users/b2dfefa09bd14fb0bbb54db465da73e0/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:59.611708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f17dd-1dcf-486c-bcd7-06b7fe9c5f01 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:59.614339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f17dd-1dcf-486c-bcd7-06b7fe9c5f01 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:59.614339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f17dd-1dcf-486c-bcd7-06b7fe9c5f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:59.631061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-df1731dd-945a-4f25-9638-c675e132a4b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38d5eee0f6884b65ac78368b4302bbcb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:59.631823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-df1731dd-945a-4f25-9638-c675e132a4b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38d5eee0f6884b65ac78368b4302bbcb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:59.632431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-df1731dd-945a-4f25-9638-c675e132a4b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38d5eee0f6884b65ac78368b4302bbcb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:59.640055 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-df1731dd-945a-4f25-9638-c675e132a4b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38d5eee0f6884b65ac78368b4302bbcb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:18:59.642301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f31f17dd-1dcf-486c-bcd7-06b7fe9c5f01 None None] MFA Rules not processed for user `b2dfefa09bd14fb0bbb54db465da73e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:59.643586 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f31f17dd-1dcf-486c-bcd7-06b7fe9c5f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:59.658705 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1069/2100] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:18:59 2022] DELETE /identity/v3/users/38d5eee0f6884b65ac78368b4302bbcb => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:18:59.663384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c61f3-adc6-4937-a9b0-8f95ace34248 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:59.663680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c61f3-adc6-4937-a9b0-8f95ace34248 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:59.663955 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c61f3-adc6-4937-a9b0-8f95ace34248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:59.684681 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d99c61f3-adc6-4937-a9b0-8f95ace34248 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:18:59.688701 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d99c61f3-adc6-4937-a9b0-8f95ace34248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:59.720522 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1032/2101] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:59.734160 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f17dd-1dcf-486c-bcd7-06b7fe9c5f01 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:59.740220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f31f17dd-1dcf-486c-bcd7-06b7fe9c5f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:59.758576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1070/2102] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:18:59.768321 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c61f3-adc6-4937-a9b0-8f95ace34248 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:18:59.769726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d99c61f3-adc6-4937-a9b0-8f95ace34248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:18:59.807147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f17dd-1dcf-486c-bcd7-06b7fe9c5f01 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:59.834901 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c61f3-adc6-4937-a9b0-8f95ace34248 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:18:59.838949 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6bdce-b428-4262-a350-7f7934c9a81d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:59.839563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6bdce-b428-4262-a350-7f7934c9a81d service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:59.839838 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6bdce-b428-4262-a350-7f7934c9a81d service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:59.840103 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6bdce-b428-4262-a350-7f7934c9a81d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:59.851010 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6bdce-b428-4262-a350-7f7934c9a81d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:59.852703 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6bdce-b428-4262-a350-7f7934c9a81d service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:59.868774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1071/2103] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:18:59.881953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abfe4f-29fb-49ee-ac0c-0a3779e39cea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:18:59.882651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abfe4f-29fb-49ee-ac0c-0a3779e39cea service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:18:59.883009 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abfe4f-29fb-49ee-ac0c-0a3779e39cea service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:18:59.883276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abfe4f-29fb-49ee-ac0c-0a3779e39cea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:18:59.950893 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abfe4f-29fb-49ee-ac0c-0a3779e39cea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:18:59.952199 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abfe4f-29fb-49ee-ac0c-0a3779e39cea service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:18:59.969433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1033/2104] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:18:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:18:59.990698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:00.113197 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6bdce-b428-4262-a350-7f7934c9a81d service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:00.124254 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6bdce-b428-4262-a350-7f7934c9a81d service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:00.128491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354a9be-9d1e-4dcf-848c-5a23e4b7e63b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:00.129859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354a9be-9d1e-4dcf-848c-5a23e4b7e63b service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:00.130270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354a9be-9d1e-4dcf-848c-5a23e4b7e63b service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:00.130602 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354a9be-9d1e-4dcf-848c-5a23e4b7e63b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:00.132373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6354a9be-9d1e-4dcf-848c-5a23e4b7e63b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:00.213054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354a9be-9d1e-4dcf-848c-5a23e4b7e63b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:00.214769 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354a9be-9d1e-4dcf-848c-5a23e4b7e63b service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:00.224888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1072/2105] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:00.445065 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abfe4f-29fb-49ee-ac0c-0a3779e39cea service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:00.447298 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-63abfe4f-29fb-49ee-ac0c-0a3779e39cea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:00.472962 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abfe4f-29fb-49ee-ac0c-0a3779e39cea service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:00.484142 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17ad25-9898-473b-a9ad-c62b02eb4f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:00.484142 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17ad25-9898-473b-a9ad-c62b02eb4f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:00.484142 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17ad25-9898-473b-a9ad-c62b02eb4f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:00.484142 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17ad25-9898-473b-a9ad-c62b02eb4f3d admin admin] PATH_INFO: `/v3/projects/f642d1a9654249e6a366ea4336cfb36a` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:00.485615 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17ad25-9898-473b-a9ad-c62b02eb4f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f642d1a9654249e6a366ea4336cfb36a)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:00.489472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17ad25-9898-473b-a9ad-c62b02eb4f3d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:00.639530 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ed17ad25-9898-473b-a9ad-c62b02eb4f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f642d1a9654249e6a366ea4336cfb36a', 'request_id': 'req-ed17ad25-9898-473b-a9ad-c62b02eb4f3d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:00.645891 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ed17ad25-9898-473b-a9ad-c62b02eb4f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f642d1a9654249e6a366ea4336cfb36a', 'request_id': 'req-ed17ad25-9898-473b-a9ad-c62b02eb4f3d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:00.786649 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ed17ad25-9898-473b-a9ad-c62b02eb4f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f642d1a9654249e6a366ea4336cfb36a', 'request_id': 'req-ed17ad25-9898-473b-a9ad-c62b02eb4f3d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:00.800438 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ed17ad25-9898-473b-a9ad-c62b02eb4f3d admin admin] The token cache is being invalidate because project f642d1a9654249e6a366ea4336cfb36a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:00.800732 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ed17ad25-9898-473b-a9ad-c62b02eb4f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:00.801544 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ed17ad25-9898-473b-a9ad-c62b02eb4f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:00.803277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1034/2106] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:00 2022] DELETE /identity/v3/projects/f642d1a9654249e6a366ea4336cfb36a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:00.808224 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426ae7e-c1b0-4436-96d8-9ce97d53e1a6 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:00.808520 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426ae7e-c1b0-4436-96d8-9ce97d53e1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:00.808797 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426ae7e-c1b0-4436-96d8-9ce97d53e1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:00.837707 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b426ae7e-c1b0-4436-96d8-9ce97d53e1a6 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:00.839345 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b426ae7e-c1b0-4436-96d8-9ce97d53e1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:00.902628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1073/2107] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:00.910456 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6aca1-a09f-43c2-a780-2c0f493cb2bf None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:00.910750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6aca1-a09f-43c2-a780-2c0f493cb2bf None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:00.911024 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6aca1-a09f-43c2-a780-2c0f493cb2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:00.933591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-60d6aca1-a09f-43c2-a780-2c0f493cb2bf None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:00.934796 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-60d6aca1-a09f-43c2-a780-2c0f493cb2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:00.946722 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1035/2108] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:00.948825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426ae7e-c1b0-4436-96d8-9ce97d53e1a6 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:00.957204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426ae7e-c1b0-4436-96d8-9ce97d53e1a6 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:00.962431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009fd18-6e5c-4cf5-91ab-d15ba6f11d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:00.963027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009fd18-6e5c-4cf5-91ab-d15ba6f11d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:00.963303 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009fd18-6e5c-4cf5-91ab-d15ba6f11d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:00.963571 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009fd18-6e5c-4cf5-91ab-d15ba6f11d8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:00.964212 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009fd18-6e5c-4cf5-91ab-d15ba6f11d8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:19:00.964511 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009fd18-6e5c-4cf5-91ab-d15ba6f11d8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:00.966191 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009fd18-6e5c-4cf5-91ab-d15ba6f11d8a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:00.977576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1074/2109] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:19:00.982100 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6aca1-a09f-43c2-a780-2c0f493cb2bf None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:00.991350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6aca1-a09f-43c2-a780-2c0f493cb2bf None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:00.996019 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eddfea-22dd-47b7-a034-ebe8ab140921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:00.996670 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eddfea-22dd-47b7-a034-ebe8ab140921 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:00.996948 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eddfea-22dd-47b7-a034-ebe8ab140921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:00.997218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eddfea-22dd-47b7-a034-ebe8ab140921 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:00.997880 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eddfea-22dd-47b7-a034-ebe8ab140921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:00.999798 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eddfea-22dd-47b7-a034-ebe8ab140921 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:01.106515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009fd18-6e5c-4cf5-91ab-d15ba6f11d8a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:01.110013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1036/2110] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:19:00 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:19:01.121141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009fd18-6e5c-4cf5-91ab-d15ba6f11d8a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:01.185270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18803815-ca66-4569-a914-4577cc8a648d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:01.186040 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18803815-ca66-4569-a914-4577cc8a648d admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:01.186321 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18803815-ca66-4569-a914-4577cc8a648d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:01.186646 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18803815-ca66-4569-a914-4577cc8a648d admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:01.187338 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18803815-ca66-4569-a914-4577cc8a648d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:01.189297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18803815-ca66-4569-a914-4577cc8a648d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:01.299239 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1075/2111] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:19:01 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:19:01.303850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eddfea-22dd-47b7-a034-ebe8ab140921 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:01.314181 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eddfea-22dd-47b7-a034-ebe8ab140921 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:01.319561 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bffaf5-cd34-4cc5-b73c-0fe6d8ec75dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:01.320190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bffaf5-cd34-4cc5-b73c-0fe6d8ec75dd admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:01.320473 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bffaf5-cd34-4cc5-b73c-0fe6d8ec75dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:01.320748 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bffaf5-cd34-4cc5-b73c-0fe6d8ec75dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:01.321396 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bffaf5-cd34-4cc5-b73c-0fe6d8ec75dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:01.323039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bffaf5-cd34-4cc5-b73c-0fe6d8ec75dd admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:01.333236 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1037/2112] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:01.337358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18803815-ca66-4569-a914-4577cc8a648d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:01.347496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18803815-ca66-4569-a914-4577cc8a648d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:01.352695 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2a9d5-3219-44f8-97a1-213b8933df45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:01.353283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2a9d5-3219-44f8-97a1-213b8933df45 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:01.353606 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2a9d5-3219-44f8-97a1-213b8933df45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:01.353877 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2a9d5-3219-44f8-97a1-213b8933df45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:01.354510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2a9d5-3219-44f8-97a1-213b8933df45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:01.356216 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2a9d5-3219-44f8-97a1-213b8933df45 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:01.367517 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1076/2113] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:19:01.372018 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bffaf5-cd34-4cc5-b73c-0fe6d8ec75dd admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:01.382875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bffaf5-cd34-4cc5-b73c-0fe6d8ec75dd admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:01.387782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee63eee-a080-4500-bf4d-6beb5f26b1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:01.390415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee63eee-a080-4500-bf4d-6beb5f26b1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:01.390415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee63eee-a080-4500-bf4d-6beb5f26b1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:01.390415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee63eee-a080-4500-bf4d-6beb5f26b1f3 admin admin] PATH_INFO: `/v3/projects/912cb83b9bb3450d8a6159e19ff09208/users/d8210c4eddc8487fa695a47e3508f9d8/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:01.403508 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee63eee-a080-4500-bf4d-6beb5f26b1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=912cb83b9bb3450d8a6159e19ff09208, user_id=d8210c4eddc8487fa695a47e3508f9d8, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:01.406354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee63eee-a080-4500-bf4d-6beb5f26b1f3 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:01.411228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:01.516648 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:01.527358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1038/2114] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:01 2022] PUT /identity/v3/projects/912cb83b9bb3450d8a6159e19ff09208/users/d8210c4eddc8487fa695a47e3508f9d8/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:01.540404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7999974-adf7-4d6e-8794-7c4d5e9d2596 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:01.540691 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7999974-adf7-4d6e-8794-7c4d5e9d2596 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:01.540974 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7999974-adf7-4d6e-8794-7c4d5e9d2596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:01.581171 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c7999974-adf7-4d6e-8794-7c4d5e9d2596 None None] MFA Rules not processed for user `d8210c4eddc8487fa695a47e3508f9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:01.583035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c7999974-adf7-4d6e-8794-7c4d5e9d2596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:01.667537 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1077/2115] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:01.694604 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee63eee-a080-4500-bf4d-6beb5f26b1f3 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:01.696461 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3ee63eee-a080-4500-bf4d-6beb5f26b1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:01.757196 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee63eee-a080-4500-bf4d-6beb5f26b1f3 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:01.761498 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d542cb-8c00-4169-b400-679f12e4bc53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:01.762194 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d542cb-8c00-4169-b400-679f12e4bc53 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:01.762548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d542cb-8c00-4169-b400-679f12e4bc53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:01.763248 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d542cb-8c00-4169-b400-679f12e4bc53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:01.773957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d542cb-8c00-4169-b400-679f12e4bc53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:01.775443 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d542cb-8c00-4169-b400-679f12e4bc53 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:01.784701 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1039/2116] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:02.151269 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:02.652648 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7999974-adf7-4d6e-8794-7c4d5e9d2596 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:02.657981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c7999974-adf7-4d6e-8794-7c4d5e9d2596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:02.677825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:02.765949 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7999974-adf7-4d6e-8794-7c4d5e9d2596 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:02.772707 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bb40a-7b77-44f2-8b7d-b015db3a57ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:02.773347 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bb40a-7b77-44f2-8b7d-b015db3a57ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:02.773656 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bb40a-7b77-44f2-8b7d-b015db3a57ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:02.773932 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bb40a-7b77-44f2-8b7d-b015db3a57ff admin admin] PATH_INFO: `/v3/users/1237f479740c43b59c423a5533359c85` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:02.775087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bb40a-7b77-44f2-8b7d-b015db3a57ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1237f479740c43b59c423a5533359c85)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:02.777011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bb40a-7b77-44f2-8b7d-b015db3a57ff admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:02.961897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:02.976915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-df1bb40a-7b77-44f2-8b7d-b015db3a57ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1237f479740c43b59c423a5533359c85'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:03.107138 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-df1bb40a-7b77-44f2-8b7d-b015db3a57ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1237f479740c43b59c423a5533359c85'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:03.107881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-df1bb40a-7b77-44f2-8b7d-b015db3a57ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1237f479740c43b59c423a5533359c85'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:03.108549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-df1bb40a-7b77-44f2-8b7d-b015db3a57ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1237f479740c43b59c423a5533359c85'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:03.115994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-df1bb40a-7b77-44f2-8b7d-b015db3a57ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1237f479740c43b59c423a5533359c85'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:03.133184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1078/2117] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:02 2022] DELETE /identity/v3/users/1237f479740c43b59c423a5533359c85 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:03.137685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadca544-2eb3-41a9-8eb5-d756f3a4e42c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:03.138036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadca544-2eb3-41a9-8eb5-d756f3a4e42c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:03.138314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadca544-2eb3-41a9-8eb5-d756f3a4e42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:03.157879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-eadca544-2eb3-41a9-8eb5-d756f3a4e42c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:03.159096 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-eadca544-2eb3-41a9-8eb5-d756f3a4e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:03.235826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1040/2118] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:03.245765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bb40a-7b77-44f2-8b7d-b015db3a57ff admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:03.247319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-df1bb40a-7b77-44f2-8b7d-b015db3a57ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:03.307567 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bb40a-7b77-44f2-8b7d-b015db3a57ff admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:03.311553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d344acf-dfe0-45d9-91a3-cd7c1979b1fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:03.312161 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d344acf-dfe0-45d9-91a3-cd7c1979b1fe service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:03.312438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d344acf-dfe0-45d9-91a3-cd7c1979b1fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:03.312708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d344acf-dfe0-45d9-91a3-cd7c1979b1fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:03.323676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d344acf-dfe0-45d9-91a3-cd7c1979b1fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:03.325122 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d344acf-dfe0-45d9-91a3-cd7c1979b1fe service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:03.334969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1079/2119] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:04.070158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadca544-2eb3-41a9-8eb5-d756f3a4e42c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:04.072500 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-eadca544-2eb3-41a9-8eb5-d756f3a4e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:04.091887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadca544-2eb3-41a9-8eb5-d756f3a4e42c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:04.100450 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38400380-cbe5-478d-b6d7-941f67d7f082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:04.100450 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38400380-cbe5-478d-b6d7-941f67d7f082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:04.100450 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38400380-cbe5-478d-b6d7-941f67d7f082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:04.100450 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38400380-cbe5-478d-b6d7-941f67d7f082 admin admin] PATH_INFO: `/v3/projects/197fcb000fd844aa8c8692eb123c3d21` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:04.101823 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38400380-cbe5-478d-b6d7-941f67d7f082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=197fcb000fd844aa8c8692eb123c3d21)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:04.104241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38400380-cbe5-478d-b6d7-941f67d7f082 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:04.251780 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:04.271137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-38400380-cbe5-478d-b6d7-941f67d7f082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '197fcb000fd844aa8c8692eb123c3d21', 'request_id': 'req-38400380-cbe5-478d-b6d7-941f67d7f082'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:04.276567 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-38400380-cbe5-478d-b6d7-941f67d7f082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '197fcb000fd844aa8c8692eb123c3d21', 'request_id': 'req-38400380-cbe5-478d-b6d7-941f67d7f082'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:04.365709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-38400380-cbe5-478d-b6d7-941f67d7f082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '197fcb000fd844aa8c8692eb123c3d21', 'request_id': 'req-38400380-cbe5-478d-b6d7-941f67d7f082'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:04.384127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-38400380-cbe5-478d-b6d7-941f67d7f082 admin admin] The token cache is being invalidate because project 197fcb000fd844aa8c8692eb123c3d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:04.384501 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-38400380-cbe5-478d-b6d7-941f67d7f082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:04.385459 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-38400380-cbe5-478d-b6d7-941f67d7f082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:04.387582 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1041/2120] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:04 2022] DELETE /identity/v3/projects/197fcb000fd844aa8c8692eb123c3d21 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:04.391465 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d344acf-dfe0-45d9-91a3-cd7c1979b1fe service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:04.403568 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d344acf-dfe0-45d9-91a3-cd7c1979b1fe service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:04.485043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7dc28-f778-4fc4-b763-9353b774064e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:04.485733 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7dc28-f778-4fc4-b763-9353b774064e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:04.486018 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7dc28-f778-4fc4-b763-9353b774064e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:04.486292 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7dc28-f778-4fc4-b763-9353b774064e admin admin] PATH_INFO: `/v3/users/7a89f9cddf6843438f18b57256e51e77` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:04.487428 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7dc28-f778-4fc4-b763-9353b774064e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a89f9cddf6843438f18b57256e51e77)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:04.489439 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7dc28-f778-4fc4-b763-9353b774064e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:04.662876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8cb7dc28-f778-4fc4-b763-9353b774064e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a89f9cddf6843438f18b57256e51e77'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:04.696774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:04.724102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8cb7dc28-f778-4fc4-b763-9353b774064e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a89f9cddf6843438f18b57256e51e77'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:04.724906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8cb7dc28-f778-4fc4-b763-9353b774064e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a89f9cddf6843438f18b57256e51e77'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:04.725762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8cb7dc28-f778-4fc4-b763-9353b774064e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a89f9cddf6843438f18b57256e51e77'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:04.737786 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8cb7dc28-f778-4fc4-b763-9353b774064e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a89f9cddf6843438f18b57256e51e77'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:04.762966 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1080/2121] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:04 2022] DELETE /identity/v3/users/7a89f9cddf6843438f18b57256e51e77 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:04.852527 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d73224-d2ba-42e9-8360-ab152b31e148 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:04.854337 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d73224-d2ba-42e9-8360-ab152b31e148 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:04.854337 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d73224-d2ba-42e9-8360-ab152b31e148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:04.889652 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-66d73224-d2ba-42e9-8360-ab152b31e148 None None] MFA Rules not processed for user `d8210c4eddc8487fa695a47e3508f9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:04.893845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-66d73224-d2ba-42e9-8360-ab152b31e148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:04.899170 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7dc28-f778-4fc4-b763-9353b774064e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:04.902473 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8cb7dc28-f778-4fc4-b763-9353b774064e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:04.961234 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:04.967703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1042/2122] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:04.982418 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7dc28-f778-4fc4-b763-9353b774064e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:04.990548 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe2820-ca25-4360-a936-59ff6057b7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:04.991215 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe2820-ca25-4360-a936-59ff6057b7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:04.991742 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe2820-ca25-4360-a936-59ff6057b7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:04.992772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe2820-ca25-4360-a936-59ff6057b7a4 admin admin] PATH_INFO: `/v3/users/2ddfe226191d48e685291af568629e45` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:04.994149 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe2820-ca25-4360-a936-59ff6057b7a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ddfe226191d48e685291af568629e45)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:04.996510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe2820-ca25-4360-a936-59ff6057b7a4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:05.259357 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-03fe2820-ca25-4360-a936-59ff6057b7a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ddfe226191d48e685291af568629e45'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:05.359854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-03fe2820-ca25-4360-a936-59ff6057b7a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ddfe226191d48e685291af568629e45'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:05.360579 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-03fe2820-ca25-4360-a936-59ff6057b7a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ddfe226191d48e685291af568629e45'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:05.361821 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-03fe2820-ca25-4360-a936-59ff6057b7a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ddfe226191d48e685291af568629e45'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:05.370520 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-03fe2820-ca25-4360-a936-59ff6057b7a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ddfe226191d48e685291af568629e45'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:05.388776 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1081/2123] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:04 2022] DELETE /identity/v3/users/2ddfe226191d48e685291af568629e45 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:05.392746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b3759-3e2c-46c6-ace8-81777aeee068 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:05.393542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b3759-3e2c-46c6-ace8-81777aeee068 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:05.393831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b3759-3e2c-46c6-ace8-81777aeee068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:05.415873 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-096b3759-3e2c-46c6-ace8-81777aeee068 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:05.417113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-096b3759-3e2c-46c6-ace8-81777aeee068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:05.479085 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1043/2124] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:05.489154 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe2820-ca25-4360-a936-59ff6057b7a4 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:05.496987 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-03fe2820-ca25-4360-a936-59ff6057b7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:05.532987 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b3759-3e2c-46c6-ace8-81777aeee068 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:05.534524 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-096b3759-3e2c-46c6-ace8-81777aeee068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:05.550100 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b3759-3e2c-46c6-ace8-81777aeee068 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:05.570597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f8064-cc8e-490c-a645-d6821b7af864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:05.570597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f8064-cc8e-490c-a645-d6821b7af864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:05.570597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f8064-cc8e-490c-a645-d6821b7af864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:05.570597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f8064-cc8e-490c-a645-d6821b7af864 admin admin] PATH_INFO: `/v3/projects/869a928458b442d2ac37ef089c96d280` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:05.571472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f8064-cc8e-490c-a645-d6821b7af864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=869a928458b442d2ac37ef089c96d280)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:05.573916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f8064-cc8e-490c-a645-d6821b7af864 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:05.582880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe2820-ca25-4360-a936-59ff6057b7a4 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:05.587442 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f9764-c259-4c7a-a743-862f6efa2581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:05.588066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f9764-c259-4c7a-a743-862f6efa2581 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:05.588354 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f9764-c259-4c7a-a743-862f6efa2581 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:05.588662 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f9764-c259-4c7a-a743-862f6efa2581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:05.602014 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f9764-c259-4c7a-a743-862f6efa2581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:05.604040 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f9764-c259-4c7a-a743-862f6efa2581 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:05.615329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1082/2125] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:05.645472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:05.696319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-151f8064-cc8e-490c-a645-d6821b7af864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869a928458b442d2ac37ef089c96d280', 'request_id': 'req-151f8064-cc8e-490c-a645-d6821b7af864'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:05.702884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-151f8064-cc8e-490c-a645-d6821b7af864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869a928458b442d2ac37ef089c96d280', 'request_id': 'req-151f8064-cc8e-490c-a645-d6821b7af864'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:05.798590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-151f8064-cc8e-490c-a645-d6821b7af864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869a928458b442d2ac37ef089c96d280', 'request_id': 'req-151f8064-cc8e-490c-a645-d6821b7af864'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:05.845251 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-151f8064-cc8e-490c-a645-d6821b7af864 admin admin] The token cache is being invalidate because project 869a928458b442d2ac37ef089c96d280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:05.845705 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-151f8064-cc8e-490c-a645-d6821b7af864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:05.847647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-151f8064-cc8e-490c-a645-d6821b7af864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:05.852673 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1044/2126] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:05 2022] DELETE /identity/v3/projects/869a928458b442d2ac37ef089c96d280 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:05.859832 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f9764-c259-4c7a-a743-862f6efa2581 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:05.873378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f9764-c259-4c7a-a743-862f6efa2581 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:05.909866 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:05.939877 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57258d3d-b50e-46db-9d0f-9bfad2d509e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:05.940928 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57258d3d-b50e-46db-9d0f-9bfad2d509e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:05.941342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57258d3d-b50e-46db-9d0f-9bfad2d509e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:05.942065 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57258d3d-b50e-46db-9d0f-9bfad2d509e2 admin admin] PATH_INFO: `/v3/users/8499173f962a48f19826f58e637bb315` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:05.943562 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57258d3d-b50e-46db-9d0f-9bfad2d509e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8499173f962a48f19826f58e637bb315)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:05.945759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57258d3d-b50e-46db-9d0f-9bfad2d509e2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:06.123542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f8064-cc8e-490c-a645-d6821b7af864 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:06.125148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-151f8064-cc8e-490c-a645-d6821b7af864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:06.157049 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f8064-cc8e-490c-a645-d6821b7af864 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:06.163192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb54ca-7a31-45d5-9acc-9e3184ba659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:06.164665 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb54ca-7a31-45d5-9acc-9e3184ba659c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:06.165131 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb54ca-7a31-45d5-9acc-9e3184ba659c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:06.165651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb54ca-7a31-45d5-9acc-9e3184ba659c admin admin] PATH_INFO: `/v3/projects/18faa87aebd14fe7abaf43c0a5fcd2da` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:06.167038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb54ca-7a31-45d5-9acc-9e3184ba659c admin admin] RBAC: Authorizing `identity:delete_project(project_id=18faa87aebd14fe7abaf43c0a5fcd2da)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:06.169262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb54ca-7a31-45d5-9acc-9e3184ba659c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:06.192490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-57258d3d-b50e-46db-9d0f-9bfad2d509e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8499173f962a48f19826f58e637bb315'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:06.318688 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-57258d3d-b50e-46db-9d0f-9bfad2d509e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8499173f962a48f19826f58e637bb315'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:06.319517 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-57258d3d-b50e-46db-9d0f-9bfad2d509e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8499173f962a48f19826f58e637bb315'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:06.320881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-57258d3d-b50e-46db-9d0f-9bfad2d509e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8499173f962a48f19826f58e637bb315'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:06.330707 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-57258d3d-b50e-46db-9d0f-9bfad2d509e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8499173f962a48f19826f58e637bb315'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:06.354315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-27cb54ca-7a31-45d5-9acc-9e3184ba659c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18faa87aebd14fe7abaf43c0a5fcd2da', 'request_id': 'req-27cb54ca-7a31-45d5-9acc-9e3184ba659c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:06.354315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-27cb54ca-7a31-45d5-9acc-9e3184ba659c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18faa87aebd14fe7abaf43c0a5fcd2da', 'request_id': 'req-27cb54ca-7a31-45d5-9acc-9e3184ba659c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:06.364117 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1083/2127] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:05 2022] DELETE /identity/v3/users/8499173f962a48f19826f58e637bb315 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:06.471927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-27cb54ca-7a31-45d5-9acc-9e3184ba659c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18faa87aebd14fe7abaf43c0a5fcd2da', 'request_id': 'req-27cb54ca-7a31-45d5-9acc-9e3184ba659c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:06.488593 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-27cb54ca-7a31-45d5-9acc-9e3184ba659c admin admin] The token cache is being invalidate because project 18faa87aebd14fe7abaf43c0a5fcd2da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:06.489115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-27cb54ca-7a31-45d5-9acc-9e3184ba659c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:06.490479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-27cb54ca-7a31-45d5-9acc-9e3184ba659c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:06.492698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1045/2128] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:06 2022] DELETE /identity/v3/projects/18faa87aebd14fe7abaf43c0a5fcd2da => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:06.497723 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57258d3d-b50e-46db-9d0f-9bfad2d509e2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:06.499780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-57258d3d-b50e-46db-9d0f-9bfad2d509e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:06.636398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57258d3d-b50e-46db-9d0f-9bfad2d509e2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:06.641319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0553410-c047-4d42-8f56-9429e55e7c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:06.642384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0553410-c047-4d42-8f56-9429e55e7c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:06.642384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0553410-c047-4d42-8f56-9429e55e7c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:06.642384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0553410-c047-4d42-8f56-9429e55e7c70 admin admin] PATH_INFO: `/v3/users/0a6b8e3e17904b6d949d16f600bc10d9` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:06.643548 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0553410-c047-4d42-8f56-9429e55e7c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6b8e3e17904b6d949d16f600bc10d9)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:06.645533 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0553410-c047-4d42-8f56-9429e55e7c70 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:06.692724 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:06.894070 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e0553410-c047-4d42-8f56-9429e55e7c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6b8e3e17904b6d949d16f600bc10d9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:06.921920 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb54ca-7a31-45d5-9acc-9e3184ba659c admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:06.924512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-27cb54ca-7a31-45d5-9acc-9e3184ba659c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:06.964777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e0553410-c047-4d42-8f56-9429e55e7c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6b8e3e17904b6d949d16f600bc10d9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:06.966340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e0553410-c047-4d42-8f56-9429e55e7c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6b8e3e17904b6d949d16f600bc10d9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:06.967123 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e0553410-c047-4d42-8f56-9429e55e7c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6b8e3e17904b6d949d16f600bc10d9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:06.980924 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-e0553410-c047-4d42-8f56-9429e55e7c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6b8e3e17904b6d949d16f600bc10d9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:07.003427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1084/2129] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:06 2022] DELETE /identity/v3/users/0a6b8e3e17904b6d949d16f600bc10d9 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:07.044303 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:07.060169 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb54ca-7a31-45d5-9acc-9e3184ba659c admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:07.168056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7aa2b-92b0-4a7b-a9a2-065e349165f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:07.168827 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7aa2b-92b0-4a7b-a9a2-065e349165f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:07.169348 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7aa2b-92b0-4a7b-a9a2-065e349165f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:07.169793 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7aa2b-92b0-4a7b-a9a2-065e349165f0 admin admin] PATH_INFO: `/v3/projects/f8c39052ea044ed89cd3b3d254e2851d` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:07.171065 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7aa2b-92b0-4a7b-a9a2-065e349165f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c39052ea044ed89cd3b3d254e2851d)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:07.173115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7aa2b-92b0-4a7b-a9a2-065e349165f0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:07.339364 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6fe7aa2b-92b0-4a7b-a9a2-065e349165f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c39052ea044ed89cd3b3d254e2851d', 'request_id': 'req-6fe7aa2b-92b0-4a7b-a9a2-065e349165f0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:07.346995 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6fe7aa2b-92b0-4a7b-a9a2-065e349165f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c39052ea044ed89cd3b3d254e2851d', 'request_id': 'req-6fe7aa2b-92b0-4a7b-a9a2-065e349165f0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:07.438590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6fe7aa2b-92b0-4a7b-a9a2-065e349165f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c39052ea044ed89cd3b3d254e2851d', 'request_id': 'req-6fe7aa2b-92b0-4a7b-a9a2-065e349165f0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:07.456540 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6fe7aa2b-92b0-4a7b-a9a2-065e349165f0 admin admin] The token cache is being invalidate because project f8c39052ea044ed89cd3b3d254e2851d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:07.456949 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6fe7aa2b-92b0-4a7b-a9a2-065e349165f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:07.457702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6fe7aa2b-92b0-4a7b-a9a2-065e349165f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:07.466900 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1416b95-a5b8-424d-9be3-5f32bc594271 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:07.467318 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1416b95-a5b8-424d-9be3-5f32bc594271 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:07.467693 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1416b95-a5b8-424d-9be3-5f32bc594271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:07.470771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1046/2130] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:06 2022] DELETE /identity/v3/projects/f8c39052ea044ed89cd3b3d254e2851d => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:07.490219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b1416b95-a5b8-424d-9be3-5f32bc594271 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:07.491749 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b1416b95-a5b8-424d-9be3-5f32bc594271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:07.580648 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29097770-8936-408f-85c6-1e6b9f0aeeda None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:07.581747 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29097770-8936-408f-85c6-1e6b9f0aeeda None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:07.582182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29097770-8936-408f-85c6-1e6b9f0aeeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:07.587703 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1085/2131] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:07.609848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-29097770-8936-408f-85c6-1e6b9f0aeeda None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:07.611625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-29097770-8936-408f-85c6-1e6b9f0aeeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:07.632438 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1047/2132] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:07.636765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1416b95-a5b8-424d-9be3-5f32bc594271 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:07.653720 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1416b95-a5b8-424d-9be3-5f32bc594271 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:07.679321 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c302c0-221c-42a6-ad35-c4f159ab2892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:07.679974 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c302c0-221c-42a6-ad35-c4f159ab2892 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:07.680261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c302c0-221c-42a6-ad35-c4f159ab2892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:07.680595 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c302c0-221c-42a6-ad35-c4f159ab2892 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:07.681267 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c302c0-221c-42a6-ad35-c4f159ab2892 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:19:07.681645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c302c0-221c-42a6-ad35-c4f159ab2892 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:07.683487 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c302c0-221c-42a6-ad35-c4f159ab2892 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:07.706637 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29097770-8936-408f-85c6-1e6b9f0aeeda None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:07.717160 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1086/2133] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:19:07.718532 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29097770-8936-408f-85c6-1e6b9f0aeeda None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:07.724496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285494b9-e59f-407f-b075-b767ca9518f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:07.725554 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285494b9-e59f-407f-b075-b767ca9518f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:07.726112 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285494b9-e59f-407f-b075-b767ca9518f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:07.726390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285494b9-e59f-407f-b075-b767ca9518f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:07.727085 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285494b9-e59f-407f-b075-b767ca9518f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:07.729297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285494b9-e59f-407f-b075-b767ca9518f4 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:07.762950 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c302c0-221c-42a6-ad35-c4f159ab2892 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:07.764975 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-51c302c0-221c-42a6-ad35-c4f159ab2892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:07.780521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c302c0-221c-42a6-ad35-c4f159ab2892 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:07.795947 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebd13d-1eb9-48d3-87fa-86a224f40eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:07.795947 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebd13d-1eb9-48d3-87fa-86a224f40eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:07.795947 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebd13d-1eb9-48d3-87fa-86a224f40eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:07.795947 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebd13d-1eb9-48d3-87fa-86a224f40eac admin admin] PATH_INFO: `/v3/projects/4c93975eede94add84e92e26a0506b15` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:07.797037 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebd13d-1eb9-48d3-87fa-86a224f40eac admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c93975eede94add84e92e26a0506b15)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:07.799520 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebd13d-1eb9-48d3-87fa-86a224f40eac admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:07.846043 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:07.856383 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1048/2134] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:19:07 2022] POST /identity/v3/projects => generated 399 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:19:07.861041 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285494b9-e59f-407f-b075-b767ca9518f4 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:07.964177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285494b9-e59f-407f-b075-b767ca9518f4 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:07.972000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09c028-46bb-4f75-bb0a-f82f590b63b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:07.972641 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09c028-46bb-4f75-bb0a-f82f590b63b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:07.972938 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09c028-46bb-4f75-bb0a-f82f590b63b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:07.973200 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09c028-46bb-4f75-bb0a-f82f590b63b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:07.973879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09c028-46bb-4f75-bb0a-f82f590b63b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:07.977802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09c028-46bb-4f75-bb0a-f82f590b63b0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:07.989850 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2bebd13d-1eb9-48d3-87fa-86a224f40eac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c93975eede94add84e92e26a0506b15', 'request_id': 'req-2bebd13d-1eb9-48d3-87fa-86a224f40eac'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:07.997653 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2bebd13d-1eb9-48d3-87fa-86a224f40eac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c93975eede94add84e92e26a0506b15', 'request_id': 'req-2bebd13d-1eb9-48d3-87fa-86a224f40eac'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:08.087142 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2bebd13d-1eb9-48d3-87fa-86a224f40eac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c93975eede94add84e92e26a0506b15', 'request_id': 'req-2bebd13d-1eb9-48d3-87fa-86a224f40eac'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:08.095717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1049/2135] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:19:07 2022] POST /identity/v3/users => generated 300 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:19:08.099003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09c028-46bb-4f75-bb0a-f82f590b63b0 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:08.111814 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2bebd13d-1eb9-48d3-87fa-86a224f40eac admin admin] The token cache is being invalidate because project 4c93975eede94add84e92e26a0506b15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:08.112304 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2bebd13d-1eb9-48d3-87fa-86a224f40eac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:08.117703 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2bebd13d-1eb9-48d3-87fa-86a224f40eac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:08.118142 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09c028-46bb-4f75-bb0a-f82f590b63b0 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:08.120322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1087/2136] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:07 2022] DELETE /identity/v3/projects/4c93975eede94add84e92e26a0506b15 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:08.132570 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebd13d-1eb9-48d3-87fa-86a224f40eac admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:08.134731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2bebd13d-1eb9-48d3-87fa-86a224f40eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:08.173407 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:08.208101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0728375-d9b3-440f-8492-f0c3ca047d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:08.208716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0728375-d9b3-440f-8492-f0c3ca047d4e admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:08.209565 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0728375-d9b3-440f-8492-f0c3ca047d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:08.209875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0728375-d9b3-440f-8492-f0c3ca047d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:08.210728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0728375-d9b3-440f-8492-f0c3ca047d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:08.212178 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebd13d-1eb9-48d3-87fa-86a224f40eac admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:08.212371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0728375-d9b3-440f-8492-f0c3ca047d4e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:08.224812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eeac2f-1793-462c-afdd-8cbca55053ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:08.225980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eeac2f-1793-462c-afdd-8cbca55053ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:08.226546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eeac2f-1793-462c-afdd-8cbca55053ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:08.227043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eeac2f-1793-462c-afdd-8cbca55053ff admin admin] PATH_INFO: `/v3/users/b2dfefa09bd14fb0bbb54db465da73e0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:08.227391 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1050/2137] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:19:08.228744 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0728375-d9b3-440f-8492-f0c3ca047d4e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:08.229958 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eeac2f-1793-462c-afdd-8cbca55053ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2dfefa09bd14fb0bbb54db465da73e0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:08.230445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b0728375-d9b3-440f-8492-f0c3ca047d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:08.233725 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eeac2f-1793-462c-afdd-8cbca55053ff admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:08.244217 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0728375-d9b3-440f-8492-f0c3ca047d4e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:08.260467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e4fa4-87de-49a0-87f6-830fe2ce7b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:08.261093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e4fa4-87de-49a0-87f6-830fe2ce7b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:08.261374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e4fa4-87de-49a0-87f6-830fe2ce7b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:08.261704 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e4fa4-87de-49a0-87f6-830fe2ce7b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:08.262356 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e4fa4-87de-49a0-87f6-830fe2ce7b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:08.263989 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e4fa4-87de-49a0-87f6-830fe2ce7b86 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:08.275525 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1051/2138] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:08.286345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e4fa4-87de-49a0-87f6-830fe2ce7b86 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:08.295801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e4fa4-87de-49a0-87f6-830fe2ce7b86 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:08.304167 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e61a56-3585-4590-a090-da84761d09af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:08.304167 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e61a56-3585-4590-a090-da84761d09af admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:08.304167 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e61a56-3585-4590-a090-da84761d09af admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:08.304167 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e61a56-3585-4590-a090-da84761d09af admin admin] PATH_INFO: `/v3/projects/9864fb4362cb4118b21800da17e52452/users/8c178b3425cb40c9aa8f9017a91540e8/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:08.320661 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e61a56-3585-4590-a090-da84761d09af admin admin] RBAC: Authorizing `identity:create_grant(project_id=9864fb4362cb4118b21800da17e52452, user_id=8c178b3425cb40c9aa8f9017a91540e8, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:08.323795 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e61a56-3585-4590-a090-da84761d09af admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:08.402594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1052/2139] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:08 2022] PUT /identity/v3/projects/9864fb4362cb4118b21800da17e52452/users/8c178b3425cb40c9aa8f9017a91540e8/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:08.414398 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2021d-7b19-44d3-ada2-44d74bddc544 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:08.414687 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2021d-7b19-44d3-ada2-44d74bddc544 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:08.414961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2021d-7b19-44d3-ada2-44d74bddc544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:08.456662 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-62eeac2f-1793-462c-afdd-8cbca55053ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2dfefa09bd14fb0bbb54db465da73e0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:08.460456 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-30b2021d-7b19-44d3-ada2-44d74bddc544 None None] MFA Rules not processed for user `8c178b3425cb40c9aa8f9017a91540e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:08.462530 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-30b2021d-7b19-44d3-ada2-44d74bddc544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:08.520573 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-62eeac2f-1793-462c-afdd-8cbca55053ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2dfefa09bd14fb0bbb54db465da73e0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:08.521340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-62eeac2f-1793-462c-afdd-8cbca55053ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2dfefa09bd14fb0bbb54db465da73e0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:08.522719 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-62eeac2f-1793-462c-afdd-8cbca55053ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2dfefa09bd14fb0bbb54db465da73e0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:08.535422 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-62eeac2f-1793-462c-afdd-8cbca55053ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2dfefa09bd14fb0bbb54db465da73e0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:08.561574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1088/2140] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:08 2022] DELETE /identity/v3/users/b2dfefa09bd14fb0bbb54db465da73e0 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:08.574348 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1053/2141] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:08.587916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eeac2f-1793-462c-afdd-8cbca55053ff admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:08.589717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-62eeac2f-1793-462c-afdd-8cbca55053ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:08.672938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eeac2f-1793-462c-afdd-8cbca55053ff admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:08.676937 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e2380-d189-4fc1-97ab-1df4bb9a1aca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:08.677584 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e2380-d189-4fc1-97ab-1df4bb9a1aca service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:08.678384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e2380-d189-4fc1-97ab-1df4bb9a1aca service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:08.678888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e2380-d189-4fc1-97ab-1df4bb9a1aca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:08.735374 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e2380-d189-4fc1-97ab-1df4bb9a1aca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:08.736556 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e2380-d189-4fc1-97ab-1df4bb9a1aca service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:08.746825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1089/2142] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:08 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:08.766757 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:09.243307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2021d-7b19-44d3-ada2-44d74bddc544 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:09.244964 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-30b2021d-7b19-44d3-ada2-44d74bddc544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:09.298175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:09.382627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2021d-7b19-44d3-ada2-44d74bddc544 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:09.426092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:09.465075 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a98fbb-288f-4cdd-823b-9434e44147c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:09.465841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a98fbb-288f-4cdd-823b-9434e44147c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:09.466194 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a98fbb-288f-4cdd-823b-9434e44147c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:09.466671 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a98fbb-288f-4cdd-823b-9434e44147c8 admin admin] PATH_INFO: `/v3/projects/1afd64b4a4a042f1bf304094c0c37970` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:09.468789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a98fbb-288f-4cdd-823b-9434e44147c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1afd64b4a4a042f1bf304094c0c37970)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:09.471938 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a98fbb-288f-4cdd-823b-9434e44147c8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:09.647441 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b5a98fbb-288f-4cdd-823b-9434e44147c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1afd64b4a4a042f1bf304094c0c37970', 'request_id': 'req-b5a98fbb-288f-4cdd-823b-9434e44147c8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:09.652961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b5a98fbb-288f-4cdd-823b-9434e44147c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1afd64b4a4a042f1bf304094c0c37970', 'request_id': 'req-b5a98fbb-288f-4cdd-823b-9434e44147c8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:09.735991 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b5a98fbb-288f-4cdd-823b-9434e44147c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1afd64b4a4a042f1bf304094c0c37970', 'request_id': 'req-b5a98fbb-288f-4cdd-823b-9434e44147c8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:09.752758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b5a98fbb-288f-4cdd-823b-9434e44147c8 admin admin] The token cache is being invalidate because project 1afd64b4a4a042f1bf304094c0c37970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:09.753146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b5a98fbb-288f-4cdd-823b-9434e44147c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:09.753908 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b5a98fbb-288f-4cdd-823b-9434e44147c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:09.755398 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1054/2143] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:09 2022] DELETE /identity/v3/projects/1afd64b4a4a042f1bf304094c0c37970 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:09.761488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac08fa3-f888-4108-bfe2-babd7a9493ae None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:09.761947 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac08fa3-f888-4108-bfe2-babd7a9493ae None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:09.762366 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac08fa3-f888-4108-bfe2-babd7a9493ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:09.782368 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2ac08fa3-f888-4108-bfe2-babd7a9493ae None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:09.783656 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2ac08fa3-f888-4108-bfe2-babd7a9493ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:09.828087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:09.860990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1090/2144] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:09.862706 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c27e3e-7ab2-49c6-ba2f-18740e39180d None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:09.863182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c27e3e-7ab2-49c6-ba2f-18740e39180d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:09.863401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c27e3e-7ab2-49c6-ba2f-18740e39180d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:09.897481 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-24c27e3e-7ab2-49c6-ba2f-18740e39180d None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:09.900133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-24c27e3e-7ab2-49c6-ba2f-18740e39180d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:09.909193 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1055/2145] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:09.915088 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac08fa3-f888-4108-bfe2-babd7a9493ae None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:09.930242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac08fa3-f888-4108-bfe2-babd7a9493ae None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:09.957073 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19e4de-05e6-4d61-9e04-51c71792c60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:09.957808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19e4de-05e6-4d61-9e04-51c71792c60f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:09.958156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19e4de-05e6-4d61-9e04-51c71792c60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:09.958523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19e4de-05e6-4d61-9e04-51c71792c60f admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:09.959447 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19e4de-05e6-4d61-9e04-51c71792c60f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:19:09.959912 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19e4de-05e6-4d61-9e04-51c71792c60f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:09.961946 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19e4de-05e6-4d61-9e04-51c71792c60f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:09.989310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1091/2146] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:19:09.995882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c27e3e-7ab2-49c6-ba2f-18740e39180d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:10.008771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c27e3e-7ab2-49c6-ba2f-18740e39180d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:10.019206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844831f1-9f6a-472c-8dde-ae9b2e078fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:10.021133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844831f1-9f6a-472c-8dde-ae9b2e078fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:10.021425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844831f1-9f6a-472c-8dde-ae9b2e078fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:10.023421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844831f1-9f6a-472c-8dde-ae9b2e078fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:10.029799 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844831f1-9f6a-472c-8dde-ae9b2e078fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:10.029799 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844831f1-9f6a-472c-8dde-ae9b2e078fa8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:10.062952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b0d5d-a959-45b7-8536-dacec957bc5e None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:10.063213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b0d5d-a959-45b7-8536-dacec957bc5e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:10.063482 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b0d5d-a959-45b7-8536-dacec957bc5e None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:10.064839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1092/2147] 10.222.0.65 () {54 vars in 921 bytes} [Tue Aug 9 19:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 19:19:10.093215 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec5b55-203c-4f95-934a-0a0508a66608 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:10.093759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec5b55-203c-4f95-934a-0a0508a66608 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:10.094239 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec5b55-203c-4f95-934a-0a0508a66608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:10.116175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b5ec5b55-203c-4f95-934a-0a0508a66608 None None] MFA Rules not processed for user `c6172f0733384291992624ef6a527ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:10.117392 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b5ec5b55-203c-4f95-934a-0a0508a66608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:10.156191 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1056/2148] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:19:09 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:19:10.158765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844831f1-9f6a-472c-8dde-ae9b2e078fa8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:10.217358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1093/2149] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Aug 9 19:19:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:10.221111 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec5b55-203c-4f95-934a-0a0508a66608 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:10.223040 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b5ec5b55-203c-4f95-934a-0a0508a66608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:10.247355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec5b55-203c-4f95-934a-0a0508a66608 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:10.255751 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377138a-e9ea-4e61-80aa-70e48c2e2449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:10.255751 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377138a-e9ea-4e61-80aa-70e48c2e2449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:10.255751 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377138a-e9ea-4e61-80aa-70e48c2e2449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:10.255751 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377138a-e9ea-4e61-80aa-70e48c2e2449 admin admin] PATH_INFO: `/v3/users/217925e91ea74413b2cb2052bbb523fa` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:10.256105 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844831f1-9f6a-472c-8dde-ae9b2e078fa8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:10.256514 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377138a-e9ea-4e61-80aa-70e48c2e2449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=217925e91ea74413b2cb2052bbb523fa)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:10.258716 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377138a-e9ea-4e61-80aa-70e48c2e2449 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:10.263244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9331a5-c9f6-4d26-9994-e1820ab4c0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:10.263890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9331a5-c9f6-4d26-9994-e1820ab4c0bb admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:10.264166 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9331a5-c9f6-4d26-9994-e1820ab4c0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:10.264433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9331a5-c9f6-4d26-9994-e1820ab4c0bb admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:10.265324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9331a5-c9f6-4d26-9994-e1820ab4c0bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:10.267652 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9331a5-c9f6-4d26-9994-e1820ab4c0bb admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:10.433711 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1057/2150] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:19:10 2022] POST /identity/v3/users => generated 291 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:19:10.434555 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9331a5-c9f6-4d26-9994-e1820ab4c0bb admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:10.436165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1f9331a5-c9f6-4d26-9994-e1820ab4c0bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:10.485086 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:10.519392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9331a5-c9f6-4d26-9994-e1820ab4c0bb admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:10.526771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1377138a-e9ea-4e61-80aa-70e48c2e2449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '217925e91ea74413b2cb2052bbb523fa'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:10.527281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf2de1-4932-415e-94a5-8566c6bf66fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6172f0733384291992624ef6a527ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:10.528092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf2de1-4932-415e-94a5-8566c6bf66fe service placement] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:10.528549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf2de1-4932-415e-94a5-8566c6bf66fe service placement] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:10.528813 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf2de1-4932-415e-94a5-8566c6bf66fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:10.541613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf2de1-4932-415e-94a5-8566c6bf66fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:10.543211 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf2de1-4932-415e-94a5-8566c6bf66fe service placement] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:10.562858 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1058/2151] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:10.564675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf2de1-4932-415e-94a5-8566c6bf66fe service placement] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:10.609552 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf2de1-4932-415e-94a5-8566c6bf66fe service placement] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:10.617052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1377138a-e9ea-4e61-80aa-70e48c2e2449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '217925e91ea74413b2cb2052bbb523fa'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:10.617883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1377138a-e9ea-4e61-80aa-70e48c2e2449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '217925e91ea74413b2cb2052bbb523fa'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:10.618681 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb723e-0d4e-4218-a153-751550b2b827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:10.618920 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1377138a-e9ea-4e61-80aa-70e48c2e2449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '217925e91ea74413b2cb2052bbb523fa'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:10.619694 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb723e-0d4e-4218-a153-751550b2b827 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:10.620067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb723e-0d4e-4218-a153-751550b2b827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:10.620458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb723e-0d4e-4218-a153-751550b2b827 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:10.621341 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb723e-0d4e-4218-a153-751550b2b827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:10.623402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb723e-0d4e-4218-a153-751550b2b827 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:10.628062 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-1377138a-e9ea-4e61-80aa-70e48c2e2449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '217925e91ea74413b2cb2052bbb523fa'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:10.643441 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1059/2152] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:10.644976 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb723e-0d4e-4218-a153-751550b2b827 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:10.647681 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1094/2153] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:10 2022] DELETE /identity/v3/users/217925e91ea74413b2cb2052bbb523fa => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:10.647979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e5eb723e-0d4e-4218-a153-751550b2b827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:10.667722 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb723e-0d4e-4218-a153-751550b2b827 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:10.755307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc63d03-b398-44c6-8b64-d59c39a80577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:10.757370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc63d03-b398-44c6-8b64-d59c39a80577 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:10.757370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc63d03-b398-44c6-8b64-d59c39a80577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:10.762194 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc63d03-b398-44c6-8b64-d59c39a80577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:10.762194 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc63d03-b398-44c6-8b64-d59c39a80577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:10.762194 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc63d03-b398-44c6-8b64-d59c39a80577 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:10.774912 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1060/2154] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:10.778831 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377138a-e9ea-4e61-80aa-70e48c2e2449 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:10.792340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377138a-e9ea-4e61-80aa-70e48c2e2449 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:10.797966 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808da5bc-4afb-405b-b0e1-a381985a5c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:10.799237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808da5bc-4afb-405b-b0e1-a381985a5c1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:10.799827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808da5bc-4afb-405b-b0e1-a381985a5c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:10.800118 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808da5bc-4afb-405b-b0e1-a381985a5c1b admin admin] PATH_INFO: `/v3/projects/3c07144ed49c44cfb77942a4b07b8941/users/1337e6e7fcd04e89970b2769fc942321/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:10.824779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808da5bc-4afb-405b-b0e1-a381985a5c1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c07144ed49c44cfb77942a4b07b8941, user_id=1337e6e7fcd04e89970b2769fc942321, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:10.827565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808da5bc-4afb-405b-b0e1-a381985a5c1b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:10.956514 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1095/2155] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:10 2022] PUT /identity/v3/projects/3c07144ed49c44cfb77942a4b07b8941/users/1337e6e7fcd04e89970b2769fc942321/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:10.969277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677835a1-da0f-44f9-b3ef-36ad7bfc1517 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:10.970146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677835a1-da0f-44f9-b3ef-36ad7bfc1517 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:10.970453 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677835a1-da0f-44f9-b3ef-36ad7bfc1517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:11.001775 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808da5bc-4afb-405b-b0e1-a381985a5c1b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:11.003947 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-808da5bc-4afb-405b-b0e1-a381985a5c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:11.067347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-677835a1-da0f-44f9-b3ef-36ad7bfc1517 None None] MFA Rules not processed for user `1337e6e7fcd04e89970b2769fc942321`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:11.074589 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-677835a1-da0f-44f9-b3ef-36ad7bfc1517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:11.146895 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808da5bc-4afb-405b-b0e1-a381985a5c1b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:11.153738 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d917c-011b-4a66-9c4b-3e0d057c7387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:11.154451 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d917c-011b-4a66-9c4b-3e0d057c7387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:11.154733 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d917c-011b-4a66-9c4b-3e0d057c7387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:11.155003 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d917c-011b-4a66-9c4b-3e0d057c7387 admin admin] PATH_INFO: `/v3/projects/1e0ed081fca4438f9fc2f9c1164ae93c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:11.156619 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d917c-011b-4a66-9c4b-3e0d057c7387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e0ed081fca4438f9fc2f9c1164ae93c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:11.158665 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d917c-011b-4a66-9c4b-3e0d057c7387 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:11.184031 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1061/2156] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:11.188621 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677835a1-da0f-44f9-b3ef-36ad7bfc1517 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:11.217273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677835a1-da0f-44f9-b3ef-36ad7bfc1517 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:11.222457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4103fb-552b-48dd-a008-65824935fd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:11.223074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4103fb-552b-48dd-a008-65824935fd19 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:11.223352 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4103fb-552b-48dd-a008-65824935fd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:11.223699 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4103fb-552b-48dd-a008-65824935fd19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:11.224532 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4103fb-552b-48dd-a008-65824935fd19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:11.226818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4103fb-552b-48dd-a008-65824935fd19 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:11.303674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-805d917c-011b-4a66-9c4b-3e0d057c7387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e0ed081fca4438f9fc2f9c1164ae93c', 'request_id': 'req-805d917c-011b-4a66-9c4b-3e0d057c7387'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:11.309020 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-805d917c-011b-4a66-9c4b-3e0d057c7387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e0ed081fca4438f9fc2f9c1164ae93c', 'request_id': 'req-805d917c-011b-4a66-9c4b-3e0d057c7387'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:11.318807 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:11.326906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1062/2157] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:19:11 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:19:11.330849 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4103fb-552b-48dd-a008-65824935fd19 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:11.394871 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4103fb-552b-48dd-a008-65824935fd19 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:11.400954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536dac83-6091-447b-9310-c7bc41d894de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:11.401631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dac83-6091-447b-9310-c7bc41d894de admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:11.401912 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dac83-6091-447b-9310-c7bc41d894de admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:11.402191 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dac83-6091-447b-9310-c7bc41d894de admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:11.402812 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536dac83-6091-447b-9310-c7bc41d894de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:11.407134 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536dac83-6091-447b-9310-c7bc41d894de admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:11.428796 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-805d917c-011b-4a66-9c4b-3e0d057c7387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e0ed081fca4438f9fc2f9c1164ae93c', 'request_id': 'req-805d917c-011b-4a66-9c4b-3e0d057c7387'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:11.442679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-805d917c-011b-4a66-9c4b-3e0d057c7387 admin admin] The token cache is being invalidate because project 1e0ed081fca4438f9fc2f9c1164ae93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:11.443051 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-805d917c-011b-4a66-9c4b-3e0d057c7387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:11.444519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-805d917c-011b-4a66-9c4b-3e0d057c7387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:11.446690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1096/2158] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:11 2022] DELETE /identity/v3/projects/1e0ed081fca4438f9fc2f9c1164ae93c => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:11.451473 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd3e15-ef57-44bf-89a8-3c66fd4c0826 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:11.451876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd3e15-ef57-44bf-89a8-3c66fd4c0826 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:11.452373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd3e15-ef57-44bf-89a8-3c66fd4c0826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:11.474566 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-95cd3e15-ef57-44bf-89a8-3c66fd4c0826 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:11.475986 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-95cd3e15-ef57-44bf-89a8-3c66fd4c0826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:11.485347 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1097/2159] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:11.493118 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fbecb-f4e4-44a6-a273-aaa20d7526ab None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:11.493409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fbecb-f4e4-44a6-a273-aaa20d7526ab None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:11.493718 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fbecb-f4e4-44a6-a273-aaa20d7526ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:11.512570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1063/2160] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:19:11 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:19:11.516480 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536dac83-6091-447b-9310-c7bc41d894de admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:11.518217 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-536dac83-6091-447b-9310-c7bc41d894de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:11.524503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-038fbecb-f4e4-44a6-a273-aaa20d7526ab None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:11.525939 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-038fbecb-f4e4-44a6-a273-aaa20d7526ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:11.532837 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536dac83-6091-447b-9310-c7bc41d894de admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:11.534461 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1098/2161] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:11.539668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fbecb-f4e4-44a6-a273-aaa20d7526ab None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:11.547751 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce29bc-07ae-452f-82a8-488cfaf5fd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:11.548538 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce29bc-07ae-452f-82a8-488cfaf5fd6e admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:11.548828 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce29bc-07ae-452f-82a8-488cfaf5fd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:11.549641 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce29bc-07ae-452f-82a8-488cfaf5fd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:11.550490 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce29bc-07ae-452f-82a8-488cfaf5fd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:11.552493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce29bc-07ae-452f-82a8-488cfaf5fd6e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:11.561674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fbecb-f4e4-44a6-a273-aaa20d7526ab None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:11.568631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1064/2162] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:19:11.570156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b330096-c479-4736-a164-390b967212e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:11.570289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce29bc-07ae-452f-82a8-488cfaf5fd6e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:11.571856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b330096-c479-4736-a164-390b967212e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:11.572358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b330096-c479-4736-a164-390b967212e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:11.573482 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b330096-c479-4736-a164-390b967212e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:11.574360 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b330096-c479-4736-a164-390b967212e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:19:11.574872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b330096-c479-4736-a164-390b967212e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:11.576991 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b330096-c479-4736-a164-390b967212e9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:11.583395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce29bc-07ae-452f-82a8-488cfaf5fd6e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:11.593668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1099/2163] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:19:11.598482 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b330096-c479-4736-a164-390b967212e9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:11.601784 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74793bd-63d6-422f-b412-ad594d96a552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:11.602638 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74793bd-63d6-422f-b412-ad594d96a552 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:11.603100 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74793bd-63d6-422f-b412-ad594d96a552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:11.604490 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74793bd-63d6-422f-b412-ad594d96a552 admin admin] PATH_INFO: `/v3/projects/95eb2487890b4055bf8e9f1cf0ef2a68/users/8615b533f7e548e29ae9dfa55387b584/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:11.610334 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b330096-c479-4736-a164-390b967212e9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:11.617650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3a8c7-7721-4a52-ad06-eadc75483c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:11.619198 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3a8c7-7721-4a52-ad06-eadc75483c27 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:11.619480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3a8c7-7721-4a52-ad06-eadc75483c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:11.619756 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3a8c7-7721-4a52-ad06-eadc75483c27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:11.620403 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3a8c7-7721-4a52-ad06-eadc75483c27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:11.623264 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3a8c7-7721-4a52-ad06-eadc75483c27 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:11.627459 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74793bd-63d6-422f-b412-ad594d96a552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95eb2487890b4055bf8e9f1cf0ef2a68, user_id=8615b533f7e548e29ae9dfa55387b584, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:11.629487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74793bd-63d6-422f-b412-ad594d96a552 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:11.707262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1065/2164] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:11 2022] PUT /identity/v3/projects/95eb2487890b4055bf8e9f1cf0ef2a68/users/8615b533f7e548e29ae9dfa55387b584/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:11.708128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74793bd-63d6-422f-b412-ad594d96a552 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:11.740134 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1100/2165] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:19:11 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:19:11.750178 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3a8c7-7721-4a52-ad06-eadc75483c27 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:11.779879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74793bd-63d6-422f-b412-ad594d96a552 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:11.824205 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3a8c7-7721-4a52-ad06-eadc75483c27 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:11.829893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b4b38-ce59-4cad-8ffc-c039db918a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:11.829893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b4b38-ce59-4cad-8ffc-c039db918a29 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:11.833643 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b4b38-ce59-4cad-8ffc-c039db918a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:11.833643 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b4b38-ce59-4cad-8ffc-c039db918a29 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:11.833643 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b4b38-ce59-4cad-8ffc-c039db918a29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:11.833643 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b4b38-ce59-4cad-8ffc-c039db918a29 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:11.846984 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6917e60-27d0-44d4-884c-4c11ef2b9971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:11.847910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6917e60-27d0-44d4-884c-4c11ef2b9971 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:11.848324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6917e60-27d0-44d4-884c-4c11ef2b9971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:11.848683 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6917e60-27d0-44d4-884c-4c11ef2b9971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:11.849406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6917e60-27d0-44d4-884c-4c11ef2b9971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:11.851346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6917e60-27d0-44d4-884c-4c11ef2b9971 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:11.862471 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1066/2166] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:19:11.867158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6917e60-27d0-44d4-884c-4c11ef2b9971 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:11.877833 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6917e60-27d0-44d4-884c-4c11ef2b9971 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:11.883241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a9404-f387-4fbd-941d-64ed023bbc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:11.884052 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a9404-f387-4fbd-941d-64ed023bbc5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:11.884632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a9404-f387-4fbd-941d-64ed023bbc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:11.885017 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a9404-f387-4fbd-941d-64ed023bbc5b admin admin] PATH_INFO: `/v3/projects/95eb2487890b4055bf8e9f1cf0ef2a68/users/8615b533f7e548e29ae9dfa55387b584/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:11.887166 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a9404-f387-4fbd-941d-64ed023bbc5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=95eb2487890b4055bf8e9f1cf0ef2a68, user_id=8615b533f7e548e29ae9dfa55387b584, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:11.890095 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a9404-f387-4fbd-941d-64ed023bbc5b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:11.902168 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1067/2167] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:11 2022] PUT /identity/v3/projects/95eb2487890b4055bf8e9f1cf0ef2a68/users/8615b533f7e548e29ae9dfa55387b584/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:11.913308 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eca877-5897-4529-8705-cf103bc93c07 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:11.913625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eca877-5897-4529-8705-cf103bc93c07 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:11.914090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eca877-5897-4529-8705-cf103bc93c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:11.926122 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1101/2168] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:19:11 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:19:11.928270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b4b38-ce59-4cad-8ffc-c039db918a29 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:11.940001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b4b38-ce59-4cad-8ffc-c039db918a29 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:11.951507 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-76eca877-5897-4529-8705-cf103bc93c07 None None] MFA Rules not processed for user `8615b533f7e548e29ae9dfa55387b584`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:11.953103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-76eca877-5897-4529-8705-cf103bc93c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:12.011708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d554e0-0022-486b-9998-769ef8d2f360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:12.012326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d554e0-0022-486b-9998-769ef8d2f360 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:12.012606 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d554e0-0022-486b-9998-769ef8d2f360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:12.012888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d554e0-0022-486b-9998-769ef8d2f360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:12.013564 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d554e0-0022-486b-9998-769ef8d2f360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:12.015725 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d554e0-0022-486b-9998-769ef8d2f360 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:12.029083 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1102/2169] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:19:12.029276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1068/2170] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:12.044612 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d554e0-0022-486b-9998-769ef8d2f360 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:12.045356 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eca877-5897-4529-8705-cf103bc93c07 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:12.045356 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-76eca877-5897-4529-8705-cf103bc93c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:12.045931 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d554e0-0022-486b-9998-769ef8d2f360 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:12.048964 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2549c8-fadc-4279-b348-014cba424b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:12.049685 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2549c8-fadc-4279-b348-014cba424b96 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:12.049912 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2549c8-fadc-4279-b348-014cba424b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:12.050578 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2549c8-fadc-4279-b348-014cba424b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:12.051651 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2549c8-fadc-4279-b348-014cba424b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:12.054229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2549c8-fadc-4279-b348-014cba424b96 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:12.070577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1103/2171] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:12.072023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2549c8-fadc-4279-b348-014cba424b96 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:12.091212 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2549c8-fadc-4279-b348-014cba424b96 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:12.096709 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795aa5d-dc9b-423a-9b6e-3e35f7289ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:12.097475 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795aa5d-dc9b-423a-9b6e-3e35f7289ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:12.097774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795aa5d-dc9b-423a-9b6e-3e35f7289ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:12.098053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795aa5d-dc9b-423a-9b6e-3e35f7289ac0 admin admin] PATH_INFO: `/v3/projects/d57bb28290a542de9fdfd87824118442/users/740e3901a15d49ee9891858ebf7086e9/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:12.120376 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795aa5d-dc9b-423a-9b6e-3e35f7289ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57bb28290a542de9fdfd87824118442, user_id=740e3901a15d49ee9891858ebf7086e9, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:12.123007 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eca877-5897-4529-8705-cf103bc93c07 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:12.127515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795aa5d-dc9b-423a-9b6e-3e35f7289ac0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:12.133421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0100f10-8814-4fec-aa49-c6347e358c4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:12.141910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0100f10-8814-4fec-aa49-c6347e358c4c service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:12.142574 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0100f10-8814-4fec-aa49-c6347e358c4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:12.143011 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0100f10-8814-4fec-aa49-c6347e358c4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:12.163517 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0100f10-8814-4fec-aa49-c6347e358c4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:12.165671 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0100f10-8814-4fec-aa49-c6347e358c4c service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:12.176280 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1069/2172] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:19:12.219738 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1104/2173] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:12 2022] PUT /identity/v3/projects/d57bb28290a542de9fdfd87824118442/users/740e3901a15d49ee9891858ebf7086e9/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:12.223912 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3599e87-36bc-4ea1-8264-1cf777708959 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:12.224271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3599e87-36bc-4ea1-8264-1cf777708959 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:12.224640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3599e87-36bc-4ea1-8264-1cf777708959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:12.264914 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-d3599e87-36bc-4ea1-8264-1cf777708959 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:12.274667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d3599e87-36bc-4ea1-8264-1cf777708959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:12.361683 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1070/2174] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:12.384105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795aa5d-dc9b-423a-9b6e-3e35f7289ac0 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:12.385984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8795aa5d-dc9b-423a-9b6e-3e35f7289ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:12.425837 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3599e87-36bc-4ea1-8264-1cf777708959 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:12.427715 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d3599e87-36bc-4ea1-8264-1cf777708959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:12.489721 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795aa5d-dc9b-423a-9b6e-3e35f7289ac0 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:12.500068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d1846-cbdd-45bf-b5a6-208c5e013d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:12.500814 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d1846-cbdd-45bf-b5a6-208c5e013d1d service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:12.501153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d1846-cbdd-45bf-b5a6-208c5e013d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:12.502146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d1846-cbdd-45bf-b5a6-208c5e013d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:12.520050 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d1846-cbdd-45bf-b5a6-208c5e013d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:12.521782 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d1846-cbdd-45bf-b5a6-208c5e013d1d service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:12.534622 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3599e87-36bc-4ea1-8264-1cf777708959 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:12.535546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1105/2175] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:12.539188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec399b-c249-4bb0-84f9-3d44c4ab0707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:12.539919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec399b-c249-4bb0-84f9-3d44c4ab0707 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:12.540264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec399b-c249-4bb0-84f9-3d44c4ab0707 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:12.540601 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec399b-c249-4bb0-84f9-3d44c4ab0707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:12.543034 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a3ec399b-c249-4bb0-84f9-3d44c4ab0707 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:12.621337 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec399b-c249-4bb0-84f9-3d44c4ab0707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:12.623930 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec399b-c249-4bb0-84f9-3d44c4ab0707 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:12.645592 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1071/2176] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:13.333415 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d1846-cbdd-45bf-b5a6-208c5e013d1d service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:13.344361 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d1846-cbdd-45bf-b5a6-208c5e013d1d service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:13.349005 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bce42-c5f2-48c2-abaa-4225867cfb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:13.349678 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bce42-c5f2-48c2-abaa-4225867cfb62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:13.349962 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bce42-c5f2-48c2-abaa-4225867cfb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:13.350238 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bce42-c5f2-48c2-abaa-4225867cfb62 admin admin] PATH_INFO: `/v3/users/1337e6e7fcd04e89970b2769fc942321` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:13.352255 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bce42-c5f2-48c2-abaa-4225867cfb62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1337e6e7fcd04e89970b2769fc942321)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:13.354323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bce42-c5f2-48c2-abaa-4225867cfb62 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:13.453775 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:13.591646 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d94bce42-c5f2-48c2-abaa-4225867cfb62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1337e6e7fcd04e89970b2769fc942321'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:13.690860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d94bce42-c5f2-48c2-abaa-4225867cfb62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1337e6e7fcd04e89970b2769fc942321'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:13.691705 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d94bce42-c5f2-48c2-abaa-4225867cfb62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1337e6e7fcd04e89970b2769fc942321'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:13.692504 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d94bce42-c5f2-48c2-abaa-4225867cfb62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1337e6e7fcd04e89970b2769fc942321'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:13.703074 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d94bce42-c5f2-48c2-abaa-4225867cfb62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1337e6e7fcd04e89970b2769fc942321'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:13.727446 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1106/2177] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:13 2022] DELETE /identity/v3/users/1337e6e7fcd04e89970b2769fc942321 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:13.733734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6033e-c0ee-4112-8486-4f50ef99c618 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:13.734113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6033e-c0ee-4112-8486-4f50ef99c618 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:13.735235 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6033e-c0ee-4112-8486-4f50ef99c618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:13.756301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1cc6033e-c0ee-4112-8486-4f50ef99c618 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:13.758567 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1cc6033e-c0ee-4112-8486-4f50ef99c618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:13.843390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1072/2178] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:13.854631 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bce42-c5f2-48c2-abaa-4225867cfb62 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:13.856367 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d94bce42-c5f2-48c2-abaa-4225867cfb62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:13.918993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bce42-c5f2-48c2-abaa-4225867cfb62 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:13.924256 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f935aff-3c33-497d-8379-298c18ab0ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:13.924860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f935aff-3c33-497d-8379-298c18ab0ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:13.925143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f935aff-3c33-497d-8379-298c18ab0ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:13.925417 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f935aff-3c33-497d-8379-298c18ab0ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:13.934907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f935aff-3c33-497d-8379-298c18ab0ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:13.936338 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f935aff-3c33-497d-8379-298c18ab0ee7 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:13.946165 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1107/2179] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:14.073384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:14.801061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6033e-c0ee-4112-8486-4f50ef99c618 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:14.802638 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1cc6033e-c0ee-4112-8486-4f50ef99c618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:14.839051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6033e-c0ee-4112-8486-4f50ef99c618 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:14.853281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2cb02-a48a-4478-ab9f-89b4d0c82311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:14.854042 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2cb02-a48a-4478-ab9f-89b4d0c82311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:14.858584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2cb02-a48a-4478-ab9f-89b4d0c82311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:14.858584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2cb02-a48a-4478-ab9f-89b4d0c82311 admin admin] PATH_INFO: `/v3/projects/3c07144ed49c44cfb77942a4b07b8941` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:14.858584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2cb02-a48a-4478-ab9f-89b4d0c82311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c07144ed49c44cfb77942a4b07b8941)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:14.861992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2cb02-a48a-4478-ab9f-89b4d0c82311 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:15.032506 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-59f2cb02-a48a-4478-ab9f-89b4d0c82311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c07144ed49c44cfb77942a4b07b8941', 'request_id': 'req-59f2cb02-a48a-4478-ab9f-89b4d0c82311'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:15.040900 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-59f2cb02-a48a-4478-ab9f-89b4d0c82311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c07144ed49c44cfb77942a4b07b8941', 'request_id': 'req-59f2cb02-a48a-4478-ab9f-89b4d0c82311'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:15.113025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-59f2cb02-a48a-4478-ab9f-89b4d0c82311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c07144ed49c44cfb77942a4b07b8941', 'request_id': 'req-59f2cb02-a48a-4478-ab9f-89b4d0c82311'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:15.126939 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-59f2cb02-a48a-4478-ab9f-89b4d0c82311 admin admin] The token cache is being invalidate because project 3c07144ed49c44cfb77942a4b07b8941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:15.127307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-59f2cb02-a48a-4478-ab9f-89b4d0c82311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:15.128028 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-59f2cb02-a48a-4478-ab9f-89b4d0c82311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:15.129712 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1073/2180] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:14 2022] DELETE /identity/v3/projects/3c07144ed49c44cfb77942a4b07b8941 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:15.134892 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f935aff-3c33-497d-8379-298c18ab0ee7 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:15.145193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f935aff-3c33-497d-8379-298c18ab0ee7 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:15.205059 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec244ce0-1ab7-4159-8887-9336b7901da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:15.205059 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec244ce0-1ab7-4159-8887-9336b7901da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:15.205340 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec244ce0-1ab7-4159-8887-9336b7901da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:15.205477 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec244ce0-1ab7-4159-8887-9336b7901da2 admin admin] PATH_INFO: `/v3/users/8615b533f7e548e29ae9dfa55387b584` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:15.206797 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec244ce0-1ab7-4159-8887-9336b7901da2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8615b533f7e548e29ae9dfa55387b584)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:15.208836 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec244ce0-1ab7-4159-8887-9336b7901da2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:15.489744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ec244ce0-1ab7-4159-8887-9336b7901da2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8615b533f7e548e29ae9dfa55387b584'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:15.571524 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ec244ce0-1ab7-4159-8887-9336b7901da2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8615b533f7e548e29ae9dfa55387b584'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:15.572508 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ec244ce0-1ab7-4159-8887-9336b7901da2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8615b533f7e548e29ae9dfa55387b584'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:15.573297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ec244ce0-1ab7-4159-8887-9336b7901da2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8615b533f7e548e29ae9dfa55387b584'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:15.580710 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:15.583457 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ec244ce0-1ab7-4159-8887-9336b7901da2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8615b533f7e548e29ae9dfa55387b584'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:15.608107 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1108/2181] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:15 2022] DELETE /identity/v3/users/8615b533f7e548e29ae9dfa55387b584 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:15.774865 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:16.283360 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2cb02-a48a-4478-ab9f-89b4d0c82311 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:16.286800 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-59f2cb02-a48a-4478-ab9f-89b4d0c82311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:16.309889 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2cb02-a48a-4478-ab9f-89b4d0c82311 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:16.391350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e5122-b8b2-4f88-9583-c330a6ccf77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:16.392006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e5122-b8b2-4f88-9583-c330a6ccf77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:16.392289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e5122-b8b2-4f88-9583-c330a6ccf77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:16.392566 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e5122-b8b2-4f88-9583-c330a6ccf77d admin admin] PATH_INFO: `/v3/projects/95eb2487890b4055bf8e9f1cf0ef2a68` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:16.393789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e5122-b8b2-4f88-9583-c330a6ccf77d admin admin] RBAC: Authorizing `identity:delete_project(project_id=95eb2487890b4055bf8e9f1cf0ef2a68)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:16.395821 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e5122-b8b2-4f88-9583-c330a6ccf77d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:16.432852 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec244ce0-1ab7-4159-8887-9336b7901da2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:16.434702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ec244ce0-1ab7-4159-8887-9336b7901da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:16.449964 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec244ce0-1ab7-4159-8887-9336b7901da2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:16.456612 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87ae1e-5669-4675-be60-b8efb8a40dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:16.457718 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87ae1e-5669-4675-be60-b8efb8a40dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:16.457996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87ae1e-5669-4675-be60-b8efb8a40dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:16.458275 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87ae1e-5669-4675-be60-b8efb8a40dd9 admin admin] PATH_INFO: `/v3/users/8c178b3425cb40c9aa8f9017a91540e8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:16.459903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87ae1e-5669-4675-be60-b8efb8a40dd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c178b3425cb40c9aa8f9017a91540e8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:16.462872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87ae1e-5669-4675-be60-b8efb8a40dd9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:16.573418 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bb0e5122-b8b2-4f88-9583-c330a6ccf77d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95eb2487890b4055bf8e9f1cf0ef2a68', 'request_id': 'req-bb0e5122-b8b2-4f88-9583-c330a6ccf77d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:16.581366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bb0e5122-b8b2-4f88-9583-c330a6ccf77d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95eb2487890b4055bf8e9f1cf0ef2a68', 'request_id': 'req-bb0e5122-b8b2-4f88-9583-c330a6ccf77d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:16.666360 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bb0e5122-b8b2-4f88-9583-c330a6ccf77d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95eb2487890b4055bf8e9f1cf0ef2a68', 'request_id': 'req-bb0e5122-b8b2-4f88-9583-c330a6ccf77d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:16.683371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bb0e5122-b8b2-4f88-9583-c330a6ccf77d admin admin] The token cache is being invalidate because project 95eb2487890b4055bf8e9f1cf0ef2a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:16.683755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bb0e5122-b8b2-4f88-9583-c330a6ccf77d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:16.684497 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bb0e5122-b8b2-4f88-9583-c330a6ccf77d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:16.696463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1074/2182] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:16 2022] DELETE /identity/v3/projects/95eb2487890b4055bf8e9f1cf0ef2a68 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:16.702123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f08035-7bcd-443d-9cc3-507090b4905a None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:16.704654 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f08035-7bcd-443d-9cc3-507090b4905a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:16.705126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f08035-7bcd-443d-9cc3-507090b4905a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:16.707044 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4a87ae1e-5669-4675-be60-b8efb8a40dd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c178b3425cb40c9aa8f9017a91540e8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:16.785133 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4a87ae1e-5669-4675-be60-b8efb8a40dd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c178b3425cb40c9aa8f9017a91540e8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:16.785794 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4a87ae1e-5669-4675-be60-b8efb8a40dd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c178b3425cb40c9aa8f9017a91540e8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:16.786442 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4a87ae1e-5669-4675-be60-b8efb8a40dd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c178b3425cb40c9aa8f9017a91540e8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:16.796235 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-d1f08035-7bcd-443d-9cc3-507090b4905a None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:16.797641 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d1f08035-7bcd-443d-9cc3-507090b4905a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:16.798483 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4a87ae1e-5669-4675-be60-b8efb8a40dd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c178b3425cb40c9aa8f9017a91540e8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:16.870569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1109/2183] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:16 2022] DELETE /identity/v3/users/8c178b3425cb40c9aa8f9017a91540e8 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:16.872763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f8a98-75e3-44fb-9c6c-34b347f9c4a2 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:16.873174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f8a98-75e3-44fb-9c6c-34b347f9c4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:16.873322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f8a98-75e3-44fb-9c6c-34b347f9c4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:16.918930 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8a4f8a98-75e3-44fb-9c6c-34b347f9c4a2 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:16.920334 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8a4f8a98-75e3-44fb-9c6c-34b347f9c4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:16.921100 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1075/2184] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:16.928612 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4222ef-e643-4849-b600-09d8623c2c3d None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:16.928995 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4222ef-e643-4849-b600-09d8623c2c3d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:16.929339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4222ef-e643-4849-b600-09d8623c2c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:16.963832 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9b4222ef-e643-4849-b600-09d8623c2c3d None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:16.963832 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9b4222ef-e643-4849-b600-09d8623c2c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:17.040995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1110/2185] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:17.062680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f8a98-75e3-44fb-9c6c-34b347f9c4a2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:17.064338 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8a4f8a98-75e3-44fb-9c6c-34b347f9c4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:17.068987 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1076/2186] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:17.073786 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4222ef-e643-4849-b600-09d8623c2c3d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:17.096528 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4222ef-e643-4849-b600-09d8623c2c3d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:17.110033 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f6dc9-f418-46a1-8457-b620fc413b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:17.110667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f6dc9-f418-46a1-8457-b620fc413b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:17.111052 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f6dc9-f418-46a1-8457-b620fc413b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:17.111278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f6dc9-f418-46a1-8457-b620fc413b45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:17.112195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f6dc9-f418-46a1-8457-b620fc413b45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:19:17.112309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f6dc9-f418-46a1-8457-b620fc413b45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:17.114513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f6dc9-f418-46a1-8457-b620fc413b45 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:17.137282 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1077/2187] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:19:17.141356 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f6dc9-f418-46a1-8457-b620fc413b45 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:17.156661 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f6dc9-f418-46a1-8457-b620fc413b45 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:17.164092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0606c9a-20da-4a27-aeaa-1782dd07a1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:17.164917 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0606c9a-20da-4a27-aeaa-1782dd07a1ec admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:17.165203 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0606c9a-20da-4a27-aeaa-1782dd07a1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:17.165505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0606c9a-20da-4a27-aeaa-1782dd07a1ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:17.166157 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0606c9a-20da-4a27-aeaa-1782dd07a1ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:17.168126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0606c9a-20da-4a27-aeaa-1782dd07a1ec admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:17.176070 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f8a98-75e3-44fb-9c6c-34b347f9c4a2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:17.180650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab07917-ca4e-40d5-b414-3cc344708014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:17.181620 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab07917-ca4e-40d5-b414-3cc344708014 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:17.181975 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab07917-ca4e-40d5-b414-3cc344708014 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:17.182315 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab07917-ca4e-40d5-b414-3cc344708014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:17.198531 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab07917-ca4e-40d5-b414-3cc344708014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:17.200004 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab07917-ca4e-40d5-b414-3cc344708014 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:17.211080 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1111/2188] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:17.316217 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1078/2189] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:19:17 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:19:17.319729 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab07917-ca4e-40d5-b414-3cc344708014 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:17.329596 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab07917-ca4e-40d5-b414-3cc344708014 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:17.386540 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89986f9f-7443-4ed8-9810-374f411b8521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:17.387158 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89986f9f-7443-4ed8-9810-374f411b8521 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:17.387566 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89986f9f-7443-4ed8-9810-374f411b8521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:17.387848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89986f9f-7443-4ed8-9810-374f411b8521 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:17.388707 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89986f9f-7443-4ed8-9810-374f411b8521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:17.390532 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89986f9f-7443-4ed8-9810-374f411b8521 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:17.418994 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0606c9a-20da-4a27-aeaa-1782dd07a1ec admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:17.420884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b0606c9a-20da-4a27-aeaa-1782dd07a1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:17.434173 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0606c9a-20da-4a27-aeaa-1782dd07a1ec admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:17.440024 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd5443-2d3d-4057-abb8-c4c29dd1c1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:17.440663 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd5443-2d3d-4057-abb8-c4c29dd1c1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:17.446011 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd5443-2d3d-4057-abb8-c4c29dd1c1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:17.446011 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd5443-2d3d-4057-abb8-c4c29dd1c1b9 admin admin] PATH_INFO: `/v3/users/69c2955c84084f4a92f1d7c867f00497` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:17.446011 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd5443-2d3d-4057-abb8-c4c29dd1c1b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c2955c84084f4a92f1d7c867f00497)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:17.446011 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd5443-2d3d-4057-abb8-c4c29dd1c1b9 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:17.503056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1112/2190] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:19:17 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:19:17.507181 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89986f9f-7443-4ed8-9810-374f411b8521 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:17.519896 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89986f9f-7443-4ed8-9810-374f411b8521 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:17.525572 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af8ec9-69d6-4a02-9652-6080a01592f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:17.529644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af8ec9-69d6-4a02-9652-6080a01592f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:17.529644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af8ec9-69d6-4a02-9652-6080a01592f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:17.529644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af8ec9-69d6-4a02-9652-6080a01592f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:17.529644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af8ec9-69d6-4a02-9652-6080a01592f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:17.529644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af8ec9-69d6-4a02-9652-6080a01592f8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:17.539694 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1113/2191] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:17.543639 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af8ec9-69d6-4a02-9652-6080a01592f8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:17.556409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af8ec9-69d6-4a02-9652-6080a01592f8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:17.561610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4535e-048c-4526-b6c0-2451c6fca630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:17.562298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4535e-048c-4526-b6c0-2451c6fca630 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:17.562646 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4535e-048c-4526-b6c0-2451c6fca630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:17.562954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4535e-048c-4526-b6c0-2451c6fca630 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:17.563608 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4535e-048c-4526-b6c0-2451c6fca630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:17.565314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4535e-048c-4526-b6c0-2451c6fca630 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:17.576727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1114/2192] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:19:17.580883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4535e-048c-4526-b6c0-2451c6fca630 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:17.592945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4535e-048c-4526-b6c0-2451c6fca630 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:17.598843 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f36a3-c0ae-441d-b210-7638a9e34df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:17.599504 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f36a3-c0ae-441d-b210-7638a9e34df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:17.599780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f36a3-c0ae-441d-b210-7638a9e34df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:17.600054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f36a3-c0ae-441d-b210-7638a9e34df5 admin admin] PATH_INFO: `/v3/projects/ee3f069e1a2f4c32a08d0a468de13b83/users/cc783b4e29cd449c82007970c9302296/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:17.620456 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f36a3-c0ae-441d-b210-7638a9e34df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3f069e1a2f4c32a08d0a468de13b83, user_id=cc783b4e29cd449c82007970c9302296, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:17.624662 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f36a3-c0ae-441d-b210-7638a9e34df5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:17.680413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b3bd5443-2d3d-4057-abb8-c4c29dd1c1b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c2955c84084f4a92f1d7c867f00497'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:17.692277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b3bd5443-2d3d-4057-abb8-c4c29dd1c1b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c2955c84084f4a92f1d7c867f00497'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:17.693035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b3bd5443-2d3d-4057-abb8-c4c29dd1c1b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c2955c84084f4a92f1d7c867f00497'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:17.693866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b3bd5443-2d3d-4057-abb8-c4c29dd1c1b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c2955c84084f4a92f1d7c867f00497'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:17.697843 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1115/2193] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:17 2022] PUT /identity/v3/projects/ee3f069e1a2f4c32a08d0a468de13b83/users/cc783b4e29cd449c82007970c9302296/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:17.709116 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804a083-b629-4b78-97a6-35ce56edb6c8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:17.709536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804a083-b629-4b78-97a6-35ce56edb6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:17.709881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804a083-b629-4b78-97a6-35ce56edb6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:17.757814 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3804a083-b629-4b78-97a6-35ce56edb6c8 None None] MFA Rules not processed for user `cc783b4e29cd449c82007970c9302296`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:17.760339 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3804a083-b629-4b78-97a6-35ce56edb6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:17.765550 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b3bd5443-2d3d-4057-abb8-c4c29dd1c1b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c2955c84084f4a92f1d7c867f00497'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:17.797548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1079/2194] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:17 2022] DELETE /identity/v3/users/69c2955c84084f4a92f1d7c867f00497 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:17.800985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249e3d8-36d8-442e-bb20-6a7a468080ba None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:17.802108 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249e3d8-36d8-442e-bb20-6a7a468080ba None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:17.802458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249e3d8-36d8-442e-bb20-6a7a468080ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:17.842535 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-5249e3d8-36d8-442e-bb20-6a7a468080ba None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:17.843864 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5249e3d8-36d8-442e-bb20-6a7a468080ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:17.854493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1116/2195] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:17.854493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804a083-b629-4b78-97a6-35ce56edb6c8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:17.855635 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3804a083-b629-4b78-97a6-35ce56edb6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:17.959686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804a083-b629-4b78-97a6-35ce56edb6c8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:17.994368 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1080/2196] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:17.999855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249e3d8-36d8-442e-bb20-6a7a468080ba None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:18.006055 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5249e3d8-36d8-442e-bb20-6a7a468080ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:18.071852 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa5755-1ebb-4168-adc1-7fec5da1fe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:18.072540 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa5755-1ebb-4168-adc1-7fec5da1fe08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:18.072834 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa5755-1ebb-4168-adc1-7fec5da1fe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:18.073143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa5755-1ebb-4168-adc1-7fec5da1fe08 admin admin] PATH_INFO: `/v3/projects/9864fb4362cb4118b21800da17e52452` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:18.074449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa5755-1ebb-4168-adc1-7fec5da1fe08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9864fb4362cb4118b21800da17e52452)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:18.076448 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa5755-1ebb-4168-adc1-7fec5da1fe08 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:18.119302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249e3d8-36d8-442e-bb20-6a7a468080ba None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:18.126544 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f0fa3-3589-458b-8db0-d4ccac6fbeec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:18.127140 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f0fa3-3589-458b-8db0-d4ccac6fbeec service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:18.127426 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f0fa3-3589-458b-8db0-d4ccac6fbeec service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:18.127701 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f0fa3-3589-458b-8db0-d4ccac6fbeec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:18.199893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47aa5755-1ebb-4168-adc1-7fec5da1fe08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9864fb4362cb4118b21800da17e52452', 'request_id': 'req-47aa5755-1ebb-4168-adc1-7fec5da1fe08'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:18.206634 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47aa5755-1ebb-4168-adc1-7fec5da1fe08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9864fb4362cb4118b21800da17e52452', 'request_id': 'req-47aa5755-1ebb-4168-adc1-7fec5da1fe08'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:18.234611 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f0fa3-3589-458b-8db0-d4ccac6fbeec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:18.236196 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f0fa3-3589-458b-8db0-d4ccac6fbeec service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:18.247465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1081/2197] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:18.248435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f0fa3-3589-458b-8db0-d4ccac6fbeec service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:18.249826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-996f0fa3-3589-458b-8db0-d4ccac6fbeec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:18.295768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47aa5755-1ebb-4168-adc1-7fec5da1fe08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9864fb4362cb4118b21800da17e52452', 'request_id': 'req-47aa5755-1ebb-4168-adc1-7fec5da1fe08'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:18.312299 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47aa5755-1ebb-4168-adc1-7fec5da1fe08 admin admin] The token cache is being invalidate because project 9864fb4362cb4118b21800da17e52452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:18.312595 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47aa5755-1ebb-4168-adc1-7fec5da1fe08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:18.313270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47aa5755-1ebb-4168-adc1-7fec5da1fe08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:18.317368 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1117/2198] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:17 2022] DELETE /identity/v3/projects/9864fb4362cb4118b21800da17e52452 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:18.337131 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f0fa3-3589-458b-8db0-d4ccac6fbeec service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:18.426036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea0326-908c-46b5-a711-df87b2168325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:18.426713 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea0326-908c-46b5-a711-df87b2168325 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:18.427042 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea0326-908c-46b5-a711-df87b2168325 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:18.427325 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea0326-908c-46b5-a711-df87b2168325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:18.430440 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-29ea0326-908c-46b5-a711-df87b2168325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:18.549057 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea0326-908c-46b5-a711-df87b2168325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:18.550578 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea0326-908c-46b5-a711-df87b2168325 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:18.563099 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1082/2199] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:18.886545 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:19.049518 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:19.062800 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa5755-1ebb-4168-adc1-7fec5da1fe08 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:19.067857 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-47aa5755-1ebb-4168-adc1-7fec5da1fe08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:19.089849 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa5755-1ebb-4168-adc1-7fec5da1fe08 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:19.108240 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f624ef-3d2d-4e1a-877f-f6c197f88650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:19.109053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f624ef-3d2d-4e1a-877f-f6c197f88650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:19.109758 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f624ef-3d2d-4e1a-877f-f6c197f88650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:19.110116 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f624ef-3d2d-4e1a-877f-f6c197f88650 admin admin] PATH_INFO: `/v3/projects/92ff8ceeebf84b30bfc49d9baf983cd7` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:19.115436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f624ef-3d2d-4e1a-877f-f6c197f88650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ff8ceeebf84b30bfc49d9baf983cd7)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:19.131282 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f624ef-3d2d-4e1a-877f-f6c197f88650 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:19.250751 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b2f624ef-3d2d-4e1a-877f-f6c197f88650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ff8ceeebf84b30bfc49d9baf983cd7', 'request_id': 'req-b2f624ef-3d2d-4e1a-877f-f6c197f88650'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:19.257904 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b2f624ef-3d2d-4e1a-877f-f6c197f88650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ff8ceeebf84b30bfc49d9baf983cd7', 'request_id': 'req-b2f624ef-3d2d-4e1a-877f-f6c197f88650'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:19.370185 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b2f624ef-3d2d-4e1a-877f-f6c197f88650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ff8ceeebf84b30bfc49d9baf983cd7', 'request_id': 'req-b2f624ef-3d2d-4e1a-877f-f6c197f88650'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:19.391306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b2f624ef-3d2d-4e1a-877f-f6c197f88650 admin admin] The token cache is being invalidate because project 92ff8ceeebf84b30bfc49d9baf983cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:19.391606 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b2f624ef-3d2d-4e1a-877f-f6c197f88650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:19.392319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-b2f624ef-3d2d-4e1a-877f-f6c197f88650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:19.394222 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1118/2200] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:19 2022] DELETE /identity/v3/projects/92ff8ceeebf84b30bfc49d9baf983cd7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:19.399855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea0326-908c-46b5-a711-df87b2168325 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:19.410691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea0326-908c-46b5-a711-df87b2168325 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:19.473512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17423f9-1e96-4b89-9079-f7ff74b905a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:19.474155 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17423f9-1e96-4b89-9079-f7ff74b905a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:19.474435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17423f9-1e96-4b89-9079-f7ff74b905a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:19.474705 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17423f9-1e96-4b89-9079-f7ff74b905a2 admin admin] PATH_INFO: `/v3/users/8bc7df3c42954b488705121ef46211a8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:19.475829 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17423f9-1e96-4b89-9079-f7ff74b905a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bc7df3c42954b488705121ef46211a8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:19.478578 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17423f9-1e96-4b89-9079-f7ff74b905a2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:19.720753 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c17423f9-1e96-4b89-9079-f7ff74b905a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc7df3c42954b488705121ef46211a8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:19.728828 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f624ef-3d2d-4e1a-877f-f6c197f88650 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:19.730376 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c17423f9-1e96-4b89-9079-f7ff74b905a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc7df3c42954b488705121ef46211a8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:19.731311 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c17423f9-1e96-4b89-9079-f7ff74b905a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc7df3c42954b488705121ef46211a8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:19.731608 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b2f624ef-3d2d-4e1a-877f-f6c197f88650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:19.732393 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c17423f9-1e96-4b89-9079-f7ff74b905a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc7df3c42954b488705121ef46211a8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:19.806040 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f624ef-3d2d-4e1a-877f-f6c197f88650 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:19.810322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa762dae-5f34-4f6b-b0b1-ff204a8a2647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:19.811244 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa762dae-5f34-4f6b-b0b1-ff204a8a2647 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:19.811671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa762dae-5f34-4f6b-b0b1-ff204a8a2647 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:19.812077 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa762dae-5f34-4f6b-b0b1-ff204a8a2647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:19.815016 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fa762dae-5f34-4f6b-b0b1-ff204a8a2647 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:19.829119 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c17423f9-1e96-4b89-9079-f7ff74b905a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc7df3c42954b488705121ef46211a8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:19.870734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1083/2201] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:19 2022] DELETE /identity/v3/users/8bc7df3c42954b488705121ef46211a8 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:19.914583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa762dae-5f34-4f6b-b0b1-ff204a8a2647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:19.916163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa762dae-5f34-4f6b-b0b1-ff204a8a2647 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:19.929323 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1119/2202] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:19:20.208128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a752ecb-838a-4ff5-9c00-b76059a72196 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:20.208437 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a752ecb-838a-4ff5-9c00-b76059a72196 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:20.208698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a752ecb-838a-4ff5-9c00-b76059a72196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:20.263403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-0a752ecb-838a-4ff5-9c00-b76059a72196 None None] MFA Rules not processed for user `740e3901a15d49ee9891858ebf7086e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:20.264876 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0a752ecb-838a-4ff5-9c00-b76059a72196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:20.368791 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1084/2203] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:20.389033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa762dae-5f34-4f6b-b0b1-ff204a8a2647 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:20.390948 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fa762dae-5f34-4f6b-b0b1-ff204a8a2647 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:20.484871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa762dae-5f34-4f6b-b0b1-ff204a8a2647 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:20.545996 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a752ecb-838a-4ff5-9c00-b76059a72196 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:20.547502 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0a752ecb-838a-4ff5-9c00-b76059a72196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:20.598536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bede0-0ec4-4253-835b-d8bae7d937b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:20.602385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bede0-0ec4-4253-835b-d8bae7d937b7 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:20.602385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bede0-0ec4-4253-835b-d8bae7d937b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:20.602385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bede0-0ec4-4253-835b-d8bae7d937b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:20.611171 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bede0-0ec4-4253-835b-d8bae7d937b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:20.613054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bede0-0ec4-4253-835b-d8bae7d937b7 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:20.625967 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1120/2204] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:20.648328 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a752ecb-838a-4ff5-9c00-b76059a72196 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:20.654597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bec4fe-888e-47d3-a7e3-b2eeffa0560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:20.655353 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bec4fe-888e-47d3-a7e3-b2eeffa0560a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:20.655700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bec4fe-888e-47d3-a7e3-b2eeffa0560a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:20.656047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bec4fe-888e-47d3-a7e3-b2eeffa0560a admin admin] PATH_INFO: `/v3/projects/239862323f2b4a5cb2bf4d835a36e0a6` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:20.657379 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bec4fe-888e-47d3-a7e3-b2eeffa0560a admin admin] RBAC: Authorizing `identity:delete_project(project_id=239862323f2b4a5cb2bf4d835a36e0a6)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:20.659581 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bec4fe-888e-47d3-a7e3-b2eeffa0560a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:20.824160 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b6bec4fe-888e-47d3-a7e3-b2eeffa0560a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239862323f2b4a5cb2bf4d835a36e0a6', 'request_id': 'req-b6bec4fe-888e-47d3-a7e3-b2eeffa0560a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:20.833829 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b6bec4fe-888e-47d3-a7e3-b2eeffa0560a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239862323f2b4a5cb2bf4d835a36e0a6', 'request_id': 'req-b6bec4fe-888e-47d3-a7e3-b2eeffa0560a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:20.936151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b6bec4fe-888e-47d3-a7e3-b2eeffa0560a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239862323f2b4a5cb2bf4d835a36e0a6', 'request_id': 'req-b6bec4fe-888e-47d3-a7e3-b2eeffa0560a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:20.952077 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b6bec4fe-888e-47d3-a7e3-b2eeffa0560a admin admin] The token cache is being invalidate because project 239862323f2b4a5cb2bf4d835a36e0a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:20.952370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b6bec4fe-888e-47d3-a7e3-b2eeffa0560a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:20.953048 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b6bec4fe-888e-47d3-a7e3-b2eeffa0560a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:20.955271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1085/2205] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:20 2022] DELETE /identity/v3/projects/239862323f2b4a5cb2bf4d835a36e0a6 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:20.959978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331151f8-4856-498e-a688-bf4974ca4098 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:20.960710 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331151f8-4856-498e-a688-bf4974ca4098 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:20.961124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331151f8-4856-498e-a688-bf4974ca4098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:21.009605 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-331151f8-4856-498e-a688-bf4974ca4098 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:21.012994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-331151f8-4856-498e-a688-bf4974ca4098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:21.111498 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1121/2206] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:21.120046 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09be4cd-5bfe-4688-bcca-d3194199984d None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:21.122353 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09be4cd-5bfe-4688-bcca-d3194199984d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:21.122353 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09be4cd-5bfe-4688-bcca-d3194199984d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:21.143879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c09be4cd-5bfe-4688-bcca-d3194199984d None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:21.146002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c09be4cd-5bfe-4688-bcca-d3194199984d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:21.166079 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331151f8-4856-498e-a688-bf4974ca4098 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:21.169389 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1086/2207] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:21.184912 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331151f8-4856-498e-a688-bf4974ca4098 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:21.194680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8357d-aa78-45d3-8c22-64a86dab8fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:21.196630 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8357d-aa78-45d3-8c22-64a86dab8fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:21.197119 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8357d-aa78-45d3-8c22-64a86dab8fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:21.197689 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8357d-aa78-45d3-8c22-64a86dab8fb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:21.198934 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8357d-aa78-45d3-8c22-64a86dab8fb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:19:21.199449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8357d-aa78-45d3-8c22-64a86dab8fb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:21.203465 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8357d-aa78-45d3-8c22-64a86dab8fb7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:21.239225 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1122/2208] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:19:21.241672 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09be4cd-5bfe-4688-bcca-d3194199984d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:21.256537 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09be4cd-5bfe-4688-bcca-d3194199984d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:21.263641 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6906c-9d60-4907-a52d-1b96f1f9323f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:21.265345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6906c-9d60-4907-a52d-1b96f1f9323f admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:21.267609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6906c-9d60-4907-a52d-1b96f1f9323f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:21.268008 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6906c-9d60-4907-a52d-1b96f1f9323f admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:21.268924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6906c-9d60-4907-a52d-1b96f1f9323f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:21.271200 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6906c-9d60-4907-a52d-1b96f1f9323f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:21.403807 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1087/2209] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:19:21 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:19:21.405970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8357d-aa78-45d3-8c22-64a86dab8fb7 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:21.422916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8357d-aa78-45d3-8c22-64a86dab8fb7 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:21.525246 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd6e27-6b06-4d34-b609-8f4c1fb70b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:21.526059 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd6e27-6b06-4d34-b609-8f4c1fb70b41 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:21.526351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd6e27-6b06-4d34-b609-8f4c1fb70b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:21.526627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd6e27-6b06-4d34-b609-8f4c1fb70b41 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:21.527294 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd6e27-6b06-4d34-b609-8f4c1fb70b41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:21.529271 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd6e27-6b06-4d34-b609-8f4c1fb70b41 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:21.622244 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1123/2210] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:19:21 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:19:21.624437 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6906c-9d60-4907-a52d-1b96f1f9323f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:21.647501 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6906c-9d60-4907-a52d-1b96f1f9323f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:21.647501 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b12ff-0c08-4a7b-aa12-0a358e0a856b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:21.647501 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b12ff-0c08-4a7b-aa12-0a358e0a856b admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:21.647501 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b12ff-0c08-4a7b-aa12-0a358e0a856b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:21.647914 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b12ff-0c08-4a7b-aa12-0a358e0a856b admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:21.647914 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b12ff-0c08-4a7b-aa12-0a358e0a856b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:21.647914 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b12ff-0c08-4a7b-aa12-0a358e0a856b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:21.658670 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1088/2211] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:21.662700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd6e27-6b06-4d34-b609-8f4c1fb70b41 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:21.677702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd6e27-6b06-4d34-b609-8f4c1fb70b41 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:21.684166 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c38c5-1ede-464b-b227-44cbe3a21d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:21.684721 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c38c5-1ede-464b-b227-44cbe3a21d3d admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:21.685006 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c38c5-1ede-464b-b227-44cbe3a21d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:21.685427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c38c5-1ede-464b-b227-44cbe3a21d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:21.686190 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c38c5-1ede-464b-b227-44cbe3a21d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:21.687864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c38c5-1ede-464b-b227-44cbe3a21d3d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:21.705126 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1124/2212] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:21.706176 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b12ff-0c08-4a7b-aa12-0a358e0a856b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:21.721748 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b12ff-0c08-4a7b-aa12-0a358e0a856b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:21.735991 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4aafd-e88c-4a04-b263-dc5b83898bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:21.737032 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4aafd-e88c-4a04-b263-dc5b83898bde admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:21.737552 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4aafd-e88c-4a04-b263-dc5b83898bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:21.738035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de4aafd-e88c-4a04-b263-dc5b83898bde admin admin] PATH_INFO: `/v3/projects/b3c8a3b408d44c6ebe917d22a055c0ed/users/5a13c4d83dfe4fbb8dce08082cec9f0a/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:21.773781 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4aafd-e88c-4a04-b263-dc5b83898bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c8a3b408d44c6ebe917d22a055c0ed, user_id=5a13c4d83dfe4fbb8dce08082cec9f0a, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:21.778235 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de4aafd-e88c-4a04-b263-dc5b83898bde admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:21.810249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:21.957149 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1089/2213] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:21 2022] PUT /identity/v3/projects/b3c8a3b408d44c6ebe917d22a055c0ed/users/5a13c4d83dfe4fbb8dce08082cec9f0a/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:21.969568 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e4760-60ed-4ca0-b2fe-9f29ce81b511 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:21.970108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e4760-60ed-4ca0-b2fe-9f29ce81b511 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:21.970108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e4760-60ed-4ca0-b2fe-9f29ce81b511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:21.996828 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:22.004941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-635e4760-60ed-4ca0-b2fe-9f29ce81b511 None None] MFA Rules not processed for user `5a13c4d83dfe4fbb8dce08082cec9f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:22.006268 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-635e4760-60ed-4ca0-b2fe-9f29ce81b511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:22.081676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1125/2214] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:22.086143 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4aafd-e88c-4a04-b263-dc5b83898bde admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:22.175101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de4aafd-e88c-4a04-b263-dc5b83898bde admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:22.180190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958fbd9-eb6c-4bac-b41a-ddb169977ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:22.181572 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958fbd9-eb6c-4bac-b41a-ddb169977ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:22.181982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958fbd9-eb6c-4bac-b41a-ddb169977ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:22.182387 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958fbd9-eb6c-4bac-b41a-ddb169977ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:22.183541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958fbd9-eb6c-4bac-b41a-ddb169977ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:22.184988 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958fbd9-eb6c-4bac-b41a-ddb169977ad2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:22.306019 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1090/2215] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:19:22 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:19:22.310065 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e4760-60ed-4ca0-b2fe-9f29ce81b511 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:22.321398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e4760-60ed-4ca0-b2fe-9f29ce81b511 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:22.394468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9bd11-f4cc-44c4-976a-019d29b9b63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:22.395110 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9bd11-f4cc-44c4-976a-019d29b9b63c admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:22.395456 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9bd11-f4cc-44c4-976a-019d29b9b63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:22.395726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9bd11-f4cc-44c4-976a-019d29b9b63c admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:22.396377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9bd11-f4cc-44c4-976a-019d29b9b63c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:22.398392 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9bd11-f4cc-44c4-976a-019d29b9b63c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:22.525329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1126/2216] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:19:22 2022] POST /identity/v3/users => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:19:22.529472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958fbd9-eb6c-4bac-b41a-ddb169977ad2 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:22.539681 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958fbd9-eb6c-4bac-b41a-ddb169977ad2 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:22.544253 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d7267-d51d-4f42-87f2-4e340a1b9c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:22.544896 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d7267-d51d-4f42-87f2-4e340a1b9c6f admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:22.545173 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d7267-d51d-4f42-87f2-4e340a1b9c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:22.545443 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d7267-d51d-4f42-87f2-4e340a1b9c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:22.546106 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d7267-d51d-4f42-87f2-4e340a1b9c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:22.547701 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d7267-d51d-4f42-87f2-4e340a1b9c6f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:22.558729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1091/2217] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:22.563986 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9bd11-f4cc-44c4-976a-019d29b9b63c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:22.575406 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9bd11-f4cc-44c4-976a-019d29b9b63c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:22.580283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eed74f-b6c3-4100-8b7a-07cefe42c428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:22.580938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eed74f-b6c3-4100-8b7a-07cefe42c428 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:22.581398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eed74f-b6c3-4100-8b7a-07cefe42c428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:22.581732 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eed74f-b6c3-4100-8b7a-07cefe42c428 admin admin] PATH_INFO: `/v3/projects/ee564ca07cfe4802ac951bac6d58beba/users/e0287a99f5114753a0091dc1e6cdde2b/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:22.598101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eed74f-b6c3-4100-8b7a-07cefe42c428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee564ca07cfe4802ac951bac6d58beba, user_id=e0287a99f5114753a0091dc1e6cdde2b, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:22.600809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eed74f-b6c3-4100-8b7a-07cefe42c428 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:22.713149 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1127/2218] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:22 2022] PUT /identity/v3/projects/ee564ca07cfe4802ac951bac6d58beba/users/e0287a99f5114753a0091dc1e6cdde2b/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:22.716938 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d7267-d51d-4f42-87f2-4e340a1b9c6f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:22.728138 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d7267-d51d-4f42-87f2-4e340a1b9c6f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:22.807961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e26e9-aa64-4b29-be9f-d9f242f8a184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:22.808731 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e26e9-aa64-4b29-be9f-d9f242f8a184 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:22.809199 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e26e9-aa64-4b29-be9f-d9f242f8a184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:22.809618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e26e9-aa64-4b29-be9f-d9f242f8a184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:22.810498 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e26e9-aa64-4b29-be9f-d9f242f8a184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:22.812344 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e26e9-aa64-4b29-be9f-d9f242f8a184 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:22.830431 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1092/2219] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:19:22.831545 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eed74f-b6c3-4100-8b7a-07cefe42c428 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:22.842928 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eed74f-b6c3-4100-8b7a-07cefe42c428 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:22.847736 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f0bcb-33d6-4b5f-a3b6-bf3e9e33a0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:22.848510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f0bcb-33d6-4b5f-a3b6-bf3e9e33a0eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:22.848685 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f0bcb-33d6-4b5f-a3b6-bf3e9e33a0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:22.848944 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f0bcb-33d6-4b5f-a3b6-bf3e9e33a0eb admin admin] PATH_INFO: `/v3/projects/ee564ca07cfe4802ac951bac6d58beba/users/e0287a99f5114753a0091dc1e6cdde2b/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:22.850999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f0bcb-33d6-4b5f-a3b6-bf3e9e33a0eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee564ca07cfe4802ac951bac6d58beba, user_id=e0287a99f5114753a0091dc1e6cdde2b, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:22.853898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f0bcb-33d6-4b5f-a3b6-bf3e9e33a0eb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:22.868589 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1128/2220] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:22 2022] PUT /identity/v3/projects/ee564ca07cfe4802ac951bac6d58beba/users/e0287a99f5114753a0091dc1e6cdde2b/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:22.881486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45316deb-d41c-412b-90f8-9a0b62bde0b2 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:22.881777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45316deb-d41c-412b-90f8-9a0b62bde0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:22.882075 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45316deb-d41c-412b-90f8-9a0b62bde0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:22.948075 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-45316deb-d41c-412b-90f8-9a0b62bde0b2 None None] MFA Rules not processed for user `e0287a99f5114753a0091dc1e6cdde2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:22.950175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-45316deb-d41c-412b-90f8-9a0b62bde0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:23.108987 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1093/2221] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:23.122275 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f0bcb-33d6-4b5f-a3b6-bf3e9e33a0eb admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:23.124159 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a76f0bcb-33d6-4b5f-a3b6-bf3e9e33a0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:23.215386 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f0bcb-33d6-4b5f-a3b6-bf3e9e33a0eb admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:23.220369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6750ebc-4669-42b6-a83d-14b16c5acd9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:23.221013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6750ebc-4669-42b6-a83d-14b16c5acd9d service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:23.221284 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6750ebc-4669-42b6-a83d-14b16c5acd9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:23.221611 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6750ebc-4669-42b6-a83d-14b16c5acd9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:23.234186 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6750ebc-4669-42b6-a83d-14b16c5acd9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:23.235671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6750ebc-4669-42b6-a83d-14b16c5acd9d service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:23.247877 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1129/2222] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:23.369090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45316deb-d41c-412b-90f8-9a0b62bde0b2 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:23.379155 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45316deb-d41c-412b-90f8-9a0b62bde0b2 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:23.383104 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe9ecc-cac9-442a-af04-670e584f8b2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:23.384359 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe9ecc-cac9-442a-af04-670e584f8b2f service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:23.384637 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe9ecc-cac9-442a-af04-670e584f8b2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:23.384910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe9ecc-cac9-442a-af04-670e584f8b2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:23.468069 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe9ecc-cac9-442a-af04-670e584f8b2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:23.470780 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe9ecc-cac9-442a-af04-670e584f8b2f service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:23.486499 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1094/2223] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:23.664791 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:24.017920 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dfb87-2f8f-4bcb-892f-bd1dcee26027 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:24.018546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dfb87-2f8f-4bcb-892f-bd1dcee26027 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:24.018907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dfb87-2f8f-4bcb-892f-bd1dcee26027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:24.073038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-828dfb87-2f8f-4bcb-892f-bd1dcee26027 None None] MFA Rules not processed for user `740e3901a15d49ee9891858ebf7086e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:24.074299 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-828dfb87-2f8f-4bcb-892f-bd1dcee26027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:24.176757 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1130/2224] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:24.859743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:26.442187 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:27.002150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:27.749679 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:27.970054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe9ecc-cac9-442a-af04-670e584f8b2f service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:28.033658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe9ecc-cac9-442a-af04-670e584f8b2f service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:28.038316 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f5a73-cbbf-4f3a-b183-64cf97e98c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:28.038943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f5a73-cbbf-4f3a-b183-64cf97e98c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:28.039218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f5a73-cbbf-4f3a-b183-64cf97e98c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:28.039487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f5a73-cbbf-4f3a-b183-64cf97e98c0a admin admin] PATH_INFO: `/v3/users/5a13c4d83dfe4fbb8dce08082cec9f0a` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:28.040581 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f5a73-cbbf-4f3a-b183-64cf97e98c0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a13c4d83dfe4fbb8dce08082cec9f0a)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:28.042581 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f5a73-cbbf-4f3a-b183-64cf97e98c0a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:28.241888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-029f5a73-cbbf-4f3a-b183-64cf97e98c0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a13c4d83dfe4fbb8dce08082cec9f0a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:28.250895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-029f5a73-cbbf-4f3a-b183-64cf97e98c0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a13c4d83dfe4fbb8dce08082cec9f0a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:28.251602 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-029f5a73-cbbf-4f3a-b183-64cf97e98c0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a13c4d83dfe4fbb8dce08082cec9f0a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:28.252223 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-029f5a73-cbbf-4f3a-b183-64cf97e98c0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a13c4d83dfe4fbb8dce08082cec9f0a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:28.271887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dfb87-2f8f-4bcb-892f-bd1dcee26027 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:28.273290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-828dfb87-2f8f-4bcb-892f-bd1dcee26027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:28.287220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dfb87-2f8f-4bcb-892f-bd1dcee26027 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:28.291895 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf075004-0236-4c36-8f78-a5a5f01027cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:28.292514 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf075004-0236-4c36-8f78-a5a5f01027cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:28.292790 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf075004-0236-4c36-8f78-a5a5f01027cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:28.293090 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf075004-0236-4c36-8f78-a5a5f01027cd admin admin] PATH_INFO: `/v3/users/cc783b4e29cd449c82007970c9302296` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:28.294325 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf075004-0236-4c36-8f78-a5a5f01027cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc783b4e29cd449c82007970c9302296)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:28.296244 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf075004-0236-4c36-8f78-a5a5f01027cd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:28.403167 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-029f5a73-cbbf-4f3a-b183-64cf97e98c0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a13c4d83dfe4fbb8dce08082cec9f0a'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:28.417122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1095/2225] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:27 2022] DELETE /identity/v3/users/5a13c4d83dfe4fbb8dce08082cec9f0a => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:28.422351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81f707-3fd8-4d44-b86e-f2793b9b202a None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:28.422738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81f707-3fd8-4d44-b86e-f2793b9b202a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:28.423022 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81f707-3fd8-4d44-b86e-f2793b9b202a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:28.442430 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-aa81f707-3fd8-4d44-b86e-f2793b9b202a None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:28.443645 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-aa81f707-3fd8-4d44-b86e-f2793b9b202a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:28.507177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1096/2226] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:28.519312 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81f707-3fd8-4d44-b86e-f2793b9b202a None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:28.520885 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-aa81f707-3fd8-4d44-b86e-f2793b9b202a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:28.526703 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bf075004-0236-4c36-8f78-a5a5f01027cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc783b4e29cd449c82007970c9302296'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:28.591429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bf075004-0236-4c36-8f78-a5a5f01027cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc783b4e29cd449c82007970c9302296'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:28.592063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bf075004-0236-4c36-8f78-a5a5f01027cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc783b4e29cd449c82007970c9302296'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:28.592817 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bf075004-0236-4c36-8f78-a5a5f01027cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc783b4e29cd449c82007970c9302296'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:28.597472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81f707-3fd8-4d44-b86e-f2793b9b202a None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:28.602040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71128e16-9f33-4e0d-92aa-a49d915380b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:28.603145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71128e16-9f33-4e0d-92aa-a49d915380b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:28.603496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71128e16-9f33-4e0d-92aa-a49d915380b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:28.603998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71128e16-9f33-4e0d-92aa-a49d915380b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:28.604758 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bf075004-0236-4c36-8f78-a5a5f01027cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc783b4e29cd449c82007970c9302296'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:28.606073 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-71128e16-9f33-4e0d-92aa-a49d915380b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:28.621602 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71128e16-9f33-4e0d-92aa-a49d915380b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:28.623187 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71128e16-9f33-4e0d-92aa-a49d915380b9 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:28.628602 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1131/2227] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:28 2022] DELETE /identity/v3/users/cc783b4e29cd449c82007970c9302296 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:28.632941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebee41-6918-4985-9822-961bd2a60318 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:28.633236 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebee41-6918-4985-9822-961bd2a60318 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:28.633549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebee41-6918-4985-9822-961bd2a60318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:28.634422 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1097/2228] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:28.658213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-65ebee41-6918-4985-9822-961bd2a60318 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:28.658213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-65ebee41-6918-4985-9822-961bd2a60318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:28.719638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1132/2229] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:28.729551 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71128e16-9f33-4e0d-92aa-a49d915380b9 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:28.731677 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-71128e16-9f33-4e0d-92aa-a49d915380b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:28.744818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71128e16-9f33-4e0d-92aa-a49d915380b9 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:28.795509 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9ccc8-d310-4978-9dd0-1538228b6a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:28.796171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9ccc8-d310-4978-9dd0-1538228b6a22 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:28.796450 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9ccc8-d310-4978-9dd0-1538228b6a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:28.796726 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9ccc8-d310-4978-9dd0-1538228b6a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:28.806269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9ccc8-d310-4978-9dd0-1538228b6a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:28.807714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9ccc8-d310-4978-9dd0-1538228b6a22 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:28.819219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1098/2230] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:29.062769 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:29.139939 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebee41-6918-4985-9822-961bd2a60318 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:29.141392 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-65ebee41-6918-4985-9822-961bd2a60318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:29.153804 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebee41-6918-4985-9822-961bd2a60318 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:29.158846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415a9b3-9516-4405-93ea-3bdc1110fde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:29.159452 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415a9b3-9516-4405-93ea-3bdc1110fde4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:29.159736 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415a9b3-9516-4405-93ea-3bdc1110fde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:29.160591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415a9b3-9516-4405-93ea-3bdc1110fde4 admin admin] PATH_INFO: `/v3/projects/b3c8a3b408d44c6ebe917d22a055c0ed` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:29.163320 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:29.164945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415a9b3-9516-4405-93ea-3bdc1110fde4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c8a3b408d44c6ebe917d22a055c0ed)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:29.168466 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415a9b3-9516-4405-93ea-3bdc1110fde4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:29.378254 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c415a9b3-9516-4405-93ea-3bdc1110fde4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c8a3b408d44c6ebe917d22a055c0ed', 'request_id': 'req-c415a9b3-9516-4405-93ea-3bdc1110fde4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:29.431326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c415a9b3-9516-4405-93ea-3bdc1110fde4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c8a3b408d44c6ebe917d22a055c0ed', 'request_id': 'req-c415a9b3-9516-4405-93ea-3bdc1110fde4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:29.631416 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9ccc8-d310-4978-9dd0-1538228b6a22 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:29.631884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c2e9ccc8-d310-4978-9dd0-1538228b6a22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:29.645762 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9ccc8-d310-4978-9dd0-1538228b6a22 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:29.653576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c415a9b3-9516-4405-93ea-3bdc1110fde4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c8a3b408d44c6ebe917d22a055c0ed', 'request_id': 'req-c415a9b3-9516-4405-93ea-3bdc1110fde4'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:29.675475 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c415a9b3-9516-4405-93ea-3bdc1110fde4 admin admin] The token cache is being invalidate because project b3c8a3b408d44c6ebe917d22a055c0ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:29.675734 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c415a9b3-9516-4405-93ea-3bdc1110fde4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:29.676479 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c415a9b3-9516-4405-93ea-3bdc1110fde4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:29.684322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1133/2231] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:29 2022] DELETE /identity/v3/projects/b3c8a3b408d44c6ebe917d22a055c0ed => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:29.684322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415a9b3-9516-4405-93ea-3bdc1110fde4 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:29.684322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c415a9b3-9516-4405-93ea-3bdc1110fde4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:29.723319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e071925-dd51-461f-abe3-c4b9d340a99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:29.723959 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e071925-dd51-461f-abe3-c4b9d340a99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:29.724236 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e071925-dd51-461f-abe3-c4b9d340a99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:29.724686 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e071925-dd51-461f-abe3-c4b9d340a99d admin admin] PATH_INFO: `/v3/projects/ee3f069e1a2f4c32a08d0a468de13b83` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:29.725859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e071925-dd51-461f-abe3-c4b9d340a99d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee3f069e1a2f4c32a08d0a468de13b83)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:29.727784 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e071925-dd51-461f-abe3-c4b9d340a99d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:29.758952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415a9b3-9516-4405-93ea-3bdc1110fde4 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:29.764315 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e18fb5-085b-49a2-9697-f6d7960fd077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:29.765700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e18fb5-085b-49a2-9697-f6d7960fd077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:29.766130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e18fb5-085b-49a2-9697-f6d7960fd077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:29.766481 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e18fb5-085b-49a2-9697-f6d7960fd077 admin admin] PATH_INFO: `/v3/users/e0287a99f5114753a0091dc1e6cdde2b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:29.767777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e18fb5-085b-49a2-9697-f6d7960fd077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0287a99f5114753a0091dc1e6cdde2b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:29.769933 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e18fb5-085b-49a2-9697-f6d7960fd077 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:29.839794 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1e071925-dd51-461f-abe3-c4b9d340a99d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee3f069e1a2f4c32a08d0a468de13b83', 'request_id': 'req-1e071925-dd51-461f-abe3-c4b9d340a99d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:29.846066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1e071925-dd51-461f-abe3-c4b9d340a99d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee3f069e1a2f4c32a08d0a468de13b83', 'request_id': 'req-1e071925-dd51-461f-abe3-c4b9d340a99d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:29.929002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1e071925-dd51-461f-abe3-c4b9d340a99d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee3f069e1a2f4c32a08d0a468de13b83', 'request_id': 'req-1e071925-dd51-461f-abe3-c4b9d340a99d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:29.945956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1e071925-dd51-461f-abe3-c4b9d340a99d admin admin] The token cache is being invalidate because project ee3f069e1a2f4c32a08d0a468de13b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:29.945956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1e071925-dd51-461f-abe3-c4b9d340a99d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:29.948724 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1e071925-dd51-461f-abe3-c4b9d340a99d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:29.956166 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1099/2232] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:29 2022] DELETE /identity/v3/projects/ee3f069e1a2f4c32a08d0a468de13b83 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:29.962001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef9599-a9fe-4664-8f78-93bc78663044 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:29.962292 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef9599-a9fe-4664-8f78-93bc78663044 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:29.962566 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef9599-a9fe-4664-8f78-93bc78663044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:29.977156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-56e18fb5-085b-49a2-9697-f6d7960fd077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0287a99f5114753a0091dc1e6cdde2b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:29.995882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-daef9599-a9fe-4664-8f78-93bc78663044 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:29.999879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-daef9599-a9fe-4664-8f78-93bc78663044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:30.048650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-56e18fb5-085b-49a2-9697-f6d7960fd077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0287a99f5114753a0091dc1e6cdde2b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:30.049293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-56e18fb5-085b-49a2-9697-f6d7960fd077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0287a99f5114753a0091dc1e6cdde2b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:30.050061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-56e18fb5-085b-49a2-9697-f6d7960fd077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0287a99f5114753a0091dc1e6cdde2b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:30.058394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-56e18fb5-085b-49a2-9697-f6d7960fd077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0287a99f5114753a0091dc1e6cdde2b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:30.077797 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1100/2233] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:30.087098 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189acbf0-016a-4437-8b73-fd47ca895339 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:30.087879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189acbf0-016a-4437-8b73-fd47ca895339 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:30.088230 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189acbf0-016a-4437-8b73-fd47ca895339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:30.101205 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1134/2234] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:29 2022] DELETE /identity/v3/users/e0287a99f5114753a0091dc1e6cdde2b => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:30.114684 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-189acbf0-016a-4437-8b73-fd47ca895339 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:30.121627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-189acbf0-016a-4437-8b73-fd47ca895339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:30.218269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1101/2235] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:30.223520 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e18fb5-085b-49a2-9697-f6d7960fd077 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:30.240011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e18fb5-085b-49a2-9697-f6d7960fd077 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:30.246112 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe1046-86a8-4ace-a35c-37b6374a2d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:30.247542 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe1046-86a8-4ace-a35c-37b6374a2d3d admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:30.247834 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe1046-86a8-4ace-a35c-37b6374a2d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:30.248217 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe1046-86a8-4ace-a35c-37b6374a2d3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:30.248878 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe1046-86a8-4ace-a35c-37b6374a2d3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:19:30.249308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe1046-86a8-4ace-a35c-37b6374a2d3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:30.251782 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe1046-86a8-4ace-a35c-37b6374a2d3d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:30.265802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1135/2236] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:19:30.270285 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189acbf0-016a-4437-8b73-fd47ca895339 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:30.279663 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189acbf0-016a-4437-8b73-fd47ca895339 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:30.284991 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e35064-9e51-4a0a-912b-f335d02161be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:30.285710 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e35064-9e51-4a0a-912b-f335d02161be admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:30.286061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e35064-9e51-4a0a-912b-f335d02161be admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:30.286400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e35064-9e51-4a0a-912b-f335d02161be admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:30.287091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e35064-9e51-4a0a-912b-f335d02161be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:30.289069 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e35064-9e51-4a0a-912b-f335d02161be admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:30.438880 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1102/2237] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:19:30 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:19:30.441604 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe1046-86a8-4ace-a35c-37b6374a2d3d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:30.453570 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe1046-86a8-4ace-a35c-37b6374a2d3d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:30.532460 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117be07-4789-4423-96fd-1aa0a3efedfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:30.533077 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117be07-4789-4423-96fd-1aa0a3efedfc admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:30.533357 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117be07-4789-4423-96fd-1aa0a3efedfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:30.533660 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117be07-4789-4423-96fd-1aa0a3efedfc admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:30.534288 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117be07-4789-4423-96fd-1aa0a3efedfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:30.536209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117be07-4789-4423-96fd-1aa0a3efedfc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:30.603638 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:30.690090 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1136/2238] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:19:30 2022] POST /identity/v3/users => generated 283 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:19:30.693844 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e35064-9e51-4a0a-912b-f335d02161be admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:30.706970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e35064-9e51-4a0a-912b-f335d02161be admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:30.716203 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117be07-4789-4423-96fd-1aa0a3efedfc admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:30.722948 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b117be07-4789-4423-96fd-1aa0a3efedfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:30.723599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88934b2-b69e-4f72-b069-373decec07df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:30.726599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88934b2-b69e-4f72-b069-373decec07df admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:30.727023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88934b2-b69e-4f72-b069-373decec07df admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:30.727799 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88934b2-b69e-4f72-b069-373decec07df admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:30.730828 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88934b2-b69e-4f72-b069-373decec07df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:30.735117 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88934b2-b69e-4f72-b069-373decec07df admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:30.743970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117be07-4789-4423-96fd-1aa0a3efedfc admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:30.750818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fe25e-ebda-4253-87b1-baacd4677eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:30.755463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fe25e-ebda-4253-87b1-baacd4677eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:30.755463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fe25e-ebda-4253-87b1-baacd4677eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:30.755463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fe25e-ebda-4253-87b1-baacd4677eb2 admin admin] PATH_INFO: `/v3/projects/ee564ca07cfe4802ac951bac6d58beba` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:30.755463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fe25e-ebda-4253-87b1-baacd4677eb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee564ca07cfe4802ac951bac6d58beba)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:30.755875 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fe25e-ebda-4253-87b1-baacd4677eb2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:30.781061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1103/2239] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:19:30.786485 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88934b2-b69e-4f72-b069-373decec07df admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:30.825110 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88934b2-b69e-4f72-b069-373decec07df admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:30.831405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f21f5d-ec32-4724-9838-7828ead42f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:30.832036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f21f5d-ec32-4724-9838-7828ead42f8b admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:30.833641 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f21f5d-ec32-4724-9838-7828ead42f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:30.833641 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f21f5d-ec32-4724-9838-7828ead42f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:30.833641 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f21f5d-ec32-4724-9838-7828ead42f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:30.835486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f21f5d-ec32-4724-9838-7828ead42f8b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:30.851168 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1104/2240] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:30.853447 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f21f5d-ec32-4724-9838-7828ead42f8b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:30.865616 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f21f5d-ec32-4724-9838-7828ead42f8b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:30.871622 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f3c89-39a3-448b-ab00-7c2d22ea2f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:30.872363 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f3c89-39a3-448b-ab00-7c2d22ea2f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:30.872705 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f3c89-39a3-448b-ab00-7c2d22ea2f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:30.873049 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f3c89-39a3-448b-ab00-7c2d22ea2f81 admin admin] PATH_INFO: `/v3/projects/599ae2e020f44beebb9179e187c25b29/users/7eeb435ae95b4dcebef5e8bf69b38f40/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:30.896465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f3c89-39a3-448b-ab00-7c2d22ea2f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=599ae2e020f44beebb9179e187c25b29, user_id=7eeb435ae95b4dcebef5e8bf69b38f40, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:30.899441 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f3c89-39a3-448b-ab00-7c2d22ea2f81 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:30.926767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cb6fe25e-ebda-4253-87b1-baacd4677eb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee564ca07cfe4802ac951bac6d58beba', 'request_id': 'req-cb6fe25e-ebda-4253-87b1-baacd4677eb2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:30.933587 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cb6fe25e-ebda-4253-87b1-baacd4677eb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee564ca07cfe4802ac951bac6d58beba', 'request_id': 'req-cb6fe25e-ebda-4253-87b1-baacd4677eb2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:31.018309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1105/2241] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:30 2022] PUT /identity/v3/projects/599ae2e020f44beebb9179e187c25b29/users/7eeb435ae95b4dcebef5e8bf69b38f40/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:31.030889 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385578f-4361-4baf-9c23-b31e1f45e1bb None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:31.031259 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385578f-4361-4baf-9c23-b31e1f45e1bb None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:31.031612 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385578f-4361-4baf-9c23-b31e1f45e1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:31.050285 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cb6fe25e-ebda-4253-87b1-baacd4677eb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee564ca07cfe4802ac951bac6d58beba', 'request_id': 'req-cb6fe25e-ebda-4253-87b1-baacd4677eb2'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:31.070139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-7385578f-4361-4baf-9c23-b31e1f45e1bb None None] MFA Rules not processed for user `7eeb435ae95b4dcebef5e8bf69b38f40`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:31.070369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cb6fe25e-ebda-4253-87b1-baacd4677eb2 admin admin] The token cache is being invalidate because project ee564ca07cfe4802ac951bac6d58beba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:31.070698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cb6fe25e-ebda-4253-87b1-baacd4677eb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:31.071329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cb6fe25e-ebda-4253-87b1-baacd4677eb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:31.071444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7385578f-4361-4baf-9c23-b31e1f45e1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:31.076825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1137/2242] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:30 2022] DELETE /identity/v3/projects/ee564ca07cfe4802ac951bac6d58beba => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:31.078259 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b05bd2-47cc-4925-adae-cabdb1c58bcd None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:31.080499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b05bd2-47cc-4925-adae-cabdb1c58bcd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:31.080499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b05bd2-47cc-4925-adae-cabdb1c58bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:31.100222 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e9b05bd2-47cc-4925-adae-cabdb1c58bcd None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:31.101601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e9b05bd2-47cc-4925-adae-cabdb1c58bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:31.146150 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1106/2243] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:31.158617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385578f-4361-4baf-9c23-b31e1f45e1bb None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:31.160089 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7385578f-4361-4baf-9c23-b31e1f45e1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:31.164627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1138/2244] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:31.172927 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e3642-f6ea-40bc-9b2d-91503250cc78 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:31.173220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e3642-f6ea-40bc-9b2d-91503250cc78 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:31.173524 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e3642-f6ea-40bc-9b2d-91503250cc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:31.192473 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-208e3642-f6ea-40bc-9b2d-91503250cc78 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:31.193737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-208e3642-f6ea-40bc-9b2d-91503250cc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:31.218963 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1139/2245] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:31.221551 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e3642-f6ea-40bc-9b2d-91503250cc78 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:31.231652 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385578f-4361-4baf-9c23-b31e1f45e1bb None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:31.235361 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e3642-f6ea-40bc-9b2d-91503250cc78 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:31.236462 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d744f0e-623b-4b82-afa6-416692b25677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:31.237859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d744f0e-623b-4b82-afa6-416692b25677 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:31.238156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d744f0e-623b-4b82-afa6-416692b25677 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:31.238436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d744f0e-623b-4b82-afa6-416692b25677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:31.242116 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfd94c-63a9-44d2-9599-221094099c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:31.243015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfd94c-63a9-44d2-9599-221094099c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:31.243479 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfd94c-63a9-44d2-9599-221094099c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:31.243941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfd94c-63a9-44d2-9599-221094099c80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:31.244753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfd94c-63a9-44d2-9599-221094099c80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:19:31.245215 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfd94c-63a9-44d2-9599-221094099c80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:31.247165 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfd94c-63a9-44d2-9599-221094099c80 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:31.247823 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d744f0e-623b-4b82-afa6-416692b25677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:31.249640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d744f0e-623b-4b82-afa6-416692b25677 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:31.260982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1107/2246] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:31.266488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1140/2247] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:19:31.274422 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d744f0e-623b-4b82-afa6-416692b25677 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:31.287229 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d744f0e-623b-4b82-afa6-416692b25677 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:31.292175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd26f3-6517-42c0-9645-9b9f58e0914c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:31.293057 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd26f3-6517-42c0-9645-9b9f58e0914c admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:31.293164 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd26f3-6517-42c0-9645-9b9f58e0914c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:31.293396 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd26f3-6517-42c0-9645-9b9f58e0914c admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:31.294023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd26f3-6517-42c0-9645-9b9f58e0914c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:31.295942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd26f3-6517-42c0-9645-9b9f58e0914c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:31.335727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:31.465013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:31.474771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1108/2248] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:19:31 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:19:31.479162 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfd94c-63a9-44d2-9599-221094099c80 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:31.492423 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfd94c-63a9-44d2-9599-221094099c80 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:31.565074 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411372c4-e8cc-4154-acb5-913a45352dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:31.565737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411372c4-e8cc-4154-acb5-913a45352dcb admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:31.566861 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411372c4-e8cc-4154-acb5-913a45352dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:31.567370 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411372c4-e8cc-4154-acb5-913a45352dcb admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:31.572486 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411372c4-e8cc-4154-acb5-913a45352dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:31.574218 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411372c4-e8cc-4154-acb5-913a45352dcb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:31.691044 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1141/2249] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:19:31 2022] POST /identity/v3/users => generated 294 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:19:31.696516 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd26f3-6517-42c0-9645-9b9f58e0914c admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:31.707046 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd26f3-6517-42c0-9645-9b9f58e0914c admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:31.711711 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804beaf-4931-4032-96ff-eb283b74c0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:31.712347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804beaf-4931-4032-96ff-eb283b74c0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:31.712629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804beaf-4931-4032-96ff-eb283b74c0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:31.712908 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804beaf-4931-4032-96ff-eb283b74c0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:31.713581 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804beaf-4931-4032-96ff-eb283b74c0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:31.715184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804beaf-4931-4032-96ff-eb283b74c0c8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:31.726438 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1109/2250] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:19:31.730359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411372c4-e8cc-4154-acb5-913a45352dcb admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:31.742776 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411372c4-e8cc-4154-acb5-913a45352dcb admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:31.751544 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e273bae-d11e-4ee5-af97-ff5f2b56e7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:31.751544 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e273bae-d11e-4ee5-af97-ff5f2b56e7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:31.751544 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e273bae-d11e-4ee5-af97-ff5f2b56e7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:31.751544 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e273bae-d11e-4ee5-af97-ff5f2b56e7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:31.751907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e273bae-d11e-4ee5-af97-ff5f2b56e7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:31.751907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e273bae-d11e-4ee5-af97-ff5f2b56e7d6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:31.764863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1142/2251] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:31.769168 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804beaf-4931-4032-96ff-eb283b74c0c8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:31.779475 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804beaf-4931-4032-96ff-eb283b74c0c8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:31.784916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521a74c-25db-48bd-b9eb-2b66e03f6817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:31.785600 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521a74c-25db-48bd-b9eb-2b66e03f6817 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:31.785879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521a74c-25db-48bd-b9eb-2b66e03f6817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:31.786147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521a74c-25db-48bd-b9eb-2b66e03f6817 admin admin] PATH_INFO: `/v3/projects/5561ad060f50468f98297f81fe6b4155/users/dbf468fff7ec43b29c44cc8916725a55/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:31.802117 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521a74c-25db-48bd-b9eb-2b66e03f6817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5561ad060f50468f98297f81fe6b4155, user_id=dbf468fff7ec43b29c44cc8916725a55, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:31.804937 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521a74c-25db-48bd-b9eb-2b66e03f6817 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:31.893073 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1110/2252] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:31 2022] PUT /identity/v3/projects/5561ad060f50468f98297f81fe6b4155/users/dbf468fff7ec43b29c44cc8916725a55/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:31.898744 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d8513-7544-4dbd-97f5-9898e856697e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:31.899038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d8513-7544-4dbd-97f5-9898e856697e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:31.899312 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d8513-7544-4dbd-97f5-9898e856697e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:31.934002 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d77d8513-7544-4dbd-97f5-9898e856697e None None] MFA Rules not processed for user `dbf468fff7ec43b29c44cc8916725a55`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:31.935512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d77d8513-7544-4dbd-97f5-9898e856697e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:32.033629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1143/2253] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:32.035926 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521a74c-25db-48bd-b9eb-2b66e03f6817 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:32.113227 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521a74c-25db-48bd-b9eb-2b66e03f6817 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:32.119324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f57d2e-72d3-4163-8eaa-b4a630692613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:32.119940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f57d2e-72d3-4163-8eaa-b4a630692613 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:32.120220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f57d2e-72d3-4163-8eaa-b4a630692613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:32.120498 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f57d2e-72d3-4163-8eaa-b4a630692613 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:32.125870 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f57d2e-72d3-4163-8eaa-b4a630692613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:32.128478 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f57d2e-72d3-4163-8eaa-b4a630692613 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:32.232463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1111/2254] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:19:32 2022] POST /identity/v3/projects => generated 387 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:19:32.237436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d8513-7544-4dbd-97f5-9898e856697e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:32.248576 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d8513-7544-4dbd-97f5-9898e856697e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:32.307934 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7f50c-b6d8-4b50-89cf-dccab9292cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:32.308551 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7f50c-b6d8-4b50-89cf-dccab9292cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:32.309027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7f50c-b6d8-4b50-89cf-dccab9292cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:32.309309 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7f50c-b6d8-4b50-89cf-dccab9292cf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:32.309980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7f50c-b6d8-4b50-89cf-dccab9292cf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:32.312763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7f50c-b6d8-4b50-89cf-dccab9292cf7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:32.419905 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1144/2255] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:19:32 2022] POST /identity/v3/users => generated 300 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:19:32.421874 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f57d2e-72d3-4163-8eaa-b4a630692613 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:32.433393 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f57d2e-72d3-4163-8eaa-b4a630692613 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:32.438996 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684b9a9-8ad4-414a-bd03-748f728fd623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:32.439621 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684b9a9-8ad4-414a-bd03-748f728fd623 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:32.440106 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684b9a9-8ad4-414a-bd03-748f728fd623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:32.440386 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684b9a9-8ad4-414a-bd03-748f728fd623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:32.441101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684b9a9-8ad4-414a-bd03-748f728fd623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:32.442772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684b9a9-8ad4-414a-bd03-748f728fd623 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:32.454100 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1112/2256] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:32.458144 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7f50c-b6d8-4b50-89cf-dccab9292cf7 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:32.469333 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7f50c-b6d8-4b50-89cf-dccab9292cf7 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:32.474731 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1240b-0d00-4176-a9db-eae080be5811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:32.475393 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1240b-0d00-4176-a9db-eae080be5811 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:32.475811 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1240b-0d00-4176-a9db-eae080be5811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:32.475934 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1240b-0d00-4176-a9db-eae080be5811 admin admin] PATH_INFO: `/v3/projects/22076eef5d3b45d0961ad69fdd6ce215/users/9e4a90ae12c947f5937d62105c657932/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:32.492637 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1240b-0d00-4176-a9db-eae080be5811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22076eef5d3b45d0961ad69fdd6ce215, user_id=9e4a90ae12c947f5937d62105c657932, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:32.496768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1240b-0d00-4176-a9db-eae080be5811 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:32.589264 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1145/2257] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:32 2022] PUT /identity/v3/projects/22076eef5d3b45d0961ad69fdd6ce215/users/9e4a90ae12c947f5937d62105c657932/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:32.594922 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684b9a9-8ad4-414a-bd03-748f728fd623 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:32.606051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684b9a9-8ad4-414a-bd03-748f728fd623 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:32.716873 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7736d-23a1-450f-bd7c-94d0efa5cb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:32.717541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7736d-23a1-450f-bd7c-94d0efa5cb71 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:32.717828 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7736d-23a1-450f-bd7c-94d0efa5cb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:32.720494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7736d-23a1-450f-bd7c-94d0efa5cb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:32.721792 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7736d-23a1-450f-bd7c-94d0efa5cb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:32.723552 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7736d-23a1-450f-bd7c-94d0efa5cb71 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:32.735399 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1113/2258] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:32.740982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1240b-0d00-4176-a9db-eae080be5811 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:32.754119 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1240b-0d00-4176-a9db-eae080be5811 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:32.768842 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321d947-c656-417a-a9c5-32270259a818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:32.769562 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321d947-c656-417a-a9c5-32270259a818 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:32.769846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321d947-c656-417a-a9c5-32270259a818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:32.770125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5321d947-c656-417a-a9c5-32270259a818 admin admin] PATH_INFO: `/v3/projects/22076eef5d3b45d0961ad69fdd6ce215/users/9e4a90ae12c947f5937d62105c657932/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:32.772499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321d947-c656-417a-a9c5-32270259a818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22076eef5d3b45d0961ad69fdd6ce215, user_id=9e4a90ae12c947f5937d62105c657932, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:32.775324 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5321d947-c656-417a-a9c5-32270259a818 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:32.786539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1146/2259] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:32 2022] PUT /identity/v3/projects/22076eef5d3b45d0961ad69fdd6ce215/users/9e4a90ae12c947f5937d62105c657932/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:32.808475 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fedc4-4e48-4c07-8521-f8fce39f939e None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:32.808769 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fedc4-4e48-4c07-8521-f8fce39f939e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:32.809050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fedc4-4e48-4c07-8521-f8fce39f939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:32.841582 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-775fedc4-4e48-4c07-8521-f8fce39f939e None None] MFA Rules not processed for user `9e4a90ae12c947f5937d62105c657932`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:32.842823 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-775fedc4-4e48-4c07-8521-f8fce39f939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:32.931218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1114/2260] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:32 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:32.943614 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321d947-c656-417a-a9c5-32270259a818 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:33.024753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5321d947-c656-417a-a9c5-32270259a818 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:33.024753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ae55a-8ec7-41f8-aaf5-bf2973d9c468 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:33.024753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ae55a-8ec7-41f8-aaf5-bf2973d9c468 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:33.024753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ae55a-8ec7-41f8-aaf5-bf2973d9c468 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:33.025113 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ae55a-8ec7-41f8-aaf5-bf2973d9c468 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:33.033781 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ae55a-8ec7-41f8-aaf5-bf2973d9c468 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:33.035588 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ae55a-8ec7-41f8-aaf5-bf2973d9c468 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:33.049900 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1147/2261] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:33.097777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52bc37-4997-46f2-9582-6aa367977e4b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:33.098067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52bc37-4997-46f2-9582-6aa367977e4b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:33.098346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52bc37-4997-46f2-9582-6aa367977e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:33.120738 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-ef52bc37-4997-46f2-9582-6aa367977e4b None None] MFA Rules not processed for user `5c29eab582a64a8991b171766d321e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:33.122072 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ef52bc37-4997-46f2-9582-6aa367977e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:33.192705 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1115/2262] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Aug 9 19:19:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:33.259314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ae55a-8ec7-41f8-aaf5-bf2973d9c468 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:33.261953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-261ae55a-8ec7-41f8-aaf5-bf2973d9c468 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:33.347634 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ae55a-8ec7-41f8-aaf5-bf2973d9c468 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:33.354536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed3f16-19fe-49b9-8a9a-5aa68a7e0867 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac48cd591b44f2999d2f172262019da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:33.354691 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed3f16-19fe-49b9-8a9a-5aa68a7e0867 service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:33.355268 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed3f16-19fe-49b9-8a9a-5aa68a7e0867 service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:33.355618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed3f16-19fe-49b9-8a9a-5aa68a7e0867 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:33.366438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed3f16-19fe-49b9-8a9a-5aa68a7e0867 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:33.368181 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed3f16-19fe-49b9-8a9a-5aa68a7e0867 service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:33.377707 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1148/2263] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Aug 9 19:19:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 19:19:33.466963 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:33.644624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:34.483262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb876c4-50f1-46c9-8b90-0f5efd9bc455 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:34.488924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb876c4-50f1-46c9-8b90-0f5efd9bc455 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:34.488924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb876c4-50f1-46c9-8b90-0f5efd9bc455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:34.505484 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-fbb876c4-50f1-46c9-8b90-0f5efd9bc455 None None] MFA Rules not processed for user `5c29eab582a64a8991b171766d321e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:34.506713 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fbb876c4-50f1-46c9-8b90-0f5efd9bc455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:34.514584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1116/2264] 10.222.0.65 () {58 vars in 967 bytes} [Tue Aug 9 19:19:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:34.527695 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed3f16-19fe-49b9-8a9a-5aa68a7e0867 service swift] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:34.539279 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed3f16-19fe-49b9-8a9a-5aa68a7e0867 service swift] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:34.548920 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0ec1d-11b6-44a8-8f1c-bf546c2785d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac48cd591b44f2999d2f172262019da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:34.549737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0ec1d-11b6-44a8-8f1c-bf546c2785d3 service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:34.550089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0ec1d-11b6-44a8-8f1c-bf546c2785d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:34.550434 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0ec1d-11b6-44a8-8f1c-bf546c2785d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:34.559299 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0ec1d-11b6-44a8-8f1c-bf546c2785d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:34.560967 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0ec1d-11b6-44a8-8f1c-bf546c2785d3 service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:34.574793 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1149/2265] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Aug 9 19:19:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 19:19:34.748487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb876c4-50f1-46c9-8b90-0f5efd9bc455 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:34.815577 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb876c4-50f1-46c9-8b90-0f5efd9bc455 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:34.820191 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66037f-6bfa-4227-a068-431038d81739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:34.820869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66037f-6bfa-4227-a068-431038d81739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:34.821124 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66037f-6bfa-4227-a068-431038d81739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:34.821404 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66037f-6bfa-4227-a068-431038d81739 admin admin] PATH_INFO: `/v3/users/dbf468fff7ec43b29c44cc8916725a55` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:34.822635 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66037f-6bfa-4227-a068-431038d81739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf468fff7ec43b29c44cc8916725a55)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:34.824562 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66037f-6bfa-4227-a068-431038d81739 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:35.020833 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-db66037f-6bfa-4227-a068-431038d81739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf468fff7ec43b29c44cc8916725a55'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:35.029184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-db66037f-6bfa-4227-a068-431038d81739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf468fff7ec43b29c44cc8916725a55'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:35.030068 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-db66037f-6bfa-4227-a068-431038d81739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf468fff7ec43b29c44cc8916725a55'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:35.030689 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-db66037f-6bfa-4227-a068-431038d81739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf468fff7ec43b29c44cc8916725a55'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:35.110469 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-db66037f-6bfa-4227-a068-431038d81739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf468fff7ec43b29c44cc8916725a55'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:35.132112 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1117/2266] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:34 2022] DELETE /identity/v3/users/dbf468fff7ec43b29c44cc8916725a55 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:35.144219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75017822-b518-4fd6-8d76-bb716f818889 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:35.144219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75017822-b518-4fd6-8d76-bb716f818889 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:35.144219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75017822-b518-4fd6-8d76-bb716f818889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:35.157633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-75017822-b518-4fd6-8d76-bb716f818889 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:35.158848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-75017822-b518-4fd6-8d76-bb716f818889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:35.215889 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1150/2267] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:35.226456 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66037f-6bfa-4227-a068-431038d81739 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:35.227871 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-db66037f-6bfa-4227-a068-431038d81739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:35.285292 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66037f-6bfa-4227-a068-431038d81739 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:35.289489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a30c23-16c7-47a5-ae87-872221f3eaec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:35.290215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a30c23-16c7-47a5-ae87-872221f3eaec service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:35.290375 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a30c23-16c7-47a5-ae87-872221f3eaec service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:35.290640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a30c23-16c7-47a5-ae87-872221f3eaec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:35.300794 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a30c23-16c7-47a5-ae87-872221f3eaec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:35.302355 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a30c23-16c7-47a5-ae87-872221f3eaec service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:35.304056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45c2b6-d821-463d-8f15-50a9773e91a6 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:35.304350 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45c2b6-d821-463d-8f15-50a9773e91a6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:35.304627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed45c2b6-d821-463d-8f15-50a9773e91a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:35.312171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1118/2268] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:35.332028 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ed45c2b6-d821-463d-8f15-50a9773e91a6 None None] MFA Rules not processed for user `5c29eab582a64a8991b171766d321e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:35.333297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ed45c2b6-d821-463d-8f15-50a9773e91a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:35.396978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1151/2269] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Aug 9 19:19:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:35.410486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a30c23-16c7-47a5-ae87-872221f3eaec service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:35.411884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-64a30c23-16c7-47a5-ae87-872221f3eaec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:35.470798 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:35.481938 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a30c23-16c7-47a5-ae87-872221f3eaec service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:35.487970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c1ca9-3ef3-4a53-bc78-51e543dd7698 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac48cd591b44f2999d2f172262019da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:35.488577 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c1ca9-3ef3-4a53-bc78-51e543dd7698 service swift] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:35.488847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c1ca9-3ef3-4a53-bc78-51e543dd7698 service swift] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:35.489121 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c1ca9-3ef3-4a53-bc78-51e543dd7698 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:35.497596 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c1ca9-3ef3-4a53-bc78-51e543dd7698 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:35.499207 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c1ca9-3ef3-4a53-bc78-51e543dd7698 service swift] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:35.510177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1119/2270] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Aug 9 19:19:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 19:19:35.558317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:35.785060 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45c2b6-d821-463d-8f15-50a9773e91a6 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:35.786618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ed45c2b6-d821-463d-8f15-50a9773e91a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:35.801838 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed45c2b6-d821-463d-8f15-50a9773e91a6 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:35.806633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2ad98-3ee7-40f1-bcb5-239673e73c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:35.807455 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2ad98-3ee7-40f1-bcb5-239673e73c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:35.807908 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2ad98-3ee7-40f1-bcb5-239673e73c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:35.808342 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2ad98-3ee7-40f1-bcb5-239673e73c55 admin admin] PATH_INFO: `/v3/projects/5561ad060f50468f98297f81fe6b4155` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:35.809611 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2ad98-3ee7-40f1-bcb5-239673e73c55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5561ad060f50468f98297f81fe6b4155)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:35.824463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2ad98-3ee7-40f1-bcb5-239673e73c55 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:35.947513 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5ca2ad98-3ee7-40f1-bcb5-239673e73c55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5561ad060f50468f98297f81fe6b4155', 'request_id': 'req-5ca2ad98-3ee7-40f1-bcb5-239673e73c55'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:35.953061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5ca2ad98-3ee7-40f1-bcb5-239673e73c55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5561ad060f50468f98297f81fe6b4155', 'request_id': 'req-5ca2ad98-3ee7-40f1-bcb5-239673e73c55'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:36.091980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5ca2ad98-3ee7-40f1-bcb5-239673e73c55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5561ad060f50468f98297f81fe6b4155', 'request_id': 'req-5ca2ad98-3ee7-40f1-bcb5-239673e73c55'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:36.104852 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5ca2ad98-3ee7-40f1-bcb5-239673e73c55 admin admin] The token cache is being invalidate because project 5561ad060f50468f98297f81fe6b4155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:36.105145 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5ca2ad98-3ee7-40f1-bcb5-239673e73c55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:36.105824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-5ca2ad98-3ee7-40f1-bcb5-239673e73c55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:36.107434 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1152/2271] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:35 2022] DELETE /identity/v3/projects/5561ad060f50468f98297f81fe6b4155 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:36.111769 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c1ca9-3ef3-4a53-bc78-51e543dd7698 service swift] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:36.124760 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c1ca9-3ef3-4a53-bc78-51e543dd7698 service swift] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:36.173020 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:36.189487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56c157-95ab-47bc-8766-6ea75494e2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:36.189487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56c157-95ab-47bc-8766-6ea75494e2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:36.189487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56c157-95ab-47bc-8766-6ea75494e2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:36.189487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56c157-95ab-47bc-8766-6ea75494e2da admin admin] PATH_INFO: `/v3/users/9e4a90ae12c947f5937d62105c657932` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:36.191209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56c157-95ab-47bc-8766-6ea75494e2da admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e4a90ae12c947f5937d62105c657932)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:36.194502 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56c157-95ab-47bc-8766-6ea75494e2da admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:36.220586 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d776337-9ace-4825-950a-3b310e4c7fcf None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:36.221226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d776337-9ace-4825-950a-3b310e4c7fcf None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:36.221594 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d776337-9ace-4825-950a-3b310e4c7fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:36.243752 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2d776337-9ace-4825-950a-3b310e4c7fcf None None] MFA Rules not processed for user `5c29eab582a64a8991b171766d321e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:36.245161 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2d776337-9ace-4825-950a-3b310e4c7fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:36.303499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1153/2272] 10.222.0.65 () {58 vars in 967 bytes} [Tue Aug 9 19:19:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:36.316062 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d776337-9ace-4825-950a-3b310e4c7fcf None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:36.317392 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2d776337-9ace-4825-950a-3b310e4c7fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:36.387711 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d776337-9ace-4825-950a-3b310e4c7fcf None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:36.392954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a6c5a-eeac-4b21-b7a6-d911fcf89f75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac48cd591b44f2999d2f172262019da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:36.393605 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a6c5a-eeac-4b21-b7a6-d911fcf89f75 service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:36.393934 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a6c5a-eeac-4b21-b7a6-d911fcf89f75 service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:36.394200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a6c5a-eeac-4b21-b7a6-d911fcf89f75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:36.402165 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a6c5a-eeac-4b21-b7a6-d911fcf89f75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:36.403751 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a6c5a-eeac-4b21-b7a6-d911fcf89f75 service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:36.412755 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1154/2273] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Aug 9 19:19:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 19:19:36.424785 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cb56c157-95ab-47bc-8766-6ea75494e2da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e4a90ae12c947f5937d62105c657932'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:36.435021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cb56c157-95ab-47bc-8766-6ea75494e2da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e4a90ae12c947f5937d62105c657932'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:36.435933 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cb56c157-95ab-47bc-8766-6ea75494e2da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e4a90ae12c947f5937d62105c657932'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:36.436584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cb56c157-95ab-47bc-8766-6ea75494e2da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e4a90ae12c947f5937d62105c657932'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:36.514957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cb56c157-95ab-47bc-8766-6ea75494e2da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e4a90ae12c947f5937d62105c657932'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:36.534326 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1120/2274] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:36 2022] DELETE /identity/v3/users/9e4a90ae12c947f5937d62105c657932 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:37.039260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a6c5a-eeac-4b21-b7a6-d911fcf89f75 service swift] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:37.044747 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a59a6c5a-eeac-4b21-b7a6-d911fcf89f75 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:37.065041 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a6c5a-eeac-4b21-b7a6-d911fcf89f75 service swift] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:37.137643 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc99fe-6236-493f-b7fb-f75543c20abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:37.138432 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc99fe-6236-493f-b7fb-f75543c20abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:37.138839 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc99fe-6236-493f-b7fb-f75543c20abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:37.139936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc99fe-6236-493f-b7fb-f75543c20abb admin admin] PATH_INFO: `/v3/projects/22076eef5d3b45d0961ad69fdd6ce215` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:37.142458 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc99fe-6236-493f-b7fb-f75543c20abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=22076eef5d3b45d0961ad69fdd6ce215)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:37.145008 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc99fe-6236-493f-b7fb-f75543c20abb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:37.265380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dedc99fe-6236-493f-b7fb-f75543c20abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22076eef5d3b45d0961ad69fdd6ce215', 'request_id': 'req-dedc99fe-6236-493f-b7fb-f75543c20abb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:37.271594 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dedc99fe-6236-493f-b7fb-f75543c20abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22076eef5d3b45d0961ad69fdd6ce215', 'request_id': 'req-dedc99fe-6236-493f-b7fb-f75543c20abb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:37.407153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dedc99fe-6236-493f-b7fb-f75543c20abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22076eef5d3b45d0961ad69fdd6ce215', 'request_id': 'req-dedc99fe-6236-493f-b7fb-f75543c20abb'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:37.433901 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dedc99fe-6236-493f-b7fb-f75543c20abb admin admin] The token cache is being invalidate because project 22076eef5d3b45d0961ad69fdd6ce215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:37.433901 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dedc99fe-6236-493f-b7fb-f75543c20abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:37.433901 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dedc99fe-6236-493f-b7fb-f75543c20abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:37.433901 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1155/2275] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:37 2022] DELETE /identity/v3/projects/22076eef5d3b45d0961ad69fdd6ce215 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:37.434324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977d3c0-18d5-4942-89b3-57a357bea53c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:37.434324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977d3c0-18d5-4942-89b3-57a357bea53c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:37.434324 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a977d3c0-18d5-4942-89b3-57a357bea53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:37.467266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a977d3c0-18d5-4942-89b3-57a357bea53c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:37.468924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a977d3c0-18d5-4942-89b3-57a357bea53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:37.552549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1121/2276] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:37.560550 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a05ec-cfe5-4b1d-ba65-780c0a3917f6 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:37.560837 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a05ec-cfe5-4b1d-ba65-780c0a3917f6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:37.561416 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a05ec-cfe5-4b1d-ba65-780c0a3917f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:37.582026 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ac3a05ec-cfe5-4b1d-ba65-780c0a3917f6 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:37.583304 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ac3a05ec-cfe5-4b1d-ba65-780c0a3917f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:37.592827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1156/2277] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:37.597832 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977d3c0-18d5-4942-89b3-57a357bea53c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:37.607683 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a977d3c0-18d5-4942-89b3-57a357bea53c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:37.613234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab3f3b-3918-4ef0-9bf4-4e9b39e2b1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:37.613867 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab3f3b-3918-4ef0-9bf4-4e9b39e2b1fc admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:37.614148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab3f3b-3918-4ef0-9bf4-4e9b39e2b1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:37.614421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab3f3b-3918-4ef0-9bf4-4e9b39e2b1fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:37.615066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab3f3b-3918-4ef0-9bf4-4e9b39e2b1fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:19:37.615372 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab3f3b-3918-4ef0-9bf4-4e9b39e2b1fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:37.617096 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab3f3b-3918-4ef0-9bf4-4e9b39e2b1fc admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:37.631021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1122/2278] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:19:37.636829 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a05ec-cfe5-4b1d-ba65-780c0a3917f6 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:37.646261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a05ec-cfe5-4b1d-ba65-780c0a3917f6 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:37.650948 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12374acc-9d37-40b2-97a9-5512529f8998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:37.651540 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12374acc-9d37-40b2-97a9-5512529f8998 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:37.651816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12374acc-9d37-40b2-97a9-5512529f8998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:37.652083 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12374acc-9d37-40b2-97a9-5512529f8998 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:37.652699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12374acc-9d37-40b2-97a9-5512529f8998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:37.654648 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12374acc-9d37-40b2-97a9-5512529f8998 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:37.768425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1157/2279] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:19:37 2022] POST /identity/v3/projects => generated 361 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:19:37.772957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab3f3b-3918-4ef0-9bf4-4e9b39e2b1fc admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:37.783608 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab3f3b-3918-4ef0-9bf4-4e9b39e2b1fc admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:37.796105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:37.852682 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08048a8-32c9-4780-b064-707a87a66afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:37.854216 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08048a8-32c9-4780-b064-707a87a66afd admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:37.854499 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08048a8-32c9-4780-b064-707a87a66afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:37.855094 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08048a8-32c9-4780-b064-707a87a66afd admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:37.856352 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08048a8-32c9-4780-b064-707a87a66afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:37.859406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08048a8-32c9-4780-b064-707a87a66afd admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:37.957097 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1123/2280] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:19:37 2022] POST /identity/v3/users => generated 281 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:19:37.961806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12374acc-9d37-40b2-97a9-5512529f8998 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:37.972166 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12374acc-9d37-40b2-97a9-5512529f8998 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:37.978173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893171d-c3a1-4f37-b4d7-a6b9fce47505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:37.978791 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893171d-c3a1-4f37-b4d7-a6b9fce47505 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:37.979207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893171d-c3a1-4f37-b4d7-a6b9fce47505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:37.979553 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893171d-c3a1-4f37-b4d7-a6b9fce47505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:37.980269 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893171d-c3a1-4f37-b4d7-a6b9fce47505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:37.981989 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893171d-c3a1-4f37-b4d7-a6b9fce47505 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:37.995122 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1158/2281] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:37.998833 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08048a8-32c9-4780-b064-707a87a66afd admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:38.010217 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08048a8-32c9-4780-b064-707a87a66afd admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:38.016786 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724ae69-1fd9-4397-8a62-661910958838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:38.017442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724ae69-1fd9-4397-8a62-661910958838 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:38.017825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724ae69-1fd9-4397-8a62-661910958838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:38.018175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724ae69-1fd9-4397-8a62-661910958838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:38.018890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724ae69-1fd9-4397-8a62-661910958838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:38.020513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724ae69-1fd9-4397-8a62-661910958838 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:38.034783 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1124/2282] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:38.042778 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893171d-c3a1-4f37-b4d7-a6b9fce47505 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:38.054680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893171d-c3a1-4f37-b4d7-a6b9fce47505 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:38.060038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b758b8-8c1d-49f5-af1c-2b64d9cc8451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:38.060781 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b758b8-8c1d-49f5-af1c-2b64d9cc8451 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:38.061127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b758b8-8c1d-49f5-af1c-2b64d9cc8451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:38.061494 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b758b8-8c1d-49f5-af1c-2b64d9cc8451 admin admin] PATH_INFO: `/v3/projects/275ad26a1f5b472b897aa3e3f72160e8/users/133c1869f6e84d72bcffbfc99ffcbf79/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:38.077062 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b758b8-8c1d-49f5-af1c-2b64d9cc8451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=275ad26a1f5b472b897aa3e3f72160e8, user_id=133c1869f6e84d72bcffbfc99ffcbf79, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:38.081791 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b758b8-8c1d-49f5-af1c-2b64d9cc8451 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:38.184009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1159/2283] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:38 2022] PUT /identity/v3/projects/275ad26a1f5b472b897aa3e3f72160e8/users/133c1869f6e84d72bcffbfc99ffcbf79/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:38.196139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e934b-4449-4298-a33b-f225adee173e None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:38.196426 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e934b-4449-4298-a33b-f225adee173e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:38.196703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e934b-4449-4298-a33b-f225adee173e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:38.223769 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-6e2e934b-4449-4298-a33b-f225adee173e None None] MFA Rules not processed for user `133c1869f6e84d72bcffbfc99ffcbf79`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:38.225054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6e2e934b-4449-4298-a33b-f225adee173e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:38.297198 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1125/2284] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:38.332981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b758b8-8c1d-49f5-af1c-2b64d9cc8451 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:38.334727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-52b758b8-8c1d-49f5-af1c-2b64d9cc8451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:38.402774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b758b8-8c1d-49f5-af1c-2b64d9cc8451 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:38.408411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91547ed1-7e40-4f19-82ff-efde0bb38f37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:38.409024 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91547ed1-7e40-4f19-82ff-efde0bb38f37 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:38.409302 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91547ed1-7e40-4f19-82ff-efde0bb38f37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:38.409605 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91547ed1-7e40-4f19-82ff-efde0bb38f37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:38.418646 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91547ed1-7e40-4f19-82ff-efde0bb38f37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:38.420183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91547ed1-7e40-4f19-82ff-efde0bb38f37 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:38.429260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1160/2285] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:38.448137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e934b-4449-4298-a33b-f225adee173e None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:38.511240 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e934b-4449-4298-a33b-f225adee173e None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:38.518206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c7dca-ed62-4cdb-a6b1-8dde0692c4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:38.518842 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c7dca-ed62-4cdb-a6b1-8dde0692c4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:38.519258 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c7dca-ed62-4cdb-a6b1-8dde0692c4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:38.519532 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c7dca-ed62-4cdb-a6b1-8dde0692c4b7 admin admin] PATH_INFO: `/v3/users/133c1869f6e84d72bcffbfc99ffcbf79` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:38.520681 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c7dca-ed62-4cdb-a6b1-8dde0692c4b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=133c1869f6e84d72bcffbfc99ffcbf79)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:38.522758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126c7dca-ed62-4cdb-a6b1-8dde0692c4b7 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:38.727381 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-126c7dca-ed62-4cdb-a6b1-8dde0692c4b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '133c1869f6e84d72bcffbfc99ffcbf79'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:38.734454 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-126c7dca-ed62-4cdb-a6b1-8dde0692c4b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '133c1869f6e84d72bcffbfc99ffcbf79'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:38.735298 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-126c7dca-ed62-4cdb-a6b1-8dde0692c4b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '133c1869f6e84d72bcffbfc99ffcbf79'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:38.736050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-126c7dca-ed62-4cdb-a6b1-8dde0692c4b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '133c1869f6e84d72bcffbfc99ffcbf79'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:38.845877 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-126c7dca-ed62-4cdb-a6b1-8dde0692c4b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '133c1869f6e84d72bcffbfc99ffcbf79'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:38.866393 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1126/2286] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:38 2022] DELETE /identity/v3/users/133c1869f6e84d72bcffbfc99ffcbf79 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:38.870810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6194c-4289-48a3-a790-089b4d9e0b54 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:38.871102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6194c-4289-48a3-a790-089b4d9e0b54 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:38.871439 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6194c-4289-48a3-a790-089b4d9e0b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:38.890734 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-46b6194c-4289-48a3-a790-089b4d9e0b54 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:38.891942 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-46b6194c-4289-48a3-a790-089b4d9e0b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:38.925058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:38.949543 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1161/2287] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:38.959487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c7dca-ed62-4cdb-a6b1-8dde0692c4b7 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:38.960984 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-126c7dca-ed62-4cdb-a6b1-8dde0692c4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:39.019287 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126c7dca-ed62-4cdb-a6b1-8dde0692c4b7 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:39.022940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861e1f4-58df-4d74-8f92-d9348ee6696a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:39.023542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861e1f4-58df-4d74-8f92-d9348ee6696a service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:39.023827 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861e1f4-58df-4d74-8f92-d9348ee6696a service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:39.024097 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861e1f4-58df-4d74-8f92-d9348ee6696a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:39.033422 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861e1f4-58df-4d74-8f92-d9348ee6696a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:39.035031 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861e1f4-58df-4d74-8f92-d9348ee6696a service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:39.044337 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1127/2288] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:39.530194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6194c-4289-48a3-a790-089b4d9e0b54 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:39.532557 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-46b6194c-4289-48a3-a790-089b4d9e0b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:39.567675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861e1f4-58df-4d74-8f92-d9348ee6696a service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:39.569228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c861e1f4-58df-4d74-8f92-d9348ee6696a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:39.573151 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6194c-4289-48a3-a790-089b4d9e0b54 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:39.580293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afd5de-e212-46b7-9aec-bd1e600bb7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:39.581116 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afd5de-e212-46b7-9aec-bd1e600bb7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:39.581583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afd5de-e212-46b7-9aec-bd1e600bb7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:39.581876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afd5de-e212-46b7-9aec-bd1e600bb7c0 admin admin] PATH_INFO: `/v3/projects/275ad26a1f5b472b897aa3e3f72160e8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:39.583256 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afd5de-e212-46b7-9aec-bd1e600bb7c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=275ad26a1f5b472b897aa3e3f72160e8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:39.585276 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afd5de-e212-46b7-9aec-bd1e600bb7c0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:39.587011 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861e1f4-58df-4d74-8f92-d9348ee6696a service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:39.616665 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326de92-5256-4989-acec-6690927bc19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:39.622725 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326de92-5256-4989-acec-6690927bc19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:39.623080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326de92-5256-4989-acec-6690927bc19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:39.623417 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326de92-5256-4989-acec-6690927bc19c admin admin] PATH_INFO: `/v3/users/d8210c4eddc8487fa695a47e3508f9d8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:39.624837 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326de92-5256-4989-acec-6690927bc19c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8210c4eddc8487fa695a47e3508f9d8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:39.629314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326de92-5256-4989-acec-6690927bc19c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:39.776187 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-21afd5de-e212-46b7-9aec-bd1e600bb7c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '275ad26a1f5b472b897aa3e3f72160e8', 'request_id': 'req-21afd5de-e212-46b7-9aec-bd1e600bb7c0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:39.788202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-21afd5de-e212-46b7-9aec-bd1e600bb7c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '275ad26a1f5b472b897aa3e3f72160e8', 'request_id': 'req-21afd5de-e212-46b7-9aec-bd1e600bb7c0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:39.877437 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-21afd5de-e212-46b7-9aec-bd1e600bb7c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '275ad26a1f5b472b897aa3e3f72160e8', 'request_id': 'req-21afd5de-e212-46b7-9aec-bd1e600bb7c0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:39.894794 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2326de92-5256-4989-acec-6690927bc19c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8210c4eddc8487fa695a47e3508f9d8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:39.903589 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2326de92-5256-4989-acec-6690927bc19c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8210c4eddc8487fa695a47e3508f9d8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:39.904734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2326de92-5256-4989-acec-6690927bc19c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8210c4eddc8487fa695a47e3508f9d8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:39.913305 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2326de92-5256-4989-acec-6690927bc19c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8210c4eddc8487fa695a47e3508f9d8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:39.914482 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-21afd5de-e212-46b7-9aec-bd1e600bb7c0 admin admin] The token cache is being invalidate because project 275ad26a1f5b472b897aa3e3f72160e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:39.914991 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-21afd5de-e212-46b7-9aec-bd1e600bb7c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:39.915820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-21afd5de-e212-46b7-9aec-bd1e600bb7c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:39.918896 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1162/2289] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:39 2022] DELETE /identity/v3/projects/275ad26a1f5b472b897aa3e3f72160e8 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:39.924057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3fe9e-b7f8-4085-96ec-767c9660e44e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:39.924593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3fe9e-b7f8-4085-96ec-767c9660e44e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:39.925260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3fe9e-b7f8-4085-96ec-767c9660e44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:39.946415 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b7a3fe9e-b7f8-4085-96ec-767c9660e44e None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:39.947755 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b7a3fe9e-b7f8-4085-96ec-767c9660e44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:40.006411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1163/2290] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:40.013628 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2326de92-5256-4989-acec-6690927bc19c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8210c4eddc8487fa695a47e3508f9d8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:40.014249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145746f-85a4-41ce-a0c6-8884fc6873dd None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:40.014533 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145746f-85a4-41ce-a0c6-8884fc6873dd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:40.014818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145746f-85a4-41ce-a0c6-8884fc6873dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:40.035328 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1145746f-85a4-41ce-a0c6-8884fc6873dd None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:40.036416 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1145746f-85a4-41ce-a0c6-8884fc6873dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:40.040528 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1128/2291] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:39 2022] DELETE /identity/v3/users/d8210c4eddc8487fa695a47e3508f9d8 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:40.042057 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f582074-b25f-4bbc-bffa-9950953e2603 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:40.042880 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f582074-b25f-4bbc-bffa-9950953e2603 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:40.043150 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f582074-b25f-4bbc-bffa-9950953e2603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:40.063962 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-5f582074-b25f-4bbc-bffa-9950953e2603 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:40.065184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5f582074-b25f-4bbc-bffa-9950953e2603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:40.106009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1164/2292] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:40.110260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145746f-85a4-41ce-a0c6-8884fc6873dd None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:40.119439 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145746f-85a4-41ce-a0c6-8884fc6873dd None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:40.124119 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc8f45-ef67-42d8-a385-7fb57cbc8d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:40.124723 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc8f45-ef67-42d8-a385-7fb57cbc8d9a admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:40.124986 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc8f45-ef67-42d8-a385-7fb57cbc8d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:40.125256 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc8f45-ef67-42d8-a385-7fb57cbc8d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:40.126565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc8f45-ef67-42d8-a385-7fb57cbc8d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:19:40.126934 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc8f45-ef67-42d8-a385-7fb57cbc8d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:40.128600 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc8f45-ef67-42d8-a385-7fb57cbc8d9a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:40.130090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1129/2293] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:40.140211 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f582074-b25f-4bbc-bffa-9950953e2603 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:40.144525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1165/2294] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:19:40.144706 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5f582074-b25f-4bbc-bffa-9950953e2603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:40.145607 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc8f45-ef67-42d8-a385-7fb57cbc8d9a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:40.160078 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc8f45-ef67-42d8-a385-7fb57cbc8d9a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:40.164917 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263eac0a-3d10-4f10-b25e-22fc86108471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:40.165545 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263eac0a-3d10-4f10-b25e-22fc86108471 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:40.165934 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263eac0a-3d10-4f10-b25e-22fc86108471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:40.166208 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263eac0a-3d10-4f10-b25e-22fc86108471 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:40.166840 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263eac0a-3d10-4f10-b25e-22fc86108471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:40.168779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263eac0a-3d10-4f10-b25e-22fc86108471 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:40.200514 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f582074-b25f-4bbc-bffa-9950953e2603 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:40.204661 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c01762-0152-40a8-8a91-6f68b8880252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:40.205363 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c01762-0152-40a8-8a91-6f68b8880252 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:40.205642 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c01762-0152-40a8-8a91-6f68b8880252 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:40.211635 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c01762-0152-40a8-8a91-6f68b8880252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:40.214819 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c01762-0152-40a8-8a91-6f68b8880252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:40.216241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c01762-0152-40a8-8a91-6f68b8880252 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:40.225909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1130/2295] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:19:40.276163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1166/2296] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:19:40 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:19:40.277373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c01762-0152-40a8-8a91-6f68b8880252 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:40.287653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c01762-0152-40a8-8a91-6f68b8880252 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:40.296777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:40.345433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20e3de-10bc-4ef8-a780-569c301843b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:40.345894 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20e3de-10bc-4ef8-a780-569c301843b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:40.346225 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20e3de-10bc-4ef8-a780-569c301843b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:40.346477 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20e3de-10bc-4ef8-a780-569c301843b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:40.347103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20e3de-10bc-4ef8-a780-569c301843b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:40.349023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20e3de-10bc-4ef8-a780-569c301843b0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:40.528395 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263eac0a-3d10-4f10-b25e-22fc86108471 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:40.530154 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-263eac0a-3d10-4f10-b25e-22fc86108471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:40.545322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263eac0a-3d10-4f10-b25e-22fc86108471 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:40.551013 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6e61c-a63b-4d8e-aaab-780da3127735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:40.551781 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6e61c-a63b-4d8e-aaab-780da3127735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:40.552066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6e61c-a63b-4d8e-aaab-780da3127735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:40.555016 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6e61c-a63b-4d8e-aaab-780da3127735 admin admin] PATH_INFO: `/v3/projects/912cb83b9bb3450d8a6159e19ff09208` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:40.555016 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6e61c-a63b-4d8e-aaab-780da3127735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=912cb83b9bb3450d8a6159e19ff09208)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:40.555795 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6e61c-a63b-4d8e-aaab-780da3127735 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:40.628959 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1131/2297] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:19:40 2022] POST /identity/v3/users => generated 293 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:19:40.632908 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20e3de-10bc-4ef8-a780-569c301843b0 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:40.642770 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20e3de-10bc-4ef8-a780-569c301843b0 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:40.648761 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba282f4-0744-4e09-b867-3b716fa68204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:40.649360 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba282f4-0744-4e09-b867-3b716fa68204 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:40.649782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba282f4-0744-4e09-b867-3b716fa68204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:40.650061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba282f4-0744-4e09-b867-3b716fa68204 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:40.650698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba282f4-0744-4e09-b867-3b716fa68204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:40.652338 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba282f4-0744-4e09-b867-3b716fa68204 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:40.662521 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1132/2298] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:40.666230 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba282f4-0744-4e09-b867-3b716fa68204 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:40.679464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba282f4-0744-4e09-b867-3b716fa68204 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:40.684784 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c9ca5-bf83-4026-ae59-346f374d57ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:40.685424 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c9ca5-bf83-4026-ae59-346f374d57ca admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:40.689850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c9ca5-bf83-4026-ae59-346f374d57ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:40.689850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c9ca5-bf83-4026-ae59-346f374d57ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:40.689850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c9ca5-bf83-4026-ae59-346f374d57ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:40.689850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c9ca5-bf83-4026-ae59-346f374d57ca admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:40.703208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1133/2299] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:19:40.705632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c9ca5-bf83-4026-ae59-346f374d57ca admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:40.719434 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c9ca5-bf83-4026-ae59-346f374d57ca admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:40.749247 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8cf6e61c-a63b-4d8e-aaab-780da3127735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '912cb83b9bb3450d8a6159e19ff09208', 'request_id': 'req-8cf6e61c-a63b-4d8e-aaab-780da3127735'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:40.758062 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8cf6e61c-a63b-4d8e-aaab-780da3127735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '912cb83b9bb3450d8a6159e19ff09208', 'request_id': 'req-8cf6e61c-a63b-4d8e-aaab-780da3127735'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:40.783915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb6a38-8b06-4024-9dd4-a64cfb33e613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:40.784581 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb6a38-8b06-4024-9dd4-a64cfb33e613 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:40.784864 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb6a38-8b06-4024-9dd4-a64cfb33e613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:40.785140 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb6a38-8b06-4024-9dd4-a64cfb33e613 admin admin] PATH_INFO: `/v3/projects/f67a7dea16994a4c94333d0a4f495947/users/0430fb294efc4ce4880ef0df9f14be01/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:40.800434 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb6a38-8b06-4024-9dd4-a64cfb33e613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67a7dea16994a4c94333d0a4f495947, user_id=0430fb294efc4ce4880ef0df9f14be01, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:40.803264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb6a38-8b06-4024-9dd4-a64cfb33e613 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:40.885279 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8cf6e61c-a63b-4d8e-aaab-780da3127735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '912cb83b9bb3450d8a6159e19ff09208', 'request_id': 'req-8cf6e61c-a63b-4d8e-aaab-780da3127735'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:40.891578 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1134/2300] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:40 2022] PUT /identity/v3/projects/f67a7dea16994a4c94333d0a4f495947/users/0430fb294efc4ce4880ef0df9f14be01/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:40.903435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765aab9-6af8-458b-9845-54d4d5373e6a None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:40.904033 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765aab9-6af8-458b-9845-54d4d5373e6a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:40.904192 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765aab9-6af8-458b-9845-54d4d5373e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:40.906287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8cf6e61c-a63b-4d8e-aaab-780da3127735 admin admin] The token cache is being invalidate because project 912cb83b9bb3450d8a6159e19ff09208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:40.906770 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8cf6e61c-a63b-4d8e-aaab-780da3127735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:40.907787 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8cf6e61c-a63b-4d8e-aaab-780da3127735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:40.910064 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1167/2301] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:40 2022] DELETE /identity/v3/projects/912cb83b9bb3450d8a6159e19ff09208 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:40.914913 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998f197-b26e-4a44-bb28-bc07a99ed291 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:40.915436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998f197-b26e-4a44-bb28-bc07a99ed291 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:40.915908 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998f197-b26e-4a44-bb28-bc07a99ed291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:40.934146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9765aab9-6af8-458b-9845-54d4d5373e6a None None] MFA Rules not processed for user `0430fb294efc4ce4880ef0df9f14be01`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:40.935574 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9765aab9-6af8-458b-9845-54d4d5373e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:40.937214 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1998f197-b26e-4a44-bb28-bc07a99ed291 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:40.938435 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1998f197-b26e-4a44-bb28-bc07a99ed291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:41.012750 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1168/2302] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:41.025953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1135/2303] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:41.026062 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0c3cd-9ade-4b59-af6f-5eea4a32b86c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:41.026062 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0c3cd-9ade-4b59-af6f-5eea4a32b86c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:41.026062 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0c3cd-9ade-4b59-af6f-5eea4a32b86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:41.028337 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765aab9-6af8-458b-9845-54d4d5373e6a None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:41.028983 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9765aab9-6af8-458b-9845-54d4d5373e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:41.044561 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765aab9-6af8-458b-9845-54d4d5373e6a None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:41.046689 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c6f0c3cd-9ade-4b59-af6f-5eea4a32b86c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:41.047900 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c6f0c3cd-9ade-4b59-af6f-5eea4a32b86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:41.053561 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75502f-3e3c-4109-8b9c-a491126986d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:41.053561 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75502f-3e3c-4109-8b9c-a491126986d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:41.053561 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75502f-3e3c-4109-8b9c-a491126986d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:41.053561 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75502f-3e3c-4109-8b9c-a491126986d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:41.053945 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75502f-3e3c-4109-8b9c-a491126986d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:41.057123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75502f-3e3c-4109-8b9c-a491126986d0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:41.070755 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1169/2304] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:41.074121 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0c3cd-9ade-4b59-af6f-5eea4a32b86c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:41.083998 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0c3cd-9ade-4b59-af6f-5eea4a32b86c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:41.089039 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60b702-ec55-48d1-a00f-b8ec4b102d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:41.089795 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60b702-ec55-48d1-a00f-b8ec4b102d72 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:41.090094 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60b702-ec55-48d1-a00f-b8ec4b102d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:41.090360 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60b702-ec55-48d1-a00f-b8ec4b102d72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:41.091112 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60b702-ec55-48d1-a00f-b8ec4b102d72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:19:41.091490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60b702-ec55-48d1-a00f-b8ec4b102d72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:41.093081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60b702-ec55-48d1-a00f-b8ec4b102d72 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:41.104734 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1170/2305] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:19:41.109028 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60b702-ec55-48d1-a00f-b8ec4b102d72 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:41.119198 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60b702-ec55-48d1-a00f-b8ec4b102d72 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:41.124029 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376208ff-1f61-4e4b-9479-4e5ddb657119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:41.124621 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376208ff-1f61-4e4b-9479-4e5ddb657119 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:41.124908 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376208ff-1f61-4e4b-9479-4e5ddb657119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:41.125191 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376208ff-1f61-4e4b-9479-4e5ddb657119 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:41.125876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376208ff-1f61-4e4b-9479-4e5ddb657119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:41.128436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376208ff-1f61-4e4b-9479-4e5ddb657119 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:41.143626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1136/2306] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:19:41 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:19:41.144969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75502f-3e3c-4109-8b9c-a491126986d0 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:41.205612 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75502f-3e3c-4109-8b9c-a491126986d0 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:41.210452 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88280f0f-011b-4f78-8d57-73c6632f8273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:41.211073 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88280f0f-011b-4f78-8d57-73c6632f8273 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:41.211366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88280f0f-011b-4f78-8d57-73c6632f8273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:41.211640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88280f0f-011b-4f78-8d57-73c6632f8273 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:41.212262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88280f0f-011b-4f78-8d57-73c6632f8273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:41.214226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88280f0f-011b-4f78-8d57-73c6632f8273 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:41.246043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1171/2307] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:19:41 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:19:41.250221 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376208ff-1f61-4e4b-9479-4e5ddb657119 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:41.312540 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376208ff-1f61-4e4b-9479-4e5ddb657119 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:41.319145 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9851cc-4e82-46cc-8e4c-f3d9a543e6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:41.319760 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9851cc-4e82-46cc-8e4c-f3d9a543e6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:41.320044 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9851cc-4e82-46cc-8e4c-f3d9a543e6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:41.320402 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9851cc-4e82-46cc-8e4c-f3d9a543e6d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:41.321027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9851cc-4e82-46cc-8e4c-f3d9a543e6d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:41.323002 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9851cc-4e82-46cc-8e4c-f3d9a543e6d8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:41.327201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1137/2308] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:19:41 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:19:41.331863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88280f0f-011b-4f78-8d57-73c6632f8273 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:41.342159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88280f0f-011b-4f78-8d57-73c6632f8273 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:41.348297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbc87b-5506-4986-b91e-ea8136a685de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:41.352734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:41.352734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbc87b-5506-4986-b91e-ea8136a685de admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:41.352734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbc87b-5506-4986-b91e-ea8136a685de admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:41.352734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbc87b-5506-4986-b91e-ea8136a685de admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:41.352734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbc87b-5506-4986-b91e-ea8136a685de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:41.353360 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbc87b-5506-4986-b91e-ea8136a685de admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:41.364082 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1138/2309] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:19:41.367903 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbc87b-5506-4986-b91e-ea8136a685de admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:41.378068 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbc87b-5506-4986-b91e-ea8136a685de admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:41.382758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96160798-b471-4810-b8d1-910b690e2921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:41.383331 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96160798-b471-4810-b8d1-910b690e2921 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:41.383613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96160798-b471-4810-b8d1-910b690e2921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:41.383886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96160798-b471-4810-b8d1-910b690e2921 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:41.384506 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96160798-b471-4810-b8d1-910b690e2921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:41.386105 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96160798-b471-4810-b8d1-910b690e2921 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:41.397167 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1139/2310] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:19:41.401219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96160798-b471-4810-b8d1-910b690e2921 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:41.411250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96160798-b471-4810-b8d1-910b690e2921 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:41.415937 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c2db3-37ef-41ea-a34e-3ecffe5d0c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:41.416504 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c2db3-37ef-41ea-a34e-3ecffe5d0c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:41.416788 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c2db3-37ef-41ea-a34e-3ecffe5d0c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:41.417064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c2db3-37ef-41ea-a34e-3ecffe5d0c1d admin admin] PATH_INFO: `/v3/projects/6ef890d091504dea93d9ca14446443c8/users/77f3932ad9974eb0a16521579d8e0f45/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:41.428002 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1172/2311] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:19:41 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:19:41.432069 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c2db3-37ef-41ea-a34e-3ecffe5d0c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef890d091504dea93d9ca14446443c8, user_id=77f3932ad9974eb0a16521579d8e0f45, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:41.434859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c2db3-37ef-41ea-a34e-3ecffe5d0c1d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:41.434978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9851cc-4e82-46cc-8e4c-f3d9a543e6d8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:41.444494 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9851cc-4e82-46cc-8e4c-f3d9a543e6d8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:41.449083 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5facf7-d8de-48d1-a078-dd9e91bd3bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:41.449702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5facf7-d8de-48d1-a078-dd9e91bd3bef admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:41.449984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5facf7-d8de-48d1-a078-dd9e91bd3bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:41.450258 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5facf7-d8de-48d1-a078-dd9e91bd3bef admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:41.455063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5facf7-d8de-48d1-a078-dd9e91bd3bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:41.455063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5facf7-d8de-48d1-a078-dd9e91bd3bef admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:41.462540 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1173/2312] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:19:41.466275 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5facf7-d8de-48d1-a078-dd9e91bd3bef admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:41.475859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5facf7-d8de-48d1-a078-dd9e91bd3bef admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:41.480521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429613b-bf11-4fbe-b4fd-e8acf68f5517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:41.481088 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429613b-bf11-4fbe-b4fd-e8acf68f5517 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:41.481370 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429613b-bf11-4fbe-b4fd-e8acf68f5517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:41.481675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429613b-bf11-4fbe-b4fd-e8acf68f5517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:41.483813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429613b-bf11-4fbe-b4fd-e8acf68f5517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:41.483813 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429613b-bf11-4fbe-b4fd-e8acf68f5517 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:41.496971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1174/2313] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:19:41.500929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429613b-bf11-4fbe-b4fd-e8acf68f5517 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:41.511084 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429613b-bf11-4fbe-b4fd-e8acf68f5517 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:41.515800 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1c6cd-a037-41c9-9d94-c65f32ce5b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:41.516442 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1c6cd-a037-41c9-9d94-c65f32ce5b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:41.516721 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1c6cd-a037-41c9-9d94-c65f32ce5b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:41.516993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1c6cd-a037-41c9-9d94-c65f32ce5b24 admin admin] PATH_INFO: `/v3/projects/3599247f04a348fda3e8b6ff2a569b51/users/46fb993dd5d7441fa70a8bc930cccff8/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:41.531283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1c6cd-a037-41c9-9d94-c65f32ce5b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3599247f04a348fda3e8b6ff2a569b51, user_id=46fb993dd5d7441fa70a8bc930cccff8, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:41.533972 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1c6cd-a037-41c9-9d94-c65f32ce5b24 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:41.582400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1140/2314] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:41 2022] PUT /identity/v3/projects/6ef890d091504dea93d9ca14446443c8/users/77f3932ad9974eb0a16521579d8e0f45/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:41.592462 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d13611-d586-4ea1-94df-03221afbbdd7 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:41.592755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d13611-d586-4ea1-94df-03221afbbdd7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:41.593032 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d13611-d586-4ea1-94df-03221afbbdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:41.610559 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1175/2315] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:41 2022] PUT /identity/v3/projects/3599247f04a348fda3e8b6ff2a569b51/users/46fb993dd5d7441fa70a8bc930cccff8/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:41.618448 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51201d-a340-4c6d-8a74-a4ef3472ba07 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:41.618739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51201d-a340-4c6d-8a74-a4ef3472ba07 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:41.619015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51201d-a340-4c6d-8a74-a4ef3472ba07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:41.621894 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a8d13611-d586-4ea1-94df-03221afbbdd7 None None] MFA Rules not processed for user `77f3932ad9974eb0a16521579d8e0f45`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:41.623114 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a8d13611-d586-4ea1-94df-03221afbbdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:41.638007 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5d51201d-a340-4c6d-8a74-a4ef3472ba07 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:41.639192 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5d51201d-a340-4c6d-8a74-a4ef3472ba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:41.687949 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1141/2316] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:41.693346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d13611-d586-4ea1-94df-03221afbbdd7 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:41.697215 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1176/2317] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:41.704087 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d13611-d586-4ea1-94df-03221afbbdd7 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:41.706945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51201d-a340-4c6d-8a74-a4ef3472ba07 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:41.708360 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5d51201d-a340-4c6d-8a74-a4ef3472ba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:41.709157 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fec3a-b235-47df-a797-8ba6f86f1ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:41.709819 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fec3a-b235-47df-a797-8ba6f86f1ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:41.710100 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fec3a-b235-47df-a797-8ba6f86f1ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:41.710374 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fec3a-b235-47df-a797-8ba6f86f1ee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:41.711001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fec3a-b235-47df-a797-8ba6f86f1ee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:41.712935 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fec3a-b235-47df-a797-8ba6f86f1ee2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:41.741877 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:41.767275 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51201d-a340-4c6d-8a74-a4ef3472ba07 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:41.771833 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d906b3a-e4cc-4905-8e61-6d9c95a4ecfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:41.772440 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d906b3a-e4cc-4905-8e61-6d9c95a4ecfd service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:41.772789 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d906b3a-e4cc-4905-8e61-6d9c95a4ecfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:41.773057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d906b3a-e4cc-4905-8e61-6d9c95a4ecfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:41.782411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d906b3a-e4cc-4905-8e61-6d9c95a4ecfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:41.783852 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d906b3a-e4cc-4905-8e61-6d9c95a4ecfd service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:41.794534 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1142/2318] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:19:41 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:19:41.794669 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1177/2319] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:19:41.799116 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fec3a-b235-47df-a797-8ba6f86f1ee2 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:41.837153 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:41.869605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fec3a-b235-47df-a797-8ba6f86f1ee2 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:41.874440 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a76ec-6960-4b1e-948c-bbe2f676feb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:41.875046 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a76ec-6960-4b1e-948c-bbe2f676feb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:41.875326 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a76ec-6960-4b1e-948c-bbe2f676feb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:41.875599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a76ec-6960-4b1e-948c-bbe2f676feb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:41.876233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a76ec-6960-4b1e-948c-bbe2f676feb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:41.878901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a76ec-6960-4b1e-948c-bbe2f676feb2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:42.003327 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1143/2320] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:19:41 2022] POST /identity/v3/users => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:19:42.003909 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d906b3a-e4cc-4905-8e61-6d9c95a4ecfd service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:42.004550 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d906b3a-e4cc-4905-8e61-6d9c95a4ecfd service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:42.012858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe6c71-2691-4a84-af20-9cd8d79fff7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:42.013698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe6c71-2691-4a84-af20-9cd8d79fff7c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:42.014124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe6c71-2691-4a84-af20-9cd8d79fff7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:42.014565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe6c71-2691-4a84-af20-9cd8d79fff7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:42.015981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe6c71-2691-4a84-af20-9cd8d79fff7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:42.020376 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fe6c71-2691-4a84-af20-9cd8d79fff7c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:42.053373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1178/2321] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:42.058029 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a76ec-6960-4b1e-948c-bbe2f676feb2 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:42.083848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a76ec-6960-4b1e-948c-bbe2f676feb2 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:42.083848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4a942-d6ac-4fe9-89ca-e2f04c3b0cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:42.083848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4a942-d6ac-4fe9-89ca-e2f04c3b0cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:42.083848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4a942-d6ac-4fe9-89ca-e2f04c3b0cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:42.084318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4a942-d6ac-4fe9-89ca-e2f04c3b0cb0 admin admin] PATH_INFO: `/v3/projects/523b5792d0b24b58969b3edcf8338c0d/users/a21ee035c2094c708acb966457eb8854/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:42.104801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4a942-d6ac-4fe9-89ca-e2f04c3b0cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=523b5792d0b24b58969b3edcf8338c0d, user_id=a21ee035c2094c708acb966457eb8854, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:42.111638 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4a942-d6ac-4fe9-89ca-e2f04c3b0cb0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:42.224198 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1144/2322] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:42 2022] PUT /identity/v3/projects/523b5792d0b24b58969b3edcf8338c0d/users/a21ee035c2094c708acb966457eb8854/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:42.228609 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe6c71-2691-4a84-af20-9cd8d79fff7c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:42.244953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe6c71-2691-4a84-af20-9cd8d79fff7c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:42.308728 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:42.328313 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b5755-277b-4edb-bd3a-21057da54631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:42.329029 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b5755-277b-4edb-bd3a-21057da54631 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:42.329380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b5755-277b-4edb-bd3a-21057da54631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:42.329759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b5755-277b-4edb-bd3a-21057da54631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:42.330504 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b5755-277b-4edb-bd3a-21057da54631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:42.332856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b5755-277b-4edb-bd3a-21057da54631 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:42.349835 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1179/2323] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:42.351140 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4a942-d6ac-4fe9-89ca-e2f04c3b0cb0 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:42.362941 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4a942-d6ac-4fe9-89ca-e2f04c3b0cb0 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:42.374239 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5378f90-822e-4ee2-9f85-ef13b0ada811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:42.374239 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5378f90-822e-4ee2-9f85-ef13b0ada811 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:42.374239 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5378f90-822e-4ee2-9f85-ef13b0ada811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:42.374239 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5378f90-822e-4ee2-9f85-ef13b0ada811 admin admin] PATH_INFO: `/v3/projects/523b5792d0b24b58969b3edcf8338c0d/users/a21ee035c2094c708acb966457eb8854/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:42.375401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5378f90-822e-4ee2-9f85-ef13b0ada811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=523b5792d0b24b58969b3edcf8338c0d, user_id=a21ee035c2094c708acb966457eb8854, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:42.378890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5378f90-822e-4ee2-9f85-ef13b0ada811 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:42.392971 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1145/2324] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:42 2022] PUT /identity/v3/projects/523b5792d0b24b58969b3edcf8338c0d/users/a21ee035c2094c708acb966457eb8854/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:42.405540 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce23afa-a9f9-4b41-8064-0c79141f122a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:42.406464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce23afa-a9f9-4b41-8064-0c79141f122a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:42.414453 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce23afa-a9f9-4b41-8064-0c79141f122a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:42.439831 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-bce23afa-a9f9-4b41-8064-0c79141f122a None None] MFA Rules not processed for user `a21ee035c2094c708acb966457eb8854`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:42.441318 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bce23afa-a9f9-4b41-8064-0c79141f122a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:42.520024 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1180/2325] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:42.528161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:42.532460 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5378f90-822e-4ee2-9f85-ef13b0ada811 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:42.536467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c5378f90-822e-4ee2-9f85-ef13b0ada811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:42.596495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5378f90-822e-4ee2-9f85-ef13b0ada811 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:42.600061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd23950-8acc-4442-82d9-493483a31b1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:42.600664 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd23950-8acc-4442-82d9-493483a31b1d service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:42.600934 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd23950-8acc-4442-82d9-493483a31b1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:42.601201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd23950-8acc-4442-82d9-493483a31b1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:42.656097 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd23950-8acc-4442-82d9-493483a31b1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:42.657639 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd23950-8acc-4442-82d9-493483a31b1d service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:42.667389 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1146/2326] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:44.100925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:44.278319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:44.963343 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:45.903888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce23afa-a9f9-4b41-8064-0c79141f122a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:45.917668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce23afa-a9f9-4b41-8064-0c79141f122a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:45.923666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fa6e3-d9fa-4646-80db-8da7c5045fab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:45.924716 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fa6e3-d9fa-4646-80db-8da7c5045fab service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:45.925328 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fa6e3-d9fa-4646-80db-8da7c5045fab service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:45.931079 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fa6e3-d9fa-4646-80db-8da7c5045fab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:46.022882 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fa6e3-d9fa-4646-80db-8da7c5045fab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:46.024548 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fa6e3-d9fa-4646-80db-8da7c5045fab service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:46.034980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1181/2327] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:46.866761 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:47.163655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:47.809906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd23950-8acc-4442-82d9-493483a31b1d service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:47.819367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd23950-8acc-4442-82d9-493483a31b1d service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:47.823280 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b9f3a-6824-4949-a2f2-67d3d7d47919 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:47.824115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b9f3a-6824-4949-a2f2-67d3d7d47919 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:47.824566 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b9f3a-6824-4949-a2f2-67d3d7d47919 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:47.825001 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b9f3a-6824-4949-a2f2-67d3d7d47919 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:47.835913 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b9f3a-6824-4949-a2f2-67d3d7d47919 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:47.837921 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b9f3a-6824-4949-a2f2-67d3d7d47919 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:47.851025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1147/2328] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:49.369608 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:49.554928 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd956b-8941-4e18-b673-3cdd9ef496dd None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:49.556056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd956b-8941-4e18-b673-3cdd9ef496dd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:49.556716 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd956b-8941-4e18-b673-3cdd9ef496dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:49.596425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a7bd956b-8941-4e18-b673-3cdd9ef496dd None None] MFA Rules not processed for user `46fb993dd5d7441fa70a8bc930cccff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:49.597781 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a7bd956b-8941-4e18-b673-3cdd9ef496dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:49.681110 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:49.717238 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1182/2329] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:49.721849 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b9f3a-6824-4949-a2f2-67d3d7d47919 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:49.786869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b9f3a-6824-4949-a2f2-67d3d7d47919 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:49.791481 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61c7bd-671b-475b-9cf2-16742024e8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:49.792079 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61c7bd-671b-475b-9cf2-16742024e8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:49.792356 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61c7bd-671b-475b-9cf2-16742024e8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:49.792625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61c7bd-671b-475b-9cf2-16742024e8d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:49.793233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61c7bd-671b-475b-9cf2-16742024e8d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:49.795171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61c7bd-671b-475b-9cf2-16742024e8d0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:49.879772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1148/2330] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:19:49 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:19:49.883997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd956b-8941-4e18-b673-3cdd9ef496dd None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:49.894891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd956b-8941-4e18-b673-3cdd9ef496dd None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:49.950945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e209e55-0cdf-41aa-bd05-faa8392ac63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:49.951559 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e209e55-0cdf-41aa-bd05-faa8392ac63d admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:49.951851 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e209e55-0cdf-41aa-bd05-faa8392ac63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:49.952108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e209e55-0cdf-41aa-bd05-faa8392ac63d admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:49.952741 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e209e55-0cdf-41aa-bd05-faa8392ac63d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:49.955766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e209e55-0cdf-41aa-bd05-faa8392ac63d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:50.076550 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1183/2331] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:19:49 2022] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:19:50.080651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61c7bd-671b-475b-9cf2-16742024e8d0 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:50.092712 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61c7bd-671b-475b-9cf2-16742024e8d0 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:50.104984 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301173ab-751b-4651-94d0-6218cb3bd499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:50.104984 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301173ab-751b-4651-94d0-6218cb3bd499 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:50.104984 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301173ab-751b-4651-94d0-6218cb3bd499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:50.104984 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301173ab-751b-4651-94d0-6218cb3bd499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:50.105351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301173ab-751b-4651-94d0-6218cb3bd499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:50.105351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301173ab-751b-4651-94d0-6218cb3bd499 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:50.124978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1149/2332] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:50.126900 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e209e55-0cdf-41aa-bd05-faa8392ac63d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:50.141404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e209e55-0cdf-41aa-bd05-faa8392ac63d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:50.147020 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d9bb2-6823-4ab0-8829-43a136344803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:50.147740 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d9bb2-6823-4ab0-8829-43a136344803 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:50.147912 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d9bb2-6823-4ab0-8829-43a136344803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:50.148170 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d9bb2-6823-4ab0-8829-43a136344803 admin admin] PATH_INFO: `/v3/projects/d4d581a6029549d7a4f53cb77e28c486/users/50a0e8f237ea44a3a33b29c3b75b4380/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:50.176664 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d9bb2-6823-4ab0-8829-43a136344803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d581a6029549d7a4f53cb77e28c486, user_id=50a0e8f237ea44a3a33b29c3b75b4380, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:50.179902 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d9bb2-6823-4ab0-8829-43a136344803 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:50.275611 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1184/2333] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:50 2022] PUT /identity/v3/projects/d4d581a6029549d7a4f53cb77e28c486/users/50a0e8f237ea44a3a33b29c3b75b4380/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:50.279838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301173ab-751b-4651-94d0-6218cb3bd499 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:50.290456 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301173ab-751b-4651-94d0-6218cb3bd499 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:50.358336 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f88a2-edd2-4903-be35-299d4538d172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:50.358936 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f88a2-edd2-4903-be35-299d4538d172 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:50.359223 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f88a2-edd2-4903-be35-299d4538d172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:50.372993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f88a2-edd2-4903-be35-299d4538d172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:50.372993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f88a2-edd2-4903-be35-299d4538d172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:50.372993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f88a2-edd2-4903-be35-299d4538d172 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:50.372993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1150/2334] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:19:50.377485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d9bb2-6823-4ab0-8829-43a136344803 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:50.389404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d9bb2-6823-4ab0-8829-43a136344803 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:50.395639 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872a76a-d076-49d9-b439-8491efaa7131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:50.396434 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872a76a-d076-49d9-b439-8491efaa7131 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:50.396717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872a76a-d076-49d9-b439-8491efaa7131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:50.396974 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872a76a-d076-49d9-b439-8491efaa7131 admin admin] PATH_INFO: `/v3/projects/d4d581a6029549d7a4f53cb77e28c486/users/50a0e8f237ea44a3a33b29c3b75b4380/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:50.401652 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872a76a-d076-49d9-b439-8491efaa7131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d581a6029549d7a4f53cb77e28c486, user_id=50a0e8f237ea44a3a33b29c3b75b4380, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:50.402129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872a76a-d076-49d9-b439-8491efaa7131 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:50.416752 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1185/2335] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:19:50 2022] PUT /identity/v3/projects/d4d581a6029549d7a4f53cb77e28c486/users/50a0e8f237ea44a3a33b29c3b75b4380/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:51.047645 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:51.529807 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:52.745724 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:54.031678 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:54.451075 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f88a2-edd2-4903-be35-299d4538d172 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:54.461805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f88a2-edd2-4903-be35-299d4538d172 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:54.565367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ab6e4-19f2-43a5-b02a-9d4e017c528e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:54.566109 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ab6e4-19f2-43a5-b02a-9d4e017c528e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:54.566395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ab6e4-19f2-43a5-b02a-9d4e017c528e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:54.566670 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ab6e4-19f2-43a5-b02a-9d4e017c528e admin admin] PATH_INFO: `/v3/users/0430fb294efc4ce4880ef0df9f14be01` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:54.568328 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ab6e4-19f2-43a5-b02a-9d4e017c528e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0430fb294efc4ce4880ef0df9f14be01)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:54.570475 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ab6e4-19f2-43a5-b02a-9d4e017c528e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:54.770424 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:54.802996 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-943ab6e4-19f2-43a5-b02a-9d4e017c528e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0430fb294efc4ce4880ef0df9f14be01'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:54.811458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-943ab6e4-19f2-43a5-b02a-9d4e017c528e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0430fb294efc4ce4880ef0df9f14be01'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:54.812542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-943ab6e4-19f2-43a5-b02a-9d4e017c528e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0430fb294efc4ce4880ef0df9f14be01'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:54.813218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-943ab6e4-19f2-43a5-b02a-9d4e017c528e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0430fb294efc4ce4880ef0df9f14be01'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:54.936032 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-943ab6e4-19f2-43a5-b02a-9d4e017c528e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0430fb294efc4ce4880ef0df9f14be01'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:54.966773 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1151/2336] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:54 2022] DELETE /identity/v3/users/0430fb294efc4ce4880ef0df9f14be01 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:54.971704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49d5fe-a768-4add-8187-6b2c91133a60 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:54.972169 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49d5fe-a768-4add-8187-6b2c91133a60 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:54.972491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49d5fe-a768-4add-8187-6b2c91133a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:54.998554 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ed49d5fe-a768-4add-8187-6b2c91133a60 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:54.999868 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ed49d5fe-a768-4add-8187-6b2c91133a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:55.074128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1186/2337] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:55.080674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ab6e4-19f2-43a5-b02a-9d4e017c528e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:55.085869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-943ab6e4-19f2-43a5-b02a-9d4e017c528e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:55.229854 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ab6e4-19f2-43a5-b02a-9d4e017c528e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:55.250718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277be39c-c2b6-4bc5-a028-94db0fb45ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:55.252057 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277be39c-c2b6-4bc5-a028-94db0fb45ded service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:55.252350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277be39c-c2b6-4bc5-a028-94db0fb45ded service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:55.252626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277be39c-c2b6-4bc5-a028-94db0fb45ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:55.272488 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277be39c-c2b6-4bc5-a028-94db0fb45ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:55.274003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277be39c-c2b6-4bc5-a028-94db0fb45ded service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:55.285849 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1152/2338] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:19:55.746512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:55.894375 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49d5fe-a768-4add-8187-6b2c91133a60 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:55.896358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ed49d5fe-a768-4add-8187-6b2c91133a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:55.911060 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49d5fe-a768-4add-8187-6b2c91133a60 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:55.916303 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a4917-8f3c-45ae-a337-af622bd6211f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:55.919286 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a4917-8f3c-45ae-a337-af622bd6211f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:55.919286 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a4917-8f3c-45ae-a337-af622bd6211f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:55.919286 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a4917-8f3c-45ae-a337-af622bd6211f admin admin] PATH_INFO: `/v3/projects/f67a7dea16994a4c94333d0a4f495947` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:55.920488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a4917-8f3c-45ae-a337-af622bd6211f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f67a7dea16994a4c94333d0a4f495947)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:55.922132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a4917-8f3c-45ae-a337-af622bd6211f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:56.051837 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-753a4917-8f3c-45ae-a337-af622bd6211f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f67a7dea16994a4c94333d0a4f495947', 'request_id': 'req-753a4917-8f3c-45ae-a337-af622bd6211f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:56.058148 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-753a4917-8f3c-45ae-a337-af622bd6211f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f67a7dea16994a4c94333d0a4f495947', 'request_id': 'req-753a4917-8f3c-45ae-a337-af622bd6211f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:56.117441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-753a4917-8f3c-45ae-a337-af622bd6211f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f67a7dea16994a4c94333d0a4f495947', 'request_id': 'req-753a4917-8f3c-45ae-a337-af622bd6211f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:56.131909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03162753-5fce-42b7-8d78-9c50f40501f7 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:56.132459 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03162753-5fce-42b7-8d78-9c50f40501f7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:56.132674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03162753-5fce-42b7-8d78-9c50f40501f7 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:56.134407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1153/2339] 10.222.0.65 () {54 vars in 921 bytes} [Tue Aug 9 19:19:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:19:56.135834 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-753a4917-8f3c-45ae-a337-af622bd6211f admin admin] The token cache is being invalidate because project f67a7dea16994a4c94333d0a4f495947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:56.135834 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-753a4917-8f3c-45ae-a337-af622bd6211f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:56.136895 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-753a4917-8f3c-45ae-a337-af622bd6211f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:56.138894 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1187/2340] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:55 2022] DELETE /identity/v3/projects/f67a7dea16994a4c94333d0a4f495947 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:56.142655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03162753-5fce-42b7-8d78-9c50f40501f7 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:56.144326 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-03162753-5fce-42b7-8d78-9c50f40501f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:56.193610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2678de7-3a82-4dd3-b020-0b826699478c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:56.194425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2678de7-3a82-4dd3-b020-0b826699478c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:56.196906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2678de7-3a82-4dd3-b020-0b826699478c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:56.216948 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f2678de7-3a82-4dd3-b020-0b826699478c None None] MFA Rules not processed for user `c6172f0733384291992624ef6a527ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:56.218883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f2678de7-3a82-4dd3-b020-0b826699478c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:56.219717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03162753-5fce-42b7-8d78-9c50f40501f7 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:56.225580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2b5fd-9320-49a5-92b9-ea825f69e804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:56.230289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2b5fd-9320-49a5-92b9-ea825f69e804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:56.230289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2b5fd-9320-49a5-92b9-ea825f69e804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:56.230289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2b5fd-9320-49a5-92b9-ea825f69e804 admin admin] PATH_INFO: `/v3/users/77f3932ad9974eb0a16521579d8e0f45` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:56.230289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2b5fd-9320-49a5-92b9-ea825f69e804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f3932ad9974eb0a16521579d8e0f45)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:56.230289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2b5fd-9320-49a5-92b9-ea825f69e804 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:56.308201 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1188/2341] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Aug 9 19:19:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:56.320166 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2678de7-3a82-4dd3-b020-0b826699478c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:56.321575 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f2678de7-3a82-4dd3-b020-0b826699478c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:56.335003 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2678de7-3a82-4dd3-b020-0b826699478c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:56.340247 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99e0ab-026f-4ae3-b27b-8f86ea211d82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6172f0733384291992624ef6a527ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:56.341014 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99e0ab-026f-4ae3-b27b-8f86ea211d82 service placement] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:56.341298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99e0ab-026f-4ae3-b27b-8f86ea211d82 service placement] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:56.341602 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99e0ab-026f-4ae3-b27b-8f86ea211d82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:56.351244 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99e0ab-026f-4ae3-b27b-8f86ea211d82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:56.352855 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99e0ab-026f-4ae3-b27b-8f86ea211d82 service placement] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:56.363935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1189/2342] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:19:56.497178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:56.512342 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cfa2b5fd-9320-49a5-92b9-ea825f69e804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f3932ad9974eb0a16521579d8e0f45'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:56.520792 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cfa2b5fd-9320-49a5-92b9-ea825f69e804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f3932ad9974eb0a16521579d8e0f45'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:56.521986 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cfa2b5fd-9320-49a5-92b9-ea825f69e804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f3932ad9974eb0a16521579d8e0f45'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:56.524103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cfa2b5fd-9320-49a5-92b9-ea825f69e804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f3932ad9974eb0a16521579d8e0f45'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:56.673279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-cfa2b5fd-9320-49a5-92b9-ea825f69e804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f3932ad9974eb0a16521579d8e0f45'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:56.705399 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1154/2343] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:56 2022] DELETE /identity/v3/users/77f3932ad9974eb0a16521579d8e0f45 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:57.023439 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:57.366042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99e0ab-026f-4ae3-b27b-8f86ea211d82 service placement] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:57.368308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9b99e0ab-026f-4ae3-b27b-8f86ea211d82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:57.396253 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99e0ab-026f-4ae3-b27b-8f86ea211d82 service placement] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:57.511518 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51e506-f993-4f93-92d1-8718c1d7a338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:57.512182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51e506-f993-4f93-92d1-8718c1d7a338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:57.512463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51e506-f993-4f93-92d1-8718c1d7a338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:57.512736 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51e506-f993-4f93-92d1-8718c1d7a338 admin admin] PATH_INFO: `/v3/users/b13695af76fe4746890bb74b3012d009` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:57.514229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51e506-f993-4f93-92d1-8718c1d7a338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b13695af76fe4746890bb74b3012d009)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:57.518911 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51e506-f993-4f93-92d1-8718c1d7a338 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:57.639946 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2b5fd-9320-49a5-92b9-ea825f69e804 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:57.641711 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cfa2b5fd-9320-49a5-92b9-ea825f69e804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:57.676454 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2b5fd-9320-49a5-92b9-ea825f69e804 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:57.691370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52caad-91e7-4505-a6b7-f5c7c4718865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:57.692593 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52caad-91e7-4505-a6b7-f5c7c4718865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:57.693094 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52caad-91e7-4505-a6b7-f5c7c4718865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:57.695072 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52caad-91e7-4505-a6b7-f5c7c4718865 admin admin] PATH_INFO: `/v3/projects/6ef890d091504dea93d9ca14446443c8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:57.696724 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52caad-91e7-4505-a6b7-f5c7c4718865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef890d091504dea93d9ca14446443c8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:57.699068 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52caad-91e7-4505-a6b7-f5c7c4718865 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:57.714620 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2c51e506-f993-4f93-92d1-8718c1d7a338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b13695af76fe4746890bb74b3012d009'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:57.800042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2c51e506-f993-4f93-92d1-8718c1d7a338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b13695af76fe4746890bb74b3012d009'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:57.801207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2c51e506-f993-4f93-92d1-8718c1d7a338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b13695af76fe4746890bb74b3012d009'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:57.802324 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2c51e506-f993-4f93-92d1-8718c1d7a338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b13695af76fe4746890bb74b3012d009'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:57.812427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2c51e506-f993-4f93-92d1-8718c1d7a338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b13695af76fe4746890bb74b3012d009'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:57.841348 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1190/2344] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:57 2022] DELETE /identity/v3/users/b13695af76fe4746890bb74b3012d009 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:57.847625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0e52caad-91e7-4505-a6b7-f5c7c4718865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef890d091504dea93d9ca14446443c8', 'request_id': 'req-0e52caad-91e7-4505-a6b7-f5c7c4718865'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:57.855570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0e52caad-91e7-4505-a6b7-f5c7c4718865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef890d091504dea93d9ca14446443c8', 'request_id': 'req-0e52caad-91e7-4505-a6b7-f5c7c4718865'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:57.904385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2aea1-7c63-44ad-88ab-f168f59660e1 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:57.904787 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2aea1-7c63-44ad-88ab-f168f59660e1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:57.905136 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2aea1-7c63-44ad-88ab-f168f59660e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:57.940282 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0e52caad-91e7-4505-a6b7-f5c7c4718865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef890d091504dea93d9ca14446443c8', 'request_id': 'req-0e52caad-91e7-4505-a6b7-f5c7c4718865'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:57.955221 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-91c2aea1-7c63-44ad-88ab-f168f59660e1 None None] MFA Rules not processed for user `50a0e8f237ea44a3a33b29c3b75b4380`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:57.955221 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-91c2aea1-7c63-44ad-88ab-f168f59660e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:57.965244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0e52caad-91e7-4505-a6b7-f5c7c4718865 admin admin] The token cache is being invalidate because project 6ef890d091504dea93d9ca14446443c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:57.965683 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0e52caad-91e7-4505-a6b7-f5c7c4718865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:57.966620 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0e52caad-91e7-4505-a6b7-f5c7c4718865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:57.968802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1155/2345] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:57 2022] DELETE /identity/v3/projects/6ef890d091504dea93d9ca14446443c8 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:57.972791 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52caad-91e7-4505-a6b7-f5c7c4718865 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:57.974709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0e52caad-91e7-4505-a6b7-f5c7c4718865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:58.065761 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1191/2346] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:19:58.077508 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52caad-91e7-4505-a6b7-f5c7c4718865 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:58.080469 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2aea1-7c63-44ad-88ab-f168f59660e1 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:58.082127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-91c2aea1-7c63-44ad-88ab-f168f59660e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:58.156942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c2701-c267-4c64-b106-bd31673659c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:58.157638 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c2701-c267-4c64-b106-bd31673659c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:58.157925 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c2701-c267-4c64-b106-bd31673659c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:58.158199 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c2701-c267-4c64-b106-bd31673659c6 admin admin] PATH_INFO: `/v3/users/a21ee035c2094c708acb966457eb8854` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:58.159381 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c2701-c267-4c64-b106-bd31673659c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a21ee035c2094c708acb966457eb8854)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:58.161661 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c2701-c267-4c64-b106-bd31673659c6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:58.167494 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2aea1-7c63-44ad-88ab-f168f59660e1 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:58.172056 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f21b2-c1f5-4dc8-abf2-e30a0bccf1df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d8000eb20445b78ee56ac372cd024c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:58.172672 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f21b2-c1f5-4dc8-abf2-e30a0bccf1df service glance] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:58.172957 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f21b2-c1f5-4dc8-abf2-e30a0bccf1df service glance] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:58.173232 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f21b2-c1f5-4dc8-abf2-e30a0bccf1df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:58.175032 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c59f21b2-c1f5-4dc8-abf2-e30a0bccf1df service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:58.256229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f21b2-c1f5-4dc8-abf2-e30a0bccf1df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:58.258233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f21b2-c1f5-4dc8-abf2-e30a0bccf1df service glance] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:58.268274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1192/2347] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:19:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:19:58.269142 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f21b2-c1f5-4dc8-abf2-e30a0bccf1df service glance] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:58.271176 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c59f21b2-c1f5-4dc8-abf2-e30a0bccf1df service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:58.288512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f21b2-c1f5-4dc8-abf2-e30a0bccf1df service glance] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:58.293540 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda72d2-4816-4cdf-9d37-e949000724a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:58.294495 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda72d2-4816-4cdf-9d37-e949000724a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:58.294780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda72d2-4816-4cdf-9d37-e949000724a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:58.295157 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda72d2-4816-4cdf-9d37-e949000724a5 admin admin] PATH_INFO: `/v3/projects/ce5d9936076d4e83ae5db7fe9a0d909b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:58.301200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda72d2-4816-4cdf-9d37-e949000724a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce5d9936076d4e83ae5db7fe9a0d909b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:58.301200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda72d2-4816-4cdf-9d37-e949000724a5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:58.351886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:58.428649 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-edda72d2-4816-4cdf-9d37-e949000724a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5d9936076d4e83ae5db7fe9a0d909b', 'request_id': 'req-edda72d2-4816-4cdf-9d37-e949000724a5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:58.436655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-edda72d2-4816-4cdf-9d37-e949000724a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5d9936076d4e83ae5db7fe9a0d909b', 'request_id': 'req-edda72d2-4816-4cdf-9d37-e949000724a5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:58.436941 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-383c2701-c267-4c64-b106-bd31673659c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a21ee035c2094c708acb966457eb8854'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:58.444951 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-383c2701-c267-4c64-b106-bd31673659c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a21ee035c2094c708acb966457eb8854'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:58.445862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-383c2701-c267-4c64-b106-bd31673659c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a21ee035c2094c708acb966457eb8854'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:58.446493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-383c2701-c267-4c64-b106-bd31673659c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a21ee035c2094c708acb966457eb8854'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:58.460448 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:58.545633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-edda72d2-4816-4cdf-9d37-e949000724a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5d9936076d4e83ae5db7fe9a0d909b', 'request_id': 'req-edda72d2-4816-4cdf-9d37-e949000724a5'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:58.557749 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-edda72d2-4816-4cdf-9d37-e949000724a5 admin admin] The token cache is being invalidate because project ce5d9936076d4e83ae5db7fe9a0d909b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:58.558039 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-edda72d2-4816-4cdf-9d37-e949000724a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:58.558715 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-edda72d2-4816-4cdf-9d37-e949000724a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:58.560284 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1193/2348] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:58 2022] DELETE /identity/v3/projects/ce5d9936076d4e83ae5db7fe9a0d909b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:58.561527 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470cebe-7afb-4ed8-af82-7f6a91150f55 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:58.561815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470cebe-7afb-4ed8-af82-7f6a91150f55 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:58.562087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470cebe-7afb-4ed8-af82-7f6a91150f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:58.589772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8470cebe-7afb-4ed8-af82-7f6a91150f55 None None] MFA Rules not processed for user `5c29eab582a64a8991b171766d321e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:58.591007 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8470cebe-7afb-4ed8-af82-7f6a91150f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:58.647881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1194/2349] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Aug 9 19:19:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:58.648649 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470cebe-7afb-4ed8-af82-7f6a91150f55 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:58.649992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8470cebe-7afb-4ed8-af82-7f6a91150f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:58.659575 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-383c2701-c267-4c64-b106-bd31673659c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a21ee035c2094c708acb966457eb8854'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:58.683846 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1156/2350] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:57 2022] DELETE /identity/v3/users/a21ee035c2094c708acb966457eb8854 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:19:58.685487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c2701-c267-4c64-b106-bd31673659c6 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:58.687657 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-383c2701-c267-4c64-b106-bd31673659c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:58.723600 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470cebe-7afb-4ed8-af82-7f6a91150f55 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:58.778173 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c2701-c267-4c64-b106-bd31673659c6 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:58.785170 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9716f-2770-4478-9974-f507898218ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac48cd591b44f2999d2f172262019da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:58.786096 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9716f-2770-4478-9974-f507898218ce service swift] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:58.786534 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9716f-2770-4478-9974-f507898218ce service swift] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:58.787191 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9716f-2770-4478-9974-f507898218ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:58.809814 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dbfe8-31bb-46ce-a822-1a584570e696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:58.810435 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dbfe8-31bb-46ce-a822-1a584570e696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:58.813699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dbfe8-31bb-46ce-a822-1a584570e696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:58.813699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dbfe8-31bb-46ce-a822-1a584570e696 admin admin] PATH_INFO: `/v3/users/028bb53b9ec34ab38bf146dcbdd2b101` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:58.819556 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dbfe8-31bb-46ce-a822-1a584570e696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=028bb53b9ec34ab38bf146dcbdd2b101)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:58.821645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dbfe8-31bb-46ce-a822-1a584570e696 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:58.855943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9716f-2770-4478-9974-f507898218ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:58.857642 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9716f-2770-4478-9974-f507898218ce service swift] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:58.869040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1157/2351] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Aug 9 19:19:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 19:19:59.151677 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fc2dbfe8-31bb-46ce-a822-1a584570e696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '028bb53b9ec34ab38bf146dcbdd2b101'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:59.191750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9716f-2770-4478-9974-f507898218ce service swift] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:59.194626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6ad9716f-2770-4478-9974-f507898218ce service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:59.221512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9716f-2770-4478-9974-f507898218ce service swift] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:59.237281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbb05f-70ef-4869-961e-cff6598d0c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:59.239491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fc2dbfe8-31bb-46ce-a822-1a584570e696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '028bb53b9ec34ab38bf146dcbdd2b101'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:59.240124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fc2dbfe8-31bb-46ce-a822-1a584570e696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '028bb53b9ec34ab38bf146dcbdd2b101'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:59.241052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fc2dbfe8-31bb-46ce-a822-1a584570e696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '028bb53b9ec34ab38bf146dcbdd2b101'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:59.251758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbb05f-70ef-4869-961e-cff6598d0c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:59.252271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbb05f-70ef-4869-961e-cff6598d0c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:59.252437 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fc2dbfe8-31bb-46ce-a822-1a584570e696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '028bb53b9ec34ab38bf146dcbdd2b101'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:59.252881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbb05f-70ef-4869-961e-cff6598d0c58 admin admin] PATH_INFO: `/v3/projects/523b5792d0b24b58969b3edcf8338c0d` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:59.260376 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbb05f-70ef-4869-961e-cff6598d0c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=523b5792d0b24b58969b3edcf8338c0d)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:59.265295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbb05f-70ef-4869-961e-cff6598d0c58 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:59.311027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1195/2352] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:19:58 2022] DELETE /identity/v3/users/028bb53b9ec34ab38bf146dcbdd2b101 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:59.407616 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c2dbb05f-70ef-4869-961e-cff6598d0c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523b5792d0b24b58969b3edcf8338c0d', 'request_id': 'req-c2dbb05f-70ef-4869-961e-cff6598d0c58'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:59.419719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c2dbb05f-70ef-4869-961e-cff6598d0c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523b5792d0b24b58969b3edcf8338c0d', 'request_id': 'req-c2dbb05f-70ef-4869-961e-cff6598d0c58'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:59.516445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c2dbb05f-70ef-4869-961e-cff6598d0c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523b5792d0b24b58969b3edcf8338c0d', 'request_id': 'req-c2dbb05f-70ef-4869-961e-cff6598d0c58'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:59.551295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c2dbb05f-70ef-4869-961e-cff6598d0c58 admin admin] The token cache is being invalidate because project 523b5792d0b24b58969b3edcf8338c0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:19:59.554745 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c2dbb05f-70ef-4869-961e-cff6598d0c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:59.554745 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c2dbb05f-70ef-4869-961e-cff6598d0c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:59.555714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1158/2353] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:59 2022] DELETE /identity/v3/projects/523b5792d0b24b58969b3edcf8338c0d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:19:59.561171 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51792d16-2ca8-44fc-ba39-21a03dd76fd2 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:59.561710 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51792d16-2ca8-44fc-ba39-21a03dd76fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:59.561710 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51792d16-2ca8-44fc-ba39-21a03dd76fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:59.598550 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-51792d16-2ca8-44fc-ba39-21a03dd76fd2 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:59.599854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-51792d16-2ca8-44fc-ba39-21a03dd76fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:59.713630 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1196/2354] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:59.717788 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4b4ca-e17d-4f4c-9e27-296f45bc304b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:59.718323 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4b4ca-e17d-4f4c-9e27-296f45bc304b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:59.718323 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4b4ca-e17d-4f4c-9e27-296f45bc304b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:59.730930 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51792d16-2ca8-44fc-ba39-21a03dd76fd2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:59.732889 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-51792d16-2ca8-44fc-ba39-21a03dd76fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:59.748712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51792d16-2ca8-44fc-ba39-21a03dd76fd2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:59.754520 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b61d1-30f4-44a5-b2b1-acb62f4167a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:59.757572 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b61d1-30f4-44a5-b2b1-acb62f4167a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:59.758067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b61d1-30f4-44a5-b2b1-acb62f4167a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:59.758526 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b61d1-30f4-44a5-b2b1-acb62f4167a0 admin admin] PATH_INFO: `/v3/projects/6b1719f9295d4679bc7f232a994073fa` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:59.760040 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b61d1-30f4-44a5-b2b1-acb62f4167a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1719f9295d4679bc7f232a994073fa)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:59.762673 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b61d1-30f4-44a5-b2b1-acb62f4167a0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:59.780003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-25a4b4ca-e17d-4f4c-9e27-296f45bc304b None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:19:59.781240 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-25a4b4ca-e17d-4f4c-9e27-296f45bc304b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:19:59.816928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1159/2355] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:19:59.821721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4b4ca-e17d-4f4c-9e27-296f45bc304b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:59.834360 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4b4ca-e17d-4f4c-9e27-296f45bc304b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:59.840539 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94ffcb-60c1-48cf-b01e-dd8e7c66339e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:59.841594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94ffcb-60c1-48cf-b01e-dd8e7c66339e admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:59.842033 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94ffcb-60c1-48cf-b01e-dd8e7c66339e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:59.847837 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94ffcb-60c1-48cf-b01e-dd8e7c66339e admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:59.847837 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94ffcb-60c1-48cf-b01e-dd8e7c66339e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:19:59.847837 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94ffcb-60c1-48cf-b01e-dd8e7c66339e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:59.847837 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94ffcb-60c1-48cf-b01e-dd8e7c66339e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:59.876027 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1160/2356] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:19:59.877063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94ffcb-60c1-48cf-b01e-dd8e7c66339e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:19:59.892897 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94ffcb-60c1-48cf-b01e-dd8e7c66339e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:19:59.900335 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3883b-6bb7-4c7a-be37-cf8d31a45c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:19:59.901228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3883b-6bb7-4c7a-be37-cf8d31a45c10 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:19:59.901733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3883b-6bb7-4c7a-be37-cf8d31a45c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:19:59.902210 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3883b-6bb7-4c7a-be37-cf8d31a45c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:19:59.903035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3883b-6bb7-4c7a-be37-cf8d31a45c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:19:59.905149 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc3883b-6bb7-4c7a-be37-cf8d31a45c10 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:19:59.924855 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-089b61d1-30f4-44a5-b2b1-acb62f4167a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1719f9295d4679bc7f232a994073fa', 'request_id': 'req-089b61d1-30f4-44a5-b2b1-acb62f4167a0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:19:59.941698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-089b61d1-30f4-44a5-b2b1-acb62f4167a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1719f9295d4679bc7f232a994073fa', 'request_id': 'req-089b61d1-30f4-44a5-b2b1-acb62f4167a0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:00.061942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1161/2357] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:19:59 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:20:00.097017 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3883b-6bb7-4c7a-be37-cf8d31a45c10 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:00.456022 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3883b-6bb7-4c7a-be37-cf8d31a45c10 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:00.456581 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:00.456581 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-089b61d1-30f4-44a5-b2b1-acb62f4167a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1719f9295d4679bc7f232a994073fa', 'request_id': 'req-089b61d1-30f4-44a5-b2b1-acb62f4167a0'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:00.456758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e065f6e-525f-4c97-9c8a-7b137b825a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:00.456758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e065f6e-525f-4c97-9c8a-7b137b825a28 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:00.456758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e065f6e-525f-4c97-9c8a-7b137b825a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:00.456758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e065f6e-525f-4c97-9c8a-7b137b825a28 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:00.457116 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e065f6e-525f-4c97-9c8a-7b137b825a28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:00.457116 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e065f6e-525f-4c97-9c8a-7b137b825a28 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:00.457270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-089b61d1-30f4-44a5-b2b1-acb62f4167a0 admin admin] The token cache is being invalidate because project 6b1719f9295d4679bc7f232a994073fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:20:00.457270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-089b61d1-30f4-44a5-b2b1-acb62f4167a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:00.457270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-089b61d1-30f4-44a5-b2b1-acb62f4167a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:00.457270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1197/2358] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:19:59 2022] DELETE /identity/v3/projects/6b1719f9295d4679bc7f232a994073fa => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:20:00.460702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd48ba0-bcb5-4fe3-8e5e-9d2b1db032f4 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:00.461022 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd48ba0-bcb5-4fe3-8e5e-9d2b1db032f4 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:00.461262 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd48ba0-bcb5-4fe3-8e5e-9d2b1db032f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:00.482942 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8dd48ba0-bcb5-4fe3-8e5e-9d2b1db032f4 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:20:00.484181 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8dd48ba0-bcb5-4fe3-8e5e-9d2b1db032f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:00.506849 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1198/2359] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:20:00.521523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f210e4-a3b0-49da-9a7d-9e98aaf98086 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:00.521523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f210e4-a3b0-49da-9a7d-9e98aaf98086 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:00.521523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f210e4-a3b0-49da-9a7d-9e98aaf98086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:00.548828 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b8f210e4-a3b0-49da-9a7d-9e98aaf98086 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:20:00.550267 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b8f210e4-a3b0-49da-9a7d-9e98aaf98086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:00.558507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1199/2360] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:20:00.562587 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f210e4-a3b0-49da-9a7d-9e98aaf98086 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:00.573106 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f210e4-a3b0-49da-9a7d-9e98aaf98086 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:00.578863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed35582-4880-42d5-b798-5ef6e7eb19bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:00.579471 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed35582-4880-42d5-b798-5ef6e7eb19bb admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:00.579774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed35582-4880-42d5-b798-5ef6e7eb19bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:00.580044 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed35582-4880-42d5-b798-5ef6e7eb19bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:00.580690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed35582-4880-42d5-b798-5ef6e7eb19bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:20:00.580993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed35582-4880-42d5-b798-5ef6e7eb19bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:00.582619 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed35582-4880-42d5-b798-5ef6e7eb19bb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:00.598431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1200/2361] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:20:00.601368 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed35582-4880-42d5-b798-5ef6e7eb19bb admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:00.614165 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed35582-4880-42d5-b798-5ef6e7eb19bb admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:00.619671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65323db-c8ba-4c94-a036-d687d8241268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:00.620413 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65323db-c8ba-4c94-a036-d687d8241268 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:00.620739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65323db-c8ba-4c94-a036-d687d8241268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:00.621025 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65323db-c8ba-4c94-a036-d687d8241268 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:00.621690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65323db-c8ba-4c94-a036-d687d8241268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:00.623724 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65323db-c8ba-4c94-a036-d687d8241268 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:00.837833 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1162/2362] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:20:00 2022] POST /identity/v3/users => generated 287 bytes in 741 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:20:00.841547 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e065f6e-525f-4c97-9c8a-7b137b825a28 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:00.850004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8e065f6e-525f-4c97-9c8a-7b137b825a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:00.885668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1201/2363] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:20:00 2022] POST /identity/v3/projects => generated 375 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:20:00.889930 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65323db-c8ba-4c94-a036-d687d8241268 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:00.896278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e065f6e-525f-4c97-9c8a-7b137b825a28 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:00.968562 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:01.016845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9af5ca-c261-46fe-90d8-c1606de49d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:01.017932 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9af5ca-c261-46fe-90d8-c1606de49d84 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:01.018413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9af5ca-c261-46fe-90d8-c1606de49d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:01.021092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9af5ca-c261-46fe-90d8-c1606de49d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:01.022639 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9af5ca-c261-46fe-90d8-c1606de49d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:01.024673 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9af5ca-c261-46fe-90d8-c1606de49d84 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:01.042533 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65323db-c8ba-4c94-a036-d687d8241268 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:01.050588 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1163/2364] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:20:01.055972 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9af5ca-c261-46fe-90d8-c1606de49d84 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:01.062594 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804e112-eeb0-4d93-98af-ad750047bc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:01.070464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804e112-eeb0-4d93-98af-ad750047bc6a admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:01.070464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804e112-eeb0-4d93-98af-ad750047bc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:01.070464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804e112-eeb0-4d93-98af-ad750047bc6a admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:01.070464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804e112-eeb0-4d93-98af-ad750047bc6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:01.070894 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804e112-eeb0-4d93-98af-ad750047bc6a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:01.079328 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9af5ca-c261-46fe-90d8-c1606de49d84 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:01.095203 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a9500-0246-4c11-b7c0-d6fa02c13df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:01.095986 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a9500-0246-4c11-b7c0-d6fa02c13df7 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:01.096328 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a9500-0246-4c11-b7c0-d6fa02c13df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:01.096799 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a9500-0246-4c11-b7c0-d6fa02c13df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:01.098025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a9500-0246-4c11-b7c0-d6fa02c13df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:01.101828 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a9500-0246-4c11-b7c0-d6fa02c13df7 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:01.118304 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1164/2365] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:20:01.125749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a9500-0246-4c11-b7c0-d6fa02c13df7 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:01.150557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a9500-0246-4c11-b7c0-d6fa02c13df7 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:01.159942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06313e9d-244c-4792-a08e-8a9a79e88445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:01.161148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06313e9d-244c-4792-a08e-8a9a79e88445 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:01.161687 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06313e9d-244c-4792-a08e-8a9a79e88445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:01.162203 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06313e9d-244c-4792-a08e-8a9a79e88445 admin admin] PATH_INFO: `/v3/projects/f61d258ff0ce40a0869833477f52adfd/users/87ed013906d34155943c37304307f7d3/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:01.177750 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1202/2366] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:20:00 2022] POST /identity/v3/users => generated 288 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:20:01.182404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804e112-eeb0-4d93-98af-ad750047bc6a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:01.204311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804e112-eeb0-4d93-98af-ad750047bc6a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:01.207505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06313e9d-244c-4792-a08e-8a9a79e88445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61d258ff0ce40a0869833477f52adfd, user_id=87ed013906d34155943c37304307f7d3, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:01.212598 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06313e9d-244c-4792-a08e-8a9a79e88445 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:01.219568 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c95098-fb2a-47be-b030-4837d824b46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:01.222704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c95098-fb2a-47be-b030-4837d824b46f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:01.222704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c95098-fb2a-47be-b030-4837d824b46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:01.222704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c95098-fb2a-47be-b030-4837d824b46f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:01.222704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c95098-fb2a-47be-b030-4837d824b46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:01.225766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c95098-fb2a-47be-b030-4837d824b46f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:01.239111 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1203/2367] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:20:01.253627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c95098-fb2a-47be-b030-4837d824b46f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:01.254471 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c95098-fb2a-47be-b030-4837d824b46f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:01.260622 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fec3e8-0e3c-4529-ba57-d0060407c5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:01.260986 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fec3e8-0e3c-4529-ba57-d0060407c5ce admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:01.261402 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fec3e8-0e3c-4529-ba57-d0060407c5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:01.262874 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fec3e8-0e3c-4529-ba57-d0060407c5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:01.263825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fec3e8-0e3c-4529-ba57-d0060407c5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:01.265709 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fec3e8-0e3c-4529-ba57-d0060407c5ce admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:01.280592 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1204/2368] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:20:01.284555 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fec3e8-0e3c-4529-ba57-d0060407c5ce admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:01.301345 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fec3e8-0e3c-4529-ba57-d0060407c5ce admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:01.301909 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60b09b-f4c4-4e67-a2b3-482627f41f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:01.302663 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60b09b-f4c4-4e67-a2b3-482627f41f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:01.302950 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60b09b-f4c4-4e67-a2b3-482627f41f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:01.303256 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60b09b-f4c4-4e67-a2b3-482627f41f94 admin admin] PATH_INFO: `/v3/projects/2ec974de257c4a21ab074aa9ec844dd1/users/e31bbb3bb7c64c35a06951591f7fbd5a/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:01.321719 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60b09b-f4c4-4e67-a2b3-482627f41f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec974de257c4a21ab074aa9ec844dd1, user_id=e31bbb3bb7c64c35a06951591f7fbd5a, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:01.324699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60b09b-f4c4-4e67-a2b3-482627f41f94 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:01.396161 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1165/2369] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:20:01 2022] PUT /identity/v3/projects/f61d258ff0ce40a0869833477f52adfd/users/87ed013906d34155943c37304307f7d3/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:20:01.401728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547e757-ab06-4b55-b3d3-a9625b96dbc6 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:01.402187 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547e757-ab06-4b55-b3d3-a9625b96dbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:01.402376 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547e757-ab06-4b55-b3d3-a9625b96dbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:01.438228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4547e757-ab06-4b55-b3d3-a9625b96dbc6 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:20:01.439843 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4547e757-ab06-4b55-b3d3-a9625b96dbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:01.457244 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1205/2370] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:20:01 2022] PUT /identity/v3/projects/2ec974de257c4a21ab074aa9ec844dd1/users/e31bbb3bb7c64c35a06951591f7fbd5a/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:20:01.458820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a6bf5-4eb2-454d-b415-c0626018915c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:01.460200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a6bf5-4eb2-454d-b415-c0626018915c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:01.460482 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a6bf5-4eb2-454d-b415-c0626018915c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:01.559729 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-992a6bf5-4eb2-454d-b415-c0626018915c None None] MFA Rules not processed for user `e31bbb3bb7c64c35a06951591f7fbd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:20:01.559729 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-992a6bf5-4eb2-454d-b415-c0626018915c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:01.578081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1166/2371] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:20:01.579603 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16724050-25b2-4539-933a-6377113bc061 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:01.579950 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16724050-25b2-4539-933a-6377113bc061 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:01.580227 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16724050-25b2-4539-933a-6377113bc061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:01.611667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-16724050-25b2-4539-933a-6377113bc061 None None] MFA Rules not processed for user `d5f9fe48bb8f44f997e36e0e320bfc5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:20:01.613042 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-16724050-25b2-4539-933a-6377113bc061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:01.644384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1206/2372] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:20:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:20:01.645935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a6bf5-4eb2-454d-b415-c0626018915c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:01.648209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-992a6bf5-4eb2-454d-b415-c0626018915c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:01.752281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1167/2373] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:20:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:20:01.773211 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a6bf5-4eb2-454d-b415-c0626018915c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:01.777402 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8737983-8dd9-41ae-95ee-a2cf92ffab1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:01.778055 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8737983-8dd9-41ae-95ee-a2cf92ffab1b service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:01.778339 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8737983-8dd9-41ae-95ee-a2cf92ffab1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:01.778617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8737983-8dd9-41ae-95ee-a2cf92ffab1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:01.790507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8737983-8dd9-41ae-95ee-a2cf92ffab1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:01.792181 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8737983-8dd9-41ae-95ee-a2cf92ffab1b service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:01.794599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:01.808582 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1207/2374] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:20:02.069045 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:02.781855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16724050-25b2-4539-933a-6377113bc061 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:02.783595 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-16724050-25b2-4539-933a-6377113bc061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:02.793289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:02.943288 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16724050-25b2-4539-933a-6377113bc061 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:02.956269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd8a3a-df27-4334-bf0f-ecf11fb2e598 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d8000eb20445b78ee56ac372cd024c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:02.956269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd8a3a-df27-4334-bf0f-ecf11fb2e598 service glance] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:02.956269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd8a3a-df27-4334-bf0f-ecf11fb2e598 service glance] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:02.956269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd8a3a-df27-4334-bf0f-ecf11fb2e598 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:02.964418 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd8a3a-df27-4334-bf0f-ecf11fb2e598 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:02.982397 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cd8a3a-df27-4334-bf0f-ecf11fb2e598 service glance] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:02.999096 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1168/2375] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:20:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:20:03.784591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea354f-52a5-4328-855e-6ce4116de3fe None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:03.785161 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea354f-52a5-4328-855e-6ce4116de3fe None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:03.785161 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea354f-52a5-4328-855e-6ce4116de3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:03.839670 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-8dea354f-52a5-4328-855e-6ce4116de3fe None None] MFA Rules not processed for user `87ed013906d34155943c37304307f7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:20:03.841316 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8dea354f-52a5-4328-855e-6ce4116de3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:03.900856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:03.980701 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1208/2376] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:20:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:20:03.994030 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd8a3a-df27-4334-bf0f-ecf11fb2e598 service glance] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:03.996248 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a9cd8a3a-df27-4334-bf0f-ecf11fb2e598 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:04.021690 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:04.090711 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cd8a3a-df27-4334-bf0f-ecf11fb2e598 service glance] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:04.107748 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859a791-9d13-4d01-9cec-3d73546eb898 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:04.110169 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859a791-9d13-4d01-9cec-3d73546eb898 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:04.110629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859a791-9d13-4d01-9cec-3d73546eb898 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:04.111063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859a791-9d13-4d01-9cec-3d73546eb898 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:04.143682 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859a791-9d13-4d01-9cec-3d73546eb898 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:04.145185 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859a791-9d13-4d01-9cec-3d73546eb898 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:04.201007 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1169/2377] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:20:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:20:04.991719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:05.148189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:05.989478 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:06.018036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:06.206597 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:06.554214 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:07.217504 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19bf1b-5232-49e1-a262-1a1f6a3765ea None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:07.220201 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19bf1b-5232-49e1-a262-1a1f6a3765ea None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:07.220201 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19bf1b-5232-49e1-a262-1a1f6a3765ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:07.238785 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1f19bf1b-5232-49e1-a262-1a1f6a3765ea None None] MFA Rules not processed for user `87ed013906d34155943c37304307f7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:20:07.240766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1f19bf1b-5232-49e1-a262-1a1f6a3765ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:07.248970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1209/2378] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:20:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:20:07.464342 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:07.896999 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:08.314254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:08.481914 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:08.761372 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:08.792065 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:INSERT=1,keystone:DELETE=7,keystone:SELECT=92 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:09.074174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:09.253002 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:11.994521 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88458abe-c035-4fe4-b89a-f8ad5015f8d4 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:11.995050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88458abe-c035-4fe4-b89a-f8ad5015f8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:11.995050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88458abe-c035-4fe4-b89a-f8ad5015f8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:12.014398 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-88458abe-c035-4fe4-b89a-f8ad5015f8d4 None None] MFA Rules not processed for user `46fb993dd5d7441fa70a8bc930cccff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:20:12.016448 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-88458abe-c035-4fe4-b89a-f8ad5015f8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:12.061602 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:12.072163 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1170/2379] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:20:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:20:19.365219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=49 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:20.145069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233df1e7-1a09-4bfc-bb14-d63790d0d4a6 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:20.145687 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233df1e7-1a09-4bfc-bb14-d63790d0d4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:20.146131 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233df1e7-1a09-4bfc-bb14-d63790d0d4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:20.167960 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-233df1e7-1a09-4bfc-bb14-d63790d0d4a6 None None] MFA Rules not processed for user `5c29eab582a64a8991b171766d321e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:20:20.169498 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-233df1e7-1a09-4bfc-bb14-d63790d0d4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:20.250716 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1210/2380] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Aug 9 19:20:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:20:20.267200 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88458abe-c035-4fe4-b89a-f8ad5015f8d4 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:20.268965 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-88458abe-c035-4fe4-b89a-f8ad5015f8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:20.343970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88458abe-c035-4fe4-b89a-f8ad5015f8d4 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:20.350418 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf40b85-8291-44f2-baaf-3d877bedf1e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac48cd591b44f2999d2f172262019da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:20.351131 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf40b85-8291-44f2-baaf-3d877bedf1e9 service swift] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:20.351485 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf40b85-8291-44f2-baaf-3d877bedf1e9 service swift] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:20.351872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf40b85-8291-44f2-baaf-3d877bedf1e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:20.362347 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf40b85-8291-44f2-baaf-3d877bedf1e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:20.363959 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf40b85-8291-44f2-baaf-3d877bedf1e9 service swift] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:20.373492 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1171/2381] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Aug 9 19:20:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 19:20:30.242669 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=25 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:30.373935 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=34 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:30.839763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233df1e7-1a09-4bfc-bb14-d63790d0d4a6 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:30.841153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-233df1e7-1a09-4bfc-bb14-d63790d0d4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:30.855715 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233df1e7-1a09-4bfc-bb14-d63790d0d4a6 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:30.860355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4462ca0-b87c-4b8b-8ee6-542cbc0026c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:30.860990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4462ca0-b87c-4b8b-8ee6-542cbc0026c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:30.861270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4462ca0-b87c-4b8b-8ee6-542cbc0026c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:30.861577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4462ca0-b87c-4b8b-8ee6-542cbc0026c9 admin admin] PATH_INFO: `/v3/users/7eeb435ae95b4dcebef5e8bf69b38f40` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:30.862706 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4462ca0-b87c-4b8b-8ee6-542cbc0026c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eeb435ae95b4dcebef5e8bf69b38f40)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:30.864632 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4462ca0-b87c-4b8b-8ee6-542cbc0026c9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:31.064135 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c4462ca0-b87c-4b8b-8ee6-542cbc0026c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eeb435ae95b4dcebef5e8bf69b38f40'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:31.136941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c4462ca0-b87c-4b8b-8ee6-542cbc0026c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eeb435ae95b4dcebef5e8bf69b38f40'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:31.136941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c4462ca0-b87c-4b8b-8ee6-542cbc0026c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eeb435ae95b4dcebef5e8bf69b38f40'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:31.136941 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c4462ca0-b87c-4b8b-8ee6-542cbc0026c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eeb435ae95b4dcebef5e8bf69b38f40'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:31.142825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c4462ca0-b87c-4b8b-8ee6-542cbc0026c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eeb435ae95b4dcebef5e8bf69b38f40'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:31.172990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1211/2382] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:20:30 2022] DELETE /identity/v3/users/7eeb435ae95b4dcebef5e8bf69b38f40 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:20:31.174105 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e481a54-ace4-43a4-8777-e5950708a690 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:31.174587 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e481a54-ace4-43a4-8777-e5950708a690 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:31.175031 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e481a54-ace4-43a4-8777-e5950708a690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:31.198499 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3e481a54-ace4-43a4-8777-e5950708a690 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:20:31.200124 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3e481a54-ace4-43a4-8777-e5950708a690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:31.285794 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1172/2383] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:20:31.297052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4462ca0-b87c-4b8b-8ee6-542cbc0026c9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:31.299333 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c4462ca0-b87c-4b8b-8ee6-542cbc0026c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:31.372452 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4462ca0-b87c-4b8b-8ee6-542cbc0026c9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:31.376294 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa139c98-2d84-4efd-a19e-a839c79521c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:31.376896 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa139c98-2d84-4efd-a19e-a839c79521c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:31.377175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa139c98-2d84-4efd-a19e-a839c79521c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:31.377448 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa139c98-2d84-4efd-a19e-a839c79521c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:31.386776 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa139c98-2d84-4efd-a19e-a839c79521c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:31.388299 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa139c98-2d84-4efd-a19e-a839c79521c7 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:31.397562 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1212/2384] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:20:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:20:31.830289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e481a54-ace4-43a4-8777-e5950708a690 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:31.831989 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3e481a54-ace4-43a4-8777-e5950708a690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:31.845607 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e481a54-ace4-43a4-8777-e5950708a690 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:31.850635 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c6615-c6db-42f1-92ed-eb48e29cc9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:31.851378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c6615-c6db-42f1-92ed-eb48e29cc9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:31.851756 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c6615-c6db-42f1-92ed-eb48e29cc9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:31.852124 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c6615-c6db-42f1-92ed-eb48e29cc9ee admin admin] PATH_INFO: `/v3/projects/599ae2e020f44beebb9179e187c25b29` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:31.853357 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c6615-c6db-42f1-92ed-eb48e29cc9ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=599ae2e020f44beebb9179e187c25b29)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:31.855481 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c6615-c6db-42f1-92ed-eb48e29cc9ee admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:31.994134 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bc8c6615-c6db-42f1-92ed-eb48e29cc9ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '599ae2e020f44beebb9179e187c25b29', 'request_id': 'req-bc8c6615-c6db-42f1-92ed-eb48e29cc9ee'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:32.006727 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bc8c6615-c6db-42f1-92ed-eb48e29cc9ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '599ae2e020f44beebb9179e187c25b29', 'request_id': 'req-bc8c6615-c6db-42f1-92ed-eb48e29cc9ee'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:32.085599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bc8c6615-c6db-42f1-92ed-eb48e29cc9ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '599ae2e020f44beebb9179e187c25b29', 'request_id': 'req-bc8c6615-c6db-42f1-92ed-eb48e29cc9ee'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:32.099754 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bc8c6615-c6db-42f1-92ed-eb48e29cc9ee admin admin] The token cache is being invalidate because project 599ae2e020f44beebb9179e187c25b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:20:32.100189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bc8c6615-c6db-42f1-92ed-eb48e29cc9ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:32.100974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-bc8c6615-c6db-42f1-92ed-eb48e29cc9ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:32.118916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1173/2385] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:20:31 2022] DELETE /identity/v3/projects/599ae2e020f44beebb9179e187c25b29 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:20:34.514804 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa139c98-2d84-4efd-a19e-a839c79521c7 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:34.516426 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-aa139c98-2d84-4efd-a19e-a839c79521c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:34.529615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa139c98-2d84-4efd-a19e-a839c79521c7 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:34.585272 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01f5a7-2451-412f-9297-940e33009e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:34.585937 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01f5a7-2451-412f-9297-940e33009e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:34.586225 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01f5a7-2451-412f-9297-940e33009e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:34.586498 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01f5a7-2451-412f-9297-940e33009e57 admin admin] PATH_INFO: `/v3/users/e31bbb3bb7c64c35a06951591f7fbd5a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:34.587624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01f5a7-2451-412f-9297-940e33009e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e31bbb3bb7c64c35a06951591f7fbd5a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:34.589737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01f5a7-2451-412f-9297-940e33009e57 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:34.606928 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:34.764636 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2d01f5a7-2451-412f-9297-940e33009e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e31bbb3bb7c64c35a06951591f7fbd5a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:34.857651 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2d01f5a7-2451-412f-9297-940e33009e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e31bbb3bb7c64c35a06951591f7fbd5a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:34.858417 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2d01f5a7-2451-412f-9297-940e33009e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e31bbb3bb7c64c35a06951591f7fbd5a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:34.859125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2d01f5a7-2451-412f-9297-940e33009e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e31bbb3bb7c64c35a06951591f7fbd5a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:34.867048 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2d01f5a7-2451-412f-9297-940e33009e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e31bbb3bb7c64c35a06951591f7fbd5a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:34.885992 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1213/2386] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:20:34 2022] DELETE /identity/v3/users/e31bbb3bb7c64c35a06951591f7fbd5a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:20:34.890513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef2f83-f125-4b5a-9805-8a061e0a3d19 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:34.891006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef2f83-f125-4b5a-9805-8a061e0a3d19 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:34.891219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef2f83-f125-4b5a-9805-8a061e0a3d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:34.910660 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-e9ef2f83-f125-4b5a-9805-8a061e0a3d19 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:20:34.911954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e9ef2f83-f125-4b5a-9805-8a061e0a3d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:34.974040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1174/2387] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:20:34.984653 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01f5a7-2451-412f-9297-940e33009e57 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:34.988145 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2d01f5a7-2451-412f-9297-940e33009e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:35.042164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01f5a7-2451-412f-9297-940e33009e57 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:35.046519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02232107-994f-4dd4-bc11-bd5068ac6ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:35.047120 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02232107-994f-4dd4-bc11-bd5068ac6ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:35.047400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02232107-994f-4dd4-bc11-bd5068ac6ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:35.047672 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02232107-994f-4dd4-bc11-bd5068ac6ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:35.056409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02232107-994f-4dd4-bc11-bd5068ac6ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:35.057851 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02232107-994f-4dd4-bc11-bd5068ac6ad9 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:35.067314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1214/2388] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:20:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:20:35.454521 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef2f83-f125-4b5a-9805-8a061e0a3d19 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:35.456038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e9ef2f83-f125-4b5a-9805-8a061e0a3d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:35.468915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef2f83-f125-4b5a-9805-8a061e0a3d19 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:35.473892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba83ae6-c29b-4aaf-8dd0-1d4dc6555080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:35.474457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba83ae6-c29b-4aaf-8dd0-1d4dc6555080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:35.474958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba83ae6-c29b-4aaf-8dd0-1d4dc6555080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:35.475183 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba83ae6-c29b-4aaf-8dd0-1d4dc6555080 admin admin] PATH_INFO: `/v3/projects/2ec974de257c4a21ab074aa9ec844dd1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:35.476315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba83ae6-c29b-4aaf-8dd0-1d4dc6555080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ec974de257c4a21ab074aa9ec844dd1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:35.478454 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba83ae6-c29b-4aaf-8dd0-1d4dc6555080 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:35.501555 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:35.599863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7ba83ae6-c29b-4aaf-8dd0-1d4dc6555080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ec974de257c4a21ab074aa9ec844dd1', 'request_id': 'req-7ba83ae6-c29b-4aaf-8dd0-1d4dc6555080'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:35.605271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7ba83ae6-c29b-4aaf-8dd0-1d4dc6555080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ec974de257c4a21ab074aa9ec844dd1', 'request_id': 'req-7ba83ae6-c29b-4aaf-8dd0-1d4dc6555080'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:35.677195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7ba83ae6-c29b-4aaf-8dd0-1d4dc6555080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ec974de257c4a21ab074aa9ec844dd1', 'request_id': 'req-7ba83ae6-c29b-4aaf-8dd0-1d4dc6555080'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:35.690016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7ba83ae6-c29b-4aaf-8dd0-1d4dc6555080 admin admin] The token cache is being invalidate because project 2ec974de257c4a21ab074aa9ec844dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:20:35.694578 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7ba83ae6-c29b-4aaf-8dd0-1d4dc6555080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:35.694578 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7ba83ae6-c29b-4aaf-8dd0-1d4dc6555080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:20:35.694578 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1175/2389] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:20:35 2022] DELETE /identity/v3/projects/2ec974de257c4a21ab074aa9ec844dd1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:20:45.063311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=9,keystone:SELECT=46,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:45.686505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:51.446163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825cd9c-7d35-471c-967d-8de15f93ab4a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:51.452428 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825cd9c-7d35-471c-967d-8de15f93ab4a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:51.452428 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825cd9c-7d35-471c-967d-8de15f93ab4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:51.469112 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e825cd9c-7d35-471c-967d-8de15f93ab4a None None] MFA Rules not processed for user `5c29eab582a64a8991b171766d321e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:20:51.474043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e825cd9c-7d35-471c-967d-8de15f93ab4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:51.547064 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1215/2390] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Aug 9 19:20:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:20:51.572698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba83ae6-c29b-4aaf-8dd0-1d4dc6555080 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:51.574521 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7ba83ae6-c29b-4aaf-8dd0-1d4dc6555080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:51.652038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba83ae6-c29b-4aaf-8dd0-1d4dc6555080 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:51.658271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5b1eb-0467-4de7-aacb-f4613b500041 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac48cd591b44f2999d2f172262019da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:51.658917 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5b1eb-0467-4de7-aacb-f4613b500041 service swift] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:51.659195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5b1eb-0467-4de7-aacb-f4613b500041 service swift] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:51.659473 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5b1eb-0467-4de7-aacb-f4613b500041 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:51.667956 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5b1eb-0467-4de7-aacb-f4613b500041 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:51.669566 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5b1eb-0467-4de7-aacb-f4613b500041 service swift] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:51.679015 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1176/2391] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Aug 9 19:20:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 19:20:58.343500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825cd9c-7d35-471c-967d-8de15f93ab4a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:20:58.346068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e825cd9c-7d35-471c-967d-8de15f93ab4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:58.457926 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825cd9c-7d35-471c-967d-8de15f93ab4a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:20:58.463997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b18a0a-4c46-43be-99e2-5629ec51a0a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6172f0733384291992624ef6a527ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:20:58.464559 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b18a0a-4c46-43be-99e2-5629ec51a0a6 service placement] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:58.464835 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b18a0a-4c46-43be-99e2-5629ec51a0a6 service placement] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:58.465104 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b18a0a-4c46-43be-99e2-5629ec51a0a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:58.466997 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-51b18a0a-4c46-43be-99e2-5629ec51a0a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:58.479384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b18a0a-4c46-43be-99e2-5629ec51a0a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:20:58.481096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b18a0a-4c46-43be-99e2-5629ec51a0a6 service placement] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:20:58.492814 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1216/2392] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:20:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:20:59.486003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26f96d-ea1d-4443-94e7-8798d96ed515 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:20:59.487397 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26f96d-ea1d-4443-94e7-8798d96ed515 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:20:59.487740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26f96d-ea1d-4443-94e7-8798d96ed515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:20:59.524803 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3f26f96d-ea1d-4443-94e7-8798d96ed515 None None] MFA Rules not processed for user `87ed013906d34155943c37304307f7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:20:59.526289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3f26f96d-ea1d-4443-94e7-8798d96ed515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:20:59.604351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1177/2393] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:20:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:21:06.345297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b18a0a-4c46-43be-99e2-5629ec51a0a6 service placement] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:21:06.347351 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-51b18a0a-4c46-43be-99e2-5629ec51a0a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:21:06.405597 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b18a0a-4c46-43be-99e2-5629ec51a0a6 service placement] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:21:06.410295 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4a571-59b7-43ad-b90d-07723df9208e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:21:06.411032 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4a571-59b7-43ad-b90d-07723df9208e service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:21:06.411419 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4a571-59b7-43ad-b90d-07723df9208e service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:21:06.411794 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4a571-59b7-43ad-b90d-07723df9208e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:21:06.413902 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-70f4a571-59b7-43ad-b90d-07723df9208e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:21:06.466468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:21:06.482051 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4a571-59b7-43ad-b90d-07723df9208e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:21:06.483818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4a571-59b7-43ad-b90d-07723df9208e service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:21:06.494026 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1217/2394] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:21:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:21:09.593809 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=57 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:21:11.757431 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b6184-18a0-4a99-adfa-4cdb9224e4f9 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:21:11.768750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b6184-18a0-4a99-adfa-4cdb9224e4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:21:11.768750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b6184-18a0-4a99-adfa-4cdb9224e4f9 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:21:11.768750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1178/2395] 10.222.0.65 () {54 vars in 921 bytes} [Tue Aug 9 19:21:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:21:11.769820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85497f17-0300-4968-833e-4e734854ab5c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:21:11.769820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85497f17-0300-4968-833e-4e734854ab5c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:21:11.769820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85497f17-0300-4968-833e-4e734854ab5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:21:11.790951 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-85497f17-0300-4968-833e-4e734854ab5c None None] MFA Rules not processed for user `2cfda1bec35145f3bbcc13fae0b7af2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:21:11.792500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-85497f17-0300-4968-833e-4e734854ab5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:21:11.877513 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1218/2396] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Aug 9 19:21:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:21:11.889676 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b6184-18a0-4a99-adfa-4cdb9224e4f9 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:21:11.891565 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b27b6184-18a0-4a99-adfa-4cdb9224e4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:21:11.949592 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b6184-18a0-4a99-adfa-4cdb9224e4f9 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:21:11.953070 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df420d61-180c-4e5c-bf1c-10f1642df687 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d8000eb20445b78ee56ac372cd024c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:21:11.953811 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df420d61-180c-4e5c-bf1c-10f1642df687 service glance] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:21:11.954087 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df420d61-180c-4e5c-bf1c-10f1642df687 service glance] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:21:11.954351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df420d61-180c-4e5c-bf1c-10f1642df687 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:21:11.964950 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df420d61-180c-4e5c-bf1c-10f1642df687 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:21:11.966348 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df420d61-180c-4e5c-bf1c-10f1642df687 service glance] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:21:11.978356 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1179/2397] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:21:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:21:12.247450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061a0c8-758c-4954-ae1a-c72886be8f13 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:21:12.247450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061a0c8-758c-4954-ae1a-c72886be8f13 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:21:12.247450 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061a0c8-758c-4954-ae1a-c72886be8f13 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:21:12.248451 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1219/2398] 10.222.0.65 () {54 vars in 921 bytes} [Tue Aug 9 19:21:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:21:12.254152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f33207-3319-42f3-84d8-1440c92cff4f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:21:12.254902 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f33207-3319-42f3-84d8-1440c92cff4f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:21:12.255658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f33207-3319-42f3-84d8-1440c92cff4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:21:12.276651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-e1f33207-3319-42f3-84d8-1440c92cff4f None None] MFA Rules not processed for user `a62d954163ca4bf298f461b4d253269e`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:21:12.278058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e1f33207-3319-42f3-84d8-1440c92cff4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:21:12.285264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1180/2399] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Aug 9 19:21:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:21:12.301908 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061a0c8-758c-4954-ae1a-c72886be8f13 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:21:12.315156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061a0c8-758c-4954-ae1a-c72886be8f13 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:21:12.319834 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1212b-357a-49c3-963f-f72aacec5f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:21:12.320519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1212b-357a-49c3-963f-f72aacec5f6f service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:21:12.321003 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1212b-357a-49c3-963f-f72aacec5f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:21:12.321345 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1212b-357a-49c3-963f-f72aacec5f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:21:12.330145 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1212b-357a-49c3-963f-f72aacec5f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:21:12.332971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1212b-357a-49c3-963f-f72aacec5f6f service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:21:12.349432 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1220/2400] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:21:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:21:12.476561 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e66cc9-ed2b-414d-b495-97f7584b6df9 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:21:12.476858 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e66cc9-ed2b-414d-b495-97f7584b6df9 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:21:12.477199 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e66cc9-ed2b-414d-b495-97f7584b6df9 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:21:12.480118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1181/2401] 10.222.0.65 () {54 vars in 921 bytes} [Tue Aug 9 19:21:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:21:12.493774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e84d9-d73e-465e-892e-e6fcd28fd177 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:21:12.494066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e84d9-d73e-465e-892e-e6fcd28fd177 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:21:12.494400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e84d9-d73e-465e-892e-e6fcd28fd177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:21:12.516639 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-401e84d9-d73e-465e-892e-e6fcd28fd177 None None] MFA Rules not processed for user `2cfda1bec35145f3bbcc13fae0b7af2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:21:12.518523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-401e84d9-d73e-465e-892e-e6fcd28fd177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:21:12.528105 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1221/2402] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Aug 9 19:21:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:21:12.539688 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e66cc9-ed2b-414d-b495-97f7584b6df9 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:21:12.552332 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e66cc9-ed2b-414d-b495-97f7584b6df9 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:21:12.556299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c75e6-2af3-49ff-8114-f96be8646a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:21:12.558228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c75e6-2af3-49ff-8114-f96be8646a7b service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:21:12.558228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c75e6-2af3-49ff-8114-f96be8646a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:21:12.558228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c75e6-2af3-49ff-8114-f96be8646a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:21:12.569448 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c75e6-2af3-49ff-8114-f96be8646a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:21:12.571021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c75e6-2af3-49ff-8114-f96be8646a7b service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:21:12.583151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1182/2403] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:21:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:21:16.480119 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fab9b9-adfa-4bcd-9e3f-d41416323d0c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:21:16.480629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fab9b9-adfa-4bcd-9e3f-d41416323d0c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:21:16.480852 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fab9b9-adfa-4bcd-9e3f-d41416323d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:21:16.500353 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b6fab9b9-adfa-4bcd-9e3f-d41416323d0c None None] MFA Rules not processed for user `5c29eab582a64a8991b171766d321e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:21:16.501765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b6fab9b9-adfa-4bcd-9e3f-d41416323d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:21:16.510422 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1222/2404] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Aug 9 19:21:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:21:16.523364 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c75e6-2af3-49ff-8114-f96be8646a7b service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:21:16.535803 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c75e6-2af3-49ff-8114-f96be8646a7b service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:21:16.540929 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff75e9b-df32-46b7-81b4-ea471bbf593b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac48cd591b44f2999d2f172262019da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:21:16.541588 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff75e9b-df32-46b7-81b4-ea471bbf593b service swift] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:21:16.541876 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff75e9b-df32-46b7-81b4-ea471bbf593b service swift] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:21:16.542155 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff75e9b-df32-46b7-81b4-ea471bbf593b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:21:16.551763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff75e9b-df32-46b7-81b4-ea471bbf593b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:21:16.553397 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff75e9b-df32-46b7-81b4-ea471bbf593b service swift] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:21:16.562771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1183/2405] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Aug 9 19:21:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 19:21:26.495046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=50 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:21:26.559571 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=41 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:21:44.746674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f08c97-f77f-4401-a05a-e1bc55f3800a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:21:44.747240 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f08c97-f77f-4401-a05a-e1bc55f3800a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:21:44.747240 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f08c97-f77f-4401-a05a-e1bc55f3800a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:21:44.766767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c2f08c97-f77f-4401-a05a-e1bc55f3800a None None] MFA Rules not processed for user `5c29eab582a64a8991b171766d321e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:21:44.767966 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c2f08c97-f77f-4401-a05a-e1bc55f3800a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:21:44.775210 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1223/2406] 10.222.0.65 () {58 vars in 967 bytes} [Tue Aug 9 19:21:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:21:44.789643 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff75e9b-df32-46b7-81b4-ea471bbf593b service swift] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:21:44.800249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff75e9b-df32-46b7-81b4-ea471bbf593b service swift] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:21:44.805331 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10899127-0c59-4e0e-b85e-bbeb96148c32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac48cd591b44f2999d2f172262019da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:21:44.805965 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10899127-0c59-4e0e-b85e-bbeb96148c32 service swift] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:21:44.806247 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10899127-0c59-4e0e-b85e-bbeb96148c32 service swift] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:21:44.806520 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10899127-0c59-4e0e-b85e-bbeb96148c32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:21:44.814856 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10899127-0c59-4e0e-b85e-bbeb96148c32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:21:44.818166 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10899127-0c59-4e0e-b85e-bbeb96148c32 service swift] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:21:44.824814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1184/2407] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Aug 9 19:21:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 19:21:49.013768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d46d1-7add-4a17-a119-74c08c5b3803 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:21:49.014216 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d46d1-7add-4a17-a119-74c08c5b3803 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:21:49.014346 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d46d1-7add-4a17-a119-74c08c5b3803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:21:49.032966 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-833d46d1-7add-4a17-a119-74c08c5b3803 None None] MFA Rules not processed for user `5c29eab582a64a8991b171766d321e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:21:49.034173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-833d46d1-7add-4a17-a119-74c08c5b3803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:21:49.041375 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1224/2408] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Aug 9 19:21:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:21:49.053888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10899127-0c59-4e0e-b85e-bbeb96148c32 service swift] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:21:49.064953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10899127-0c59-4e0e-b85e-bbeb96148c32 service swift] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:21:49.069916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6bffe-0dad-4225-89d7-7bac2d67c691 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac48cd591b44f2999d2f172262019da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:21:49.070504 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6bffe-0dad-4225-89d7-7bac2d67c691 service swift] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:21:49.070779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6bffe-0dad-4225-89d7-7bac2d67c691 service swift] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:21:49.071047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6bffe-0dad-4225-89d7-7bac2d67c691 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:21:49.078909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6bffe-0dad-4225-89d7-7bac2d67c691 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:21:49.080468 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6bffe-0dad-4225-89d7-7bac2d67c691 service swift] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:21:49.088888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1185/2409] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Aug 9 19:21:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 19:21:59.027883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=6 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:21:59.085662 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=12 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:22:05.487295 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba2155-6cf2-4db2-a214-faa4832f1868 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:05.487751 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba2155-6cf2-4db2-a214-faa4832f1868 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:05.487852 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba2155-6cf2-4db2-a214-faa4832f1868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:05.506867 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-75ba2155-6cf2-4db2-a214-faa4832f1868 None None] MFA Rules not processed for user `5c29eab582a64a8991b171766d321e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:22:05.508053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-75ba2155-6cf2-4db2-a214-faa4832f1868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:22:05.515429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1225/2410] 10.222.0.65 () {58 vars in 967 bytes} [Tue Aug 9 19:22:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:22:05.527772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6bffe-0dad-4225-89d7-7bac2d67c691 service swift] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:22:05.538496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6bffe-0dad-4225-89d7-7bac2d67c691 service swift] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:22:05.543658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58608670-9996-49ae-a74f-9d475bfc0bc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac48cd591b44f2999d2f172262019da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:22:05.544258 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58608670-9996-49ae-a74f-9d475bfc0bc0 service swift] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:05.544539 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58608670-9996-49ae-a74f-9d475bfc0bc0 service swift] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:05.544812 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58608670-9996-49ae-a74f-9d475bfc0bc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:05.553718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58608670-9996-49ae-a74f-9d475bfc0bc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:22:05.555329 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58608670-9996-49ae-a74f-9d475bfc0bc0 service swift] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:22:05.563917 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1186/2411] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Aug 9 19:22:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 19:22:08.463012 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba2155-6cf2-4db2-a214-faa4832f1868 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:22:08.464468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-75ba2155-6cf2-4db2-a214-faa4832f1868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:22:08.531028 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba2155-6cf2-4db2-a214-faa4832f1868 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:22:08.535947 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44d55d-4918-4e37-a4c2-849c26105866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:22:08.536579 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44d55d-4918-4e37-a4c2-849c26105866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:08.536863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44d55d-4918-4e37-a4c2-849c26105866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:08.537144 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44d55d-4918-4e37-a4c2-849c26105866 admin admin] PATH_INFO: `/v3/users/87ed013906d34155943c37304307f7d3` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:08.538332 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44d55d-4918-4e37-a4c2-849c26105866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ed013906d34155943c37304307f7d3)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:22:08.540261 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44d55d-4918-4e37-a4c2-849c26105866 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:22:08.693400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bb44d55d-4918-4e37-a4c2-849c26105866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ed013906d34155943c37304307f7d3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:22:08.766348 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bb44d55d-4918-4e37-a4c2-849c26105866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ed013906d34155943c37304307f7d3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:22:08.767019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bb44d55d-4918-4e37-a4c2-849c26105866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ed013906d34155943c37304307f7d3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:22:08.767679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bb44d55d-4918-4e37-a4c2-849c26105866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ed013906d34155943c37304307f7d3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:22:08.774844 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bb44d55d-4918-4e37-a4c2-849c26105866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ed013906d34155943c37304307f7d3'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:22:08.792485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1226/2412] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:22:08 2022] DELETE /identity/v3/users/87ed013906d34155943c37304307f7d3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:22:09.029362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58608670-9996-49ae-a74f-9d475bfc0bc0 service swift] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:22:09.042719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58608670-9996-49ae-a74f-9d475bfc0bc0 service swift] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:22:09.104315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7c6f7-8a65-45fb-9cab-0c4eb226e8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:22:09.105392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7c6f7-8a65-45fb-9cab-0c4eb226e8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:09.105392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7c6f7-8a65-45fb-9cab-0c4eb226e8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:09.105786 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7c6f7-8a65-45fb-9cab-0c4eb226e8be admin admin] PATH_INFO: `/v3/projects/f61d258ff0ce40a0869833477f52adfd` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:09.107008 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7c6f7-8a65-45fb-9cab-0c4eb226e8be admin admin] RBAC: Authorizing `identity:delete_project(project_id=f61d258ff0ce40a0869833477f52adfd)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:22:09.109114 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7c6f7-8a65-45fb-9cab-0c4eb226e8be admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:22:09.239257 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ddc7c6f7-8a65-45fb-9cab-0c4eb226e8be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61d258ff0ce40a0869833477f52adfd', 'request_id': 'req-ddc7c6f7-8a65-45fb-9cab-0c4eb226e8be'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:22:09.244640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ddc7c6f7-8a65-45fb-9cab-0c4eb226e8be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61d258ff0ce40a0869833477f52adfd', 'request_id': 'req-ddc7c6f7-8a65-45fb-9cab-0c4eb226e8be'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:22:09.315630 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ddc7c6f7-8a65-45fb-9cab-0c4eb226e8be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61d258ff0ce40a0869833477f52adfd', 'request_id': 'req-ddc7c6f7-8a65-45fb-9cab-0c4eb226e8be'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:22:09.327975 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ddc7c6f7-8a65-45fb-9cab-0c4eb226e8be admin admin] The token cache is being invalidate because project f61d258ff0ce40a0869833477f52adfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:22:09.328264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ddc7c6f7-8a65-45fb-9cab-0c4eb226e8be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:22:09.329526 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ddc7c6f7-8a65-45fb-9cab-0c4eb226e8be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:22:09.331006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1187/2413] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:22:09 2022] DELETE /identity/v3/projects/f61d258ff0ce40a0869833477f52adfd => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:22:09.336026 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47c28f-240a-4f97-a7de-e02b55a571f2 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:09.337020 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47c28f-240a-4f97-a7de-e02b55a571f2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:09.337020 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47c28f-240a-4f97-a7de-e02b55a571f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:09.356044 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6c47c28f-240a-4f97-a7de-e02b55a571f2 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:22:09.357247 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6c47c28f-240a-4f97-a7de-e02b55a571f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:22:09.415148 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1227/2414] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:22:09.422845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb01fc8-0949-4490-a9e9-53bcf44d567d None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:09.423128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb01fc8-0949-4490-a9e9-53bcf44d567d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:09.423400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb01fc8-0949-4490-a9e9-53bcf44d567d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:09.444016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4fb01fc8-0949-4490-a9e9-53bcf44d567d None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:22:09.445245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4fb01fc8-0949-4490-a9e9-53bcf44d567d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:22:09.453425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1188/2415] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:22:09.458149 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47c28f-240a-4f97-a7de-e02b55a571f2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:22:09.467583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47c28f-240a-4f97-a7de-e02b55a571f2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:22:09.472179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96674b96-e89b-4a58-8fe8-a63db05fbc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:22:09.472767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96674b96-e89b-4a58-8fe8-a63db05fbc56 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:09.473042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96674b96-e89b-4a58-8fe8-a63db05fbc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:09.473311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96674b96-e89b-4a58-8fe8-a63db05fbc56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:09.473980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96674b96-e89b-4a58-8fe8-a63db05fbc56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:22:09.474285 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96674b96-e89b-4a58-8fe8-a63db05fbc56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:22:09.475865 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96674b96-e89b-4a58-8fe8-a63db05fbc56 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:22:09.484137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:22:09.487300 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1228/2416] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:22:09.497534 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb01fc8-0949-4490-a9e9-53bcf44d567d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:22:09.501632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb01fc8-0949-4490-a9e9-53bcf44d567d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:22:09.506533 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060f1ad-abc0-430e-94f7-9735f77e2ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:22:09.507132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060f1ad-abc0-430e-94f7-9735f77e2ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:09.507410 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060f1ad-abc0-430e-94f7-9735f77e2ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:09.508028 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d060f1ad-abc0-430e-94f7-9735f77e2ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:09.508313 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d060f1ad-abc0-430e-94f7-9735f77e2ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:22:09.510247 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d060f1ad-abc0-430e-94f7-9735f77e2ce0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:22:09.604748 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1189/2417] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:22:09 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:22:09.609118 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96674b96-e89b-4a58-8fe8-a63db05fbc56 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:22:09.619506 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96674b96-e89b-4a58-8fe8-a63db05fbc56 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:22:09.676575 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1106d-0adc-44cc-a469-c2b60e4b21a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:22:09.677174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1106d-0adc-44cc-a469-c2b60e4b21a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:09.677472 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1106d-0adc-44cc-a469-c2b60e4b21a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:09.677750 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1106d-0adc-44cc-a469-c2b60e4b21a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:09.678379 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1106d-0adc-44cc-a469-c2b60e4b21a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:22:09.680298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1106d-0adc-44cc-a469-c2b60e4b21a6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:22:09.764116 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1229/2418] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:22:09 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:22:09.768727 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060f1ad-abc0-430e-94f7-9735f77e2ce0 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:22:09.779157 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d060f1ad-abc0-430e-94f7-9735f77e2ce0 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:22:09.783989 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3bd19-8163-4280-9184-2b818ffc03e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:22:09.784587 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3bd19-8163-4280-9184-2b818ffc03e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:09.784862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3bd19-8163-4280-9184-2b818ffc03e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:09.785434 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3bd19-8163-4280-9184-2b818ffc03e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:09.785839 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3bd19-8163-4280-9184-2b818ffc03e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:22:09.787435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3bd19-8163-4280-9184-2b818ffc03e6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:22:09.798652 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1190/2419] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:22:09.802657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1106d-0adc-44cc-a469-c2b60e4b21a6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:22:09.812398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1106d-0adc-44cc-a469-c2b60e4b21a6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:22:09.817648 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902c7e2-f82d-4ef9-a23e-a2fabf0ced43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:22:09.818237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902c7e2-f82d-4ef9-a23e-a2fabf0ced43 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:09.818514 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902c7e2-f82d-4ef9-a23e-a2fabf0ced43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:09.818785 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902c7e2-f82d-4ef9-a23e-a2fabf0ced43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:09.819604 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902c7e2-f82d-4ef9-a23e-a2fabf0ced43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:22:09.821309 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902c7e2-f82d-4ef9-a23e-a2fabf0ced43 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:22:09.831768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1230/2420] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:22:09.835958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3bd19-8163-4280-9184-2b818ffc03e6 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:22:09.846109 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3bd19-8163-4280-9184-2b818ffc03e6 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:22:09.850828 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c7ce2-c56a-418d-aa28-178ebf20619a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:22:09.851468 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c7ce2-c56a-418d-aa28-178ebf20619a admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:09.851749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c7ce2-c56a-418d-aa28-178ebf20619a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:09.852022 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c7ce2-c56a-418d-aa28-178ebf20619a admin admin] PATH_INFO: `/v3/projects/2ffd314db2844f3fa1fd48f8029a095c/users/80fa78fd284947f19c8aaf4d996af3a1/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:09.866746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c7ce2-c56a-418d-aa28-178ebf20619a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ffd314db2844f3fa1fd48f8029a095c, user_id=80fa78fd284947f19c8aaf4d996af3a1, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:22:09.869395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c7ce2-c56a-418d-aa28-178ebf20619a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:22:09.934829 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1191/2421] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:22:09 2022] PUT /identity/v3/projects/2ffd314db2844f3fa1fd48f8029a095c/users/80fa78fd284947f19c8aaf4d996af3a1/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:22:09.939816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cf3d6-cf3b-4bc9-b585-f9b1e7c9d4c8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:09.940102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cf3d6-cf3b-4bc9-b585-f9b1e7c9d4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:09.940373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cf3d6-cf3b-4bc9-b585-f9b1e7c9d4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:09.959633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1d4cf3d6-cf3b-4bc9-b585-f9b1e7c9d4c8 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:22:09.960835 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1d4cf3d6-cf3b-4bc9-b585-f9b1e7c9d4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:22:10.019725 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1231/2422] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:22:10.029313 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c7ce2-c56a-418d-aa28-178ebf20619a admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:22:10.031042 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d88c7ce2-c56a-418d-aa28-178ebf20619a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:22:10.045746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:22:10.088509 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c7ce2-c56a-418d-aa28-178ebf20619a admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:22:10.092152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fd5fd-050a-4fac-a5f1-30eecdb60721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:22:10.092754 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fd5fd-050a-4fac-a5f1-30eecdb60721 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:10.093036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fd5fd-050a-4fac-a5f1-30eecdb60721 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:10.093309 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fd5fd-050a-4fac-a5f1-30eecdb60721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:10.102163 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fd5fd-050a-4fac-a5f1-30eecdb60721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:22:10.103587 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fd5fd-050a-4fac-a5f1-30eecdb60721 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:22:10.112726 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1192/2423] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:22:11.444217 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b1184-2c58-4710-b9dc-eb91d73cb86c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:11.444755 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b1184-2c58-4710-b9dc-eb91d73cb86c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:11.444755 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b1184-2c58-4710-b9dc-eb91d73cb86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:11.474220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-904b1184-2c58-4710-b9dc-eb91d73cb86c None None] MFA Rules not processed for user `80fa78fd284947f19c8aaf4d996af3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:22:11.475444 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-904b1184-2c58-4710-b9dc-eb91d73cb86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:22:11.550343 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1232/2424] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:22:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:22:11.560930 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fd5fd-050a-4fac-a5f1-30eecdb60721 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:22:11.562379 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-038fd5fd-050a-4fac-a5f1-30eecdb60721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:22:11.620220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fd5fd-050a-4fac-a5f1-30eecdb60721 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:22:11.623910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcfc18-817f-430d-b197-0b34967616ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:22:11.624518 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcfc18-817f-430d-b197-0b34967616ba service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:11.624800 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcfc18-817f-430d-b197-0b34967616ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:11.625074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcfc18-817f-430d-b197-0b34967616ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:11.634322 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcfc18-817f-430d-b197-0b34967616ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:22:11.635763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcfc18-817f-430d-b197-0b34967616ba service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:22:11.646068 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1193/2425] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:22:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:22:14.462122 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f80dc3-00f7-4f41-b453-5278115cf7e0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:14.462737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f80dc3-00f7-4f41-b453-5278115cf7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:14.462737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f80dc3-00f7-4f41-b453-5278115cf7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:14.481701 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a5f80dc3-00f7-4f41-b453-5278115cf7e0 None None] MFA Rules not processed for user `80fa78fd284947f19c8aaf4d996af3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:22:14.482909 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a5f80dc3-00f7-4f41-b453-5278115cf7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:22:14.490713 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1233/2426] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:22:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:22:21.640997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=46 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:22:24.476077 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:22:34.276528 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41174d28-b859-4321-8ed6-29fcee4b59e1 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:34.277092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41174d28-b859-4321-8ed6-29fcee4b59e1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:34.277092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41174d28-b859-4321-8ed6-29fcee4b59e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:34.295568 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-41174d28-b859-4321-8ed6-29fcee4b59e1 None None] MFA Rules not processed for user `d5f9fe48bb8f44f997e36e0e320bfc5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:22:34.296891 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-41174d28-b859-4321-8ed6-29fcee4b59e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:22:34.354005 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1194/2427] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:22:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:22:44.346763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=25 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:22:46.582729 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f80dc3-00f7-4f41-b453-5278115cf7e0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:22:46.584174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a5f80dc3-00f7-4f41-b453-5278115cf7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:22:46.596123 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f80dc3-00f7-4f41-b453-5278115cf7e0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:22:46.600563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbce79-75ec-49c8-89b1-259697617573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:22:46.601163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbce79-75ec-49c8-89b1-259697617573 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:46.601446 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbce79-75ec-49c8-89b1-259697617573 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:46.601748 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbce79-75ec-49c8-89b1-259697617573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:46.603617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1bbbce79-75ec-49c8-89b1-259697617573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:22:46.684784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbce79-75ec-49c8-89b1-259697617573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:22:46.686409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbce79-75ec-49c8-89b1-259697617573 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:22:46.697286 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1234/2428] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:22:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:22:47.886807 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41174d28-b859-4321-8ed6-29fcee4b59e1 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:22:47.896808 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41174d28-b859-4321-8ed6-29fcee4b59e1 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:22:47.901139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5f801-cee1-4225-a1ff-8450daba5cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:22:47.901783 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5f801-cee1-4225-a1ff-8450daba5cdf service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:47.902065 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5f801-cee1-4225-a1ff-8450daba5cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:47.902356 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5f801-cee1-4225-a1ff-8450daba5cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:47.904091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-50b5f801-cee1-4225-a1ff-8450daba5cdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:22:47.917293 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5f801-cee1-4225-a1ff-8450daba5cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:22:47.918760 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5f801-cee1-4225-a1ff-8450daba5cdf service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:22:47.929559 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1195/2429] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:22:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:22:56.692510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=34 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:22:57.243504 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f469f-1044-4182-b89c-fa0ece588f26 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:57.249860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f469f-1044-4182-b89c-fa0ece588f26 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:57.249860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f469f-1044-4182-b89c-fa0ece588f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:57.263776 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-203f469f-1044-4182-b89c-fa0ece588f26 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:22:57.264900 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-203f469f-1044-4182-b89c-fa0ece588f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:22:57.272939 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1235/2430] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 9 19:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:22:57.295289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5f801-cee1-4225-a1ff-8450daba5cdf service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:22:57.296690 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-50b5f801-cee1-4225-a1ff-8450daba5cdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:22:57.310882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5f801-cee1-4225-a1ff-8450daba5cdf service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:22:57.316380 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4b8f5-bc1b-4ba4-804a-1222328223c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:22:57.316975 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4b8f5-bc1b-4ba4-804a-1222328223c9 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:22:57.317255 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4b8f5-bc1b-4ba4-804a-1222328223c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:22:57.317554 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4b8f5-bc1b-4ba4-804a-1222328223c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:22:57.326338 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4b8f5-bc1b-4ba4-804a-1222328223c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:22:57.327953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4b8f5-bc1b-4ba4-804a-1222328223c9 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:22:57.337426 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1196/2431] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:23:02.569404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60813fdd-092f-4890-b289-cc98d0519622 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:02.570115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60813fdd-092f-4890-b289-cc98d0519622 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:02.570115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60813fdd-092f-4890-b289-cc98d0519622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:02.589843 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-60813fdd-092f-4890-b289-cc98d0519622 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:23:02.591052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-60813fdd-092f-4890-b289-cc98d0519622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:23:02.599161 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1236/2432] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 9 19:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:23:02.652268 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4b8f5-bc1b-4ba4-804a-1222328223c9 service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:23:02.653836 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-76d4b8f5-bc1b-4ba4-804a-1222328223c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:23:02.668425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4b8f5-bc1b-4ba4-804a-1222328223c9 service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:23:02.673898 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e33bee-194b-40aa-b084-2d2a947f0191 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:23:02.674494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e33bee-194b-40aa-b084-2d2a947f0191 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:02.674779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e33bee-194b-40aa-b084-2d2a947f0191 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:02.675054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e33bee-194b-40aa-b084-2d2a947f0191 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:02.683756 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e33bee-194b-40aa-b084-2d2a947f0191 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:23:02.685331 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e33bee-194b-40aa-b084-2d2a947f0191 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:23:02.694808 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1197/2433] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:23:02.909446 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60813fdd-092f-4890-b289-cc98d0519622 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:23:02.922683 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60813fdd-092f-4890-b289-cc98d0519622 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:23:02.928249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d727bd7-4ebe-4fa0-8b33-28a642c83227 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:23:02.928840 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d727bd7-4ebe-4fa0-8b33-28a642c83227 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:02.929115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d727bd7-4ebe-4fa0-8b33-28a642c83227 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:02.929382 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d727bd7-4ebe-4fa0-8b33-28a642c83227 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:02.931138 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8d727bd7-4ebe-4fa0-8b33-28a642c83227 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:23:02.989785 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d727bd7-4ebe-4fa0-8b33-28a642c83227 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:23:02.991380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d727bd7-4ebe-4fa0-8b33-28a642c83227 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:23:03.001748 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1237/2434] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:23:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:23:08.087627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773f63a-6037-4291-a914-45f0e271e4a1 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:08.088713 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773f63a-6037-4291-a914-45f0e271e4a1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:08.089003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773f63a-6037-4291-a914-45f0e271e4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:08.108593 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a773f63a-6037-4291-a914-45f0e271e4a1 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:23:08.109871 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a773f63a-6037-4291-a914-45f0e271e4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:23:08.117749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1198/2435] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 9 19:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:23:08.142937 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d727bd7-4ebe-4fa0-8b33-28a642c83227 service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:23:08.154314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d727bd7-4ebe-4fa0-8b33-28a642c83227 service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:23:08.159954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa58209-a3fd-4b96-ac66-5b307a7c28e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:23:08.160544 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa58209-a3fd-4b96-ac66-5b307a7c28e1 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:08.160826 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa58209-a3fd-4b96-ac66-5b307a7c28e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:08.161098 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa58209-a3fd-4b96-ac66-5b307a7c28e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:08.169865 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa58209-a3fd-4b96-ac66-5b307a7c28e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:23:08.171425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa58209-a3fd-4b96-ac66-5b307a7c28e1 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:23:08.180975 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1238/2436] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:23:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:23:13.054076 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067264e-0da4-480b-950b-04ac5500b014 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:13.060850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067264e-0da4-480b-950b-04ac5500b014 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:13.060850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067264e-0da4-480b-950b-04ac5500b014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:13.077674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-b067264e-0da4-480b-950b-04ac5500b014 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:23:13.078933 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b067264e-0da4-480b-950b-04ac5500b014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:23:13.088624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1199/2437] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 9 19:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:23:13.112673 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa58209-a3fd-4b96-ac66-5b307a7c28e1 service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:23:13.124983 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa58209-a3fd-4b96-ac66-5b307a7c28e1 service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:23:13.130845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f4798-21e3-4e44-a08b-7efc52c64107 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:23:13.131443 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f4798-21e3-4e44-a08b-7efc52c64107 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:13.131719 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f4798-21e3-4e44-a08b-7efc52c64107 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:13.131988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f4798-21e3-4e44-a08b-7efc52c64107 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:13.142220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f4798-21e3-4e44-a08b-7efc52c64107 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:23:13.144180 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f4798-21e3-4e44-a08b-7efc52c64107 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:23:13.165660 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1239/2438] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:23:17.229197 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab9e56-8179-43c7-ad3b-0f874c690fcf None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:17.230257 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab9e56-8179-43c7-ad3b-0f874c690fcf None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:17.230437 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab9e56-8179-43c7-ad3b-0f874c690fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:17.237572 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=25 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:23:17.250033 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-47ab9e56-8179-43c7-ad3b-0f874c690fcf None None] MFA Rules not processed for user `57a4a9f362d948ebaac0cae4a51dbf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:23:17.251233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-47ab9e56-8179-43c7-ad3b-0f874c690fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:23:17.258041 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1200/2439] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:23:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:23:17.368774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194027f-ba5d-4641-b721-a4dbe244970a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:17.369324 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194027f-ba5d-4641-b721-a4dbe244970a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:17.369324 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194027f-ba5d-4641-b721-a4dbe244970a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:17.389895 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d194027f-ba5d-4641-b721-a4dbe244970a None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:23:17.391100 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d194027f-ba5d-4641-b721-a4dbe244970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:23:17.399353 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1240/2440] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 9 19:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:23:17.422638 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab9e56-8179-43c7-ad3b-0f874c690fcf None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:23:17.436449 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab9e56-8179-43c7-ad3b-0f874c690fcf None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:23:17.442046 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f233ac6-8577-4750-9800-280f5da8daaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:23:17.442655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f233ac6-8577-4750-9800-280f5da8daaf service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:17.442932 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f233ac6-8577-4750-9800-280f5da8daaf service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:17.443200 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f233ac6-8577-4750-9800-280f5da8daaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:17.451909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f233ac6-8577-4750-9800-280f5da8daaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:23:17.453722 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f233ac6-8577-4750-9800-280f5da8daaf service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:23:17.463162 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1201/2441] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:23:17.572833 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194027f-ba5d-4641-b721-a4dbe244970a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:23:17.582456 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194027f-ba5d-4641-b721-a4dbe244970a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:23:17.585978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bae41-4c6a-42c1-90a5-de1ac8ce752b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:23:17.586570 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bae41-4c6a-42c1-90a5-de1ac8ce752b service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:17.586847 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bae41-4c6a-42c1-90a5-de1ac8ce752b service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:17.587117 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bae41-4c6a-42c1-90a5-de1ac8ce752b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:17.588806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a60bae41-4c6a-42c1-90a5-de1ac8ce752b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:23:17.598647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bae41-4c6a-42c1-90a5-de1ac8ce752b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:23:17.600060 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bae41-4c6a-42c1-90a5-de1ac8ce752b service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:23:17.608518 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1241/2442] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:23:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:23:17.999435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f233ac6-8577-4750-9800-280f5da8daaf service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:23:18.000908 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4f233ac6-8577-4750-9800-280f5da8daaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:23:18.077691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f233ac6-8577-4750-9800-280f5da8daaf service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:23:18.082685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d0979-abc0-47ca-90fd-fafba1a07018 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6172f0733384291992624ef6a527ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:23:18.083295 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d0979-abc0-47ca-90fd-fafba1a07018 service placement] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:18.083578 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d0979-abc0-47ca-90fd-fafba1a07018 service placement] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:18.083849 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d0979-abc0-47ca-90fd-fafba1a07018 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:18.085755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c13d0979-abc0-47ca-90fd-fafba1a07018 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:23:18.098255 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d0979-abc0-47ca-90fd-fafba1a07018 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:23:18.099847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d0979-abc0-47ca-90fd-fafba1a07018 service placement] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:23:18.109858 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1202/2443] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:23:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:23:21.626480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659d28f-4953-4ed5-953b-90549d89f88c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:21.627019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659d28f-4953-4ed5-953b-90549d89f88c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:21.627019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659d28f-4953-4ed5-953b-90549d89f88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:21.647121 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a659d28f-4953-4ed5-953b-90549d89f88c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:23:21.648318 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a659d28f-4953-4ed5-953b-90549d89f88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:23:21.656554 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1242/2444] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 9 19:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:23:21.679691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d0979-abc0-47ca-90fd-fafba1a07018 service placement] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:23:21.693866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d0979-abc0-47ca-90fd-fafba1a07018 service placement] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:23:21.699532 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca213556-86e2-4c45-8950-23bed9dfa335 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:23:21.700133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca213556-86e2-4c45-8950-23bed9dfa335 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:21.700411 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca213556-86e2-4c45-8950-23bed9dfa335 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:21.700681 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca213556-86e2-4c45-8950-23bed9dfa335 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:21.709619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca213556-86e2-4c45-8950-23bed9dfa335 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:23:21.713697 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca213556-86e2-4c45-8950-23bed9dfa335 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:23:21.722395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1203/2445] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:23:22.862520 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659d28f-4953-4ed5-953b-90549d89f88c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:23:22.874189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659d28f-4953-4ed5-953b-90549d89f88c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:23:22.878972 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f62852-ed63-46e9-87d3-6ea745906374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:23:22.879927 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f62852-ed63-46e9-87d3-6ea745906374 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:22.880453 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f62852-ed63-46e9-87d3-6ea745906374 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:22.881317 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f62852-ed63-46e9-87d3-6ea745906374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:22.883376 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b5f62852-ed63-46e9-87d3-6ea745906374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:23:22.894371 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f62852-ed63-46e9-87d3-6ea745906374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:23:22.895860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f62852-ed63-46e9-87d3-6ea745906374 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:23:22.903978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1243/2446] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:23:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:23:23.769155 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca213556-86e2-4c45-8950-23bed9dfa335 service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:23:23.792847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca213556-86e2-4c45-8950-23bed9dfa335 service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:23:23.798427 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0efda-4398-4c39-ac42-ccb10c55e2c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:23:23.799360 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0efda-4398-4c39-ac42-ccb10c55e2c6 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:23.799360 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0efda-4398-4c39-ac42-ccb10c55e2c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:23.799562 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0efda-4398-4c39-ac42-ccb10c55e2c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:23.801307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d3d0efda-4398-4c39-ac42-ccb10c55e2c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:23:23.814106 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0efda-4398-4c39-ac42-ccb10c55e2c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:23:23.815667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0efda-4398-4c39-ac42-ccb10c55e2c6 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:23:23.827170 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1204/2447] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:23:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:23:32.900435 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=64 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:23:33.821835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=52 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:23:40.316188 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f62852-ed63-46e9-87d3-6ea745906374 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:23:40.330724 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f62852-ed63-46e9-87d3-6ea745906374 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:23:40.336575 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81329e-267c-4c8a-bab0-7862dd399433 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:23:40.337198 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81329e-267c-4c8a-bab0-7862dd399433 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:40.337521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81329e-267c-4c8a-bab0-7862dd399433 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:40.337794 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81329e-267c-4c8a-bab0-7862dd399433 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:40.339916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9e81329e-267c-4c8a-bab0-7862dd399433 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:23:40.352582 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81329e-267c-4c8a-bab0-7862dd399433 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:23:40.354214 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81329e-267c-4c8a-bab0-7862dd399433 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:23:40.365226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1244/2448] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:23:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:23:44.497904 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1a38d-990d-4820-a1a7-cf41d26b1135 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:44.498320 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1a38d-990d-4820-a1a7-cf41d26b1135 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:44.498463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1a38d-990d-4820-a1a7-cf41d26b1135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:44.521555 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2dc1a38d-990d-4820-a1a7-cf41d26b1135 None None] MFA Rules not processed for user `80fa78fd284947f19c8aaf4d996af3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:23:44.522784 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2dc1a38d-990d-4820-a1a7-cf41d26b1135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:23:44.530233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1205/2449] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:23:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:23:44.959445 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81329e-267c-4c8a-bab0-7862dd399433 service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:23:44.968552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81329e-267c-4c8a-bab0-7862dd399433 service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:23:44.972769 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb4fe6-883f-4b75-afad-09837c99b81c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:23:44.973363 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4fe6-883f-4b75-afad-09837c99b81c service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:44.973675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4fe6-883f-4b75-afad-09837c99b81c service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:44.973949 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4fe6-883f-4b75-afad-09837c99b81c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:44.975679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-24eb4fe6-883f-4b75-afad-09837c99b81c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:23:44.985054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb4fe6-883f-4b75-afad-09837c99b81c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:23:44.986674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb4fe6-883f-4b75-afad-09837c99b81c service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:23:44.994461 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1245/2450] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:23:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:23:48.400910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1a38d-990d-4820-a1a7-cf41d26b1135 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:23:48.410772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1a38d-990d-4820-a1a7-cf41d26b1135 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:23:48.414443 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c7bd2-4891-48e0-bfad-f1f1f5c24a9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:23:48.415046 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c7bd2-4891-48e0-bfad-f1f1f5c24a9f service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:48.415327 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c7bd2-4891-48e0-bfad-f1f1f5c24a9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:48.415594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c7bd2-4891-48e0-bfad-f1f1f5c24a9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:48.417364 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-039c7bd2-4891-48e0-bfad-f1f1f5c24a9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:23:48.429163 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c7bd2-4891-48e0-bfad-f1f1f5c24a9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:23:48.430664 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c7bd2-4891-48e0-bfad-f1f1f5c24a9f service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:23:48.440569 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1206/2451] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:23:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:23:54.991031 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=12 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:23:57.237773 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb4fe6-883f-4b75-afad-09837c99b81c service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:23:57.252771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb4fe6-883f-4b75-afad-09837c99b81c service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:23:57.259205 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fd5e1-3a5d-4623-8a41-902b8a598480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:23:57.259827 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fd5e1-3a5d-4623-8a41-902b8a598480 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:23:57.260096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fd5e1-3a5d-4623-8a41-902b8a598480 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:23:57.260369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fd5e1-3a5d-4623-8a41-902b8a598480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:23:57.262152 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fb2fd5e1-3a5d-4623-8a41-902b8a598480 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:23:57.275552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fd5e1-3a5d-4623-8a41-902b8a598480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:23:57.277142 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fd5e1-3a5d-4623-8a41-902b8a598480 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:23:57.288033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1246/2452] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:23:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:23:58.435637 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=9 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:06.654597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d1071-76ca-4286-9783-8147268a94c4 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:06.655298 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d1071-76ca-4286-9783-8147268a94c4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:06.655298 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d1071-76ca-4286-9783-8147268a94c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:06.680073 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-8e9d1071-76ca-4286-9783-8147268a94c4 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:24:06.681169 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8e9d1071-76ca-4286-9783-8147268a94c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:06.689868 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1207/2453] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 9 19:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:24:06.829150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fd5e1-3a5d-4623-8a41-902b8a598480 service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:06.842887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fd5e1-3a5d-4623-8a41-902b8a598480 service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:06.852079 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782da290-2395-457b-af44-70b47916ae96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:06.853146 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782da290-2395-457b-af44-70b47916ae96 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:06.853468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782da290-2395-457b-af44-70b47916ae96 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:06.853915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782da290-2395-457b-af44-70b47916ae96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:06.885666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782da290-2395-457b-af44-70b47916ae96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:06.887506 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782da290-2395-457b-af44-70b47916ae96 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:06.901871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1247/2454] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:24:13.235095 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657f4fd-8a87-40e8-a2f8-359fe432b231 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:13.235646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657f4fd-8a87-40e8-a2f8-359fe432b231 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:13.235646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657f4fd-8a87-40e8-a2f8-359fe432b231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:13.254856 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4657f4fd-8a87-40e8-a2f8-359fe432b231 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:24:13.258915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4657f4fd-8a87-40e8-a2f8-359fe432b231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:13.270240 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1208/2455] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 9 19:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:24:13.294196 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782da290-2395-457b-af44-70b47916ae96 service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:13.305684 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782da290-2395-457b-af44-70b47916ae96 service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:13.311145 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6acbd13-ebf2-41b4-a48b-5a8bb27c1de8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:13.313893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acbd13-ebf2-41b4-a48b-5a8bb27c1de8 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:13.313893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acbd13-ebf2-41b4-a48b-5a8bb27c1de8 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:13.313893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6acbd13-ebf2-41b4-a48b-5a8bb27c1de8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:13.320852 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acbd13-ebf2-41b4-a48b-5a8bb27c1de8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:13.322468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6acbd13-ebf2-41b4-a48b-5a8bb27c1de8 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:13.331890 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1248/2456] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:24:21.190417 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657f4fd-8a87-40e8-a2f8-359fe432b231 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:21.200593 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657f4fd-8a87-40e8-a2f8-359fe432b231 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:21.204308 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351594f-8b3f-4586-82cd-c2f60670c233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:21.204889 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351594f-8b3f-4586-82cd-c2f60670c233 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:21.205165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351594f-8b3f-4586-82cd-c2f60670c233 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:21.205468 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9351594f-8b3f-4586-82cd-c2f60670c233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:21.207220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9351594f-8b3f-4586-82cd-c2f60670c233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:21.218444 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc3afd-c0d1-41aa-8cc7-a3958bbb8dee None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:21.221831 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc3afd-c0d1-41aa-8cc7-a3958bbb8dee None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:21.221831 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc3afd-c0d1-41aa-8cc7-a3958bbb8dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:21.222318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351594f-8b3f-4586-82cd-c2f60670c233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:21.222318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9351594f-8b3f-4586-82cd-c2f60670c233 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:21.233684 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1209/2457] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:24:21.259513 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-dbcc3afd-c0d1-41aa-8cc7-a3958bbb8dee None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:24:21.260961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-dbcc3afd-c0d1-41aa-8cc7-a3958bbb8dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:21.271090 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1249/2458] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 9 19:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:24:21.299945 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351594f-8b3f-4586-82cd-c2f60670c233 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:21.313528 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9351594f-8b3f-4586-82cd-c2f60670c233 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:21.319233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed627e18-f17a-4404-ace8-25df161de39b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:21.319836 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed627e18-f17a-4404-ace8-25df161de39b service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:21.320116 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed627e18-f17a-4404-ace8-25df161de39b service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:21.320390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed627e18-f17a-4404-ace8-25df161de39b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:21.328816 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed627e18-f17a-4404-ace8-25df161de39b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:21.330435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed627e18-f17a-4404-ace8-25df161de39b service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:21.340959 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1210/2459] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:24:22.721074 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f82bd-bb24-411c-8a28-def2fa24bcbe None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:22.721582 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f82bd-bb24-411c-8a28-def2fa24bcbe None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:22.721582 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f82bd-bb24-411c-8a28-def2fa24bcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:22.741037 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-e67f82bd-bb24-411c-8a28-def2fa24bcbe None None] MFA Rules not processed for user `5c29eab582a64a8991b171766d321e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:24:22.742491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-e67f82bd-bb24-411c-8a28-def2fa24bcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:22.802230 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1250/2460] 10.222.0.65 () {58 vars in 967 bytes} [Tue Aug 9 19:24:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:24:22.937303 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed627e18-f17a-4404-ace8-25df161de39b service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:22.938895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ed627e18-f17a-4404-ace8-25df161de39b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:23.013276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed627e18-f17a-4404-ace8-25df161de39b service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:23.018851 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e45b2-de8d-4f4f-835f-291f22953bf3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac48cd591b44f2999d2f172262019da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:23.019468 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e45b2-de8d-4f4f-835f-291f22953bf3 service swift] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:23.019749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e45b2-de8d-4f4f-835f-291f22953bf3 service swift] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:23.020021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e45b2-de8d-4f4f-835f-291f22953bf3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:23.029275 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e45b2-de8d-4f4f-835f-291f22953bf3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:23.030911 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e45b2-de8d-4f4f-835f-291f22953bf3 service swift] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:23.039585 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1211/2461] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Aug 9 19:24:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 19:24:25.034153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f82bd-bb24-411c-8a28-def2fa24bcbe None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:25.046651 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f82bd-bb24-411c-8a28-def2fa24bcbe None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:25.051887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c9b67-65bf-4cd3-995c-435bebcd45cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6172f0733384291992624ef6a527ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:25.052956 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c9b67-65bf-4cd3-995c-435bebcd45cc service placement] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:25.053106 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c9b67-65bf-4cd3-995c-435bebcd45cc service placement] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:25.053381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c9b67-65bf-4cd3-995c-435bebcd45cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:25.055160 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bb9c9b67-65bf-4cd3-995c-435bebcd45cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:25.064458 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=49 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:25.070167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c9b67-65bf-4cd3-995c-435bebcd45cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:25.071797 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c9b67-65bf-4cd3-995c-435bebcd45cc service placement] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:25.083195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1251/2462] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:24:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:24:25.168030 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e45b2-de8d-4f4f-835f-291f22953bf3 service swift] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:25.169762 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1a7e45b2-de8d-4f4f-835f-291f22953bf3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:25.193989 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e45b2-de8d-4f4f-835f-291f22953bf3 service swift] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:25.202899 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da68487-9222-4571-b054-033de399bca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:25.203568 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da68487-9222-4571-b054-033de399bca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:25.203871 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da68487-9222-4571-b054-033de399bca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:25.204109 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da68487-9222-4571-b054-033de399bca0 admin admin] PATH_INFO: `/v3/users/d5f9fe48bb8f44f997e36e0e320bfc5f` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:25.205300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da68487-9222-4571-b054-033de399bca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5f9fe48bb8f44f997e36e0e320bfc5f)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:25.207342 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da68487-9222-4571-b054-033de399bca0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:25.441326 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5da68487-9222-4571-b054-033de399bca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5f9fe48bb8f44f997e36e0e320bfc5f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:25.449325 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5da68487-9222-4571-b054-033de399bca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5f9fe48bb8f44f997e36e0e320bfc5f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:25.450136 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5da68487-9222-4571-b054-033de399bca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5f9fe48bb8f44f997e36e0e320bfc5f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:25.450755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5da68487-9222-4571-b054-033de399bca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5f9fe48bb8f44f997e36e0e320bfc5f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:25.514882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5da68487-9222-4571-b054-033de399bca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5f9fe48bb8f44f997e36e0e320bfc5f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:25.532580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ba9bc-bf5d-4608-8429-dd98a745da73 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:25.533164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ba9bc-bf5d-4608-8429-dd98a745da73 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:25.533809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ba9bc-bf5d-4608-8429-dd98a745da73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:25.534628 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1212/2463] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:24:25 2022] DELETE /identity/v3/users/d5f9fe48bb8f44f997e36e0e320bfc5f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:24:25.558550 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3c8ba9bc-bf5d-4608-8429-dd98a745da73 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:24:25.559875 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3c8ba9bc-bf5d-4608-8429-dd98a745da73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:25.628497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1252/2464] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 9 19:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:24:25.652053 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da68487-9222-4571-b054-033de399bca0 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:25.653536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5da68487-9222-4571-b054-033de399bca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:25.696647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:25.767721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da68487-9222-4571-b054-033de399bca0 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:25.774093 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4effe-c649-4a62-b521-4c4e607afb5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:25.774865 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4effe-c649-4a62-b521-4c4e607afb5e service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:25.775465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4effe-c649-4a62-b521-4c4e607afb5e service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:25.775726 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4effe-c649-4a62-b521-4c4e607afb5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:25.789584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4effe-c649-4a62-b521-4c4e607afb5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:25.789584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4effe-c649-4a62-b521-4c4e607afb5e service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:25.798448 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1213/2465] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:24:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:24:25.862065 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ba9bc-bf5d-4608-8429-dd98a745da73 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:25.863512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3c8ba9bc-bf5d-4608-8429-dd98a745da73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:25.887692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ba9bc-bf5d-4608-8429-dd98a745da73 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:25.895092 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f9576-c759-4b1c-8a71-e7c9396738e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:25.896846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f9576-c759-4b1c-8a71-e7c9396738e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:25.897383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f9576-c759-4b1c-8a71-e7c9396738e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:25.897889 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f9576-c759-4b1c-8a71-e7c9396738e9 admin admin] PATH_INFO: `/v3/projects/54848519ff4c47f693fffde3e80f33b1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:25.899982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f9576-c759-4b1c-8a71-e7c9396738e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54848519ff4c47f693fffde3e80f33b1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:25.902470 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f9576-c759-4b1c-8a71-e7c9396738e9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:26.025859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c66f9576-c759-4b1c-8a71-e7c9396738e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54848519ff4c47f693fffde3e80f33b1', 'request_id': 'req-c66f9576-c759-4b1c-8a71-e7c9396738e9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:26.047894 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c66f9576-c759-4b1c-8a71-e7c9396738e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54848519ff4c47f693fffde3e80f33b1', 'request_id': 'req-c66f9576-c759-4b1c-8a71-e7c9396738e9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:26.120847 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c66f9576-c759-4b1c-8a71-e7c9396738e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54848519ff4c47f693fffde3e80f33b1', 'request_id': 'req-c66f9576-c759-4b1c-8a71-e7c9396738e9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:26.134096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c66f9576-c759-4b1c-8a71-e7c9396738e9 admin admin] The token cache is being invalidate because project 54848519ff4c47f693fffde3e80f33b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:24:26.134391 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c66f9576-c759-4b1c-8a71-e7c9396738e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:26.135124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-c66f9576-c759-4b1c-8a71-e7c9396738e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:26.136716 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1253/2466] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:24:25 2022] DELETE /identity/v3/projects/54848519ff4c47f693fffde3e80f33b1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:24:26.143924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa14f9d-4019-4cf7-88f7-acb37adb540f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:26.144463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa14f9d-4019-4cf7-88f7-acb37adb540f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:26.144899 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa14f9d-4019-4cf7-88f7-acb37adb540f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:26.167159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-6aa14f9d-4019-4cf7-88f7-acb37adb540f None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:24:26.168390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6aa14f9d-4019-4cf7-88f7-acb37adb540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:26.238081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1214/2467] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:24:26.247014 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89af135-3b29-45b2-a386-aa734c1b74d5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:26.251142 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89af135-3b29-45b2-a386-aa734c1b74d5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:26.251142 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89af135-3b29-45b2-a386-aa734c1b74d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:26.271822 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d89af135-3b29-45b2-a386-aa734c1b74d5 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:24:26.274164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d89af135-3b29-45b2-a386-aa734c1b74d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:26.281494 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1254/2468] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:24:26.285911 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa14f9d-4019-4cf7-88f7-acb37adb540f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:26.296643 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa14f9d-4019-4cf7-88f7-acb37adb540f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:26.301498 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bc470-ecd4-479c-baf1-6d9cfd5270ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:26.302068 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bc470-ecd4-479c-baf1-6d9cfd5270ab admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:26.302888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bc470-ecd4-479c-baf1-6d9cfd5270ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:26.303153 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bc470-ecd4-479c-baf1-6d9cfd5270ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:26.303840 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bc470-ecd4-479c-baf1-6d9cfd5270ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:24:26.304134 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bc470-ecd4-479c-baf1-6d9cfd5270ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:26.305793 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bc470-ecd4-479c-baf1-6d9cfd5270ab admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:26.318504 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1215/2469] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:24:26.323194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89af135-3b29-45b2-a386-aa734c1b74d5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:26.332604 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89af135-3b29-45b2-a386-aa734c1b74d5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:26.338109 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f9fc5-572a-4eb4-bfb1-cbeb14e435a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:26.342438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f9fc5-572a-4eb4-bfb1-cbeb14e435a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:26.342438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f9fc5-572a-4eb4-bfb1-cbeb14e435a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:26.342438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f9fc5-572a-4eb4-bfb1-cbeb14e435a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:26.342438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f9fc5-572a-4eb4-bfb1-cbeb14e435a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:26.342438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f9fc5-572a-4eb4-bfb1-cbeb14e435a6 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:26.438252 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1255/2470] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:24:26 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:24:26.442549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bc470-ecd4-479c-baf1-6d9cfd5270ab admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:26.453601 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bc470-ecd4-479c-baf1-6d9cfd5270ab admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:26.523577 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdc6a7-e485-4f49-a9d5-53be7f11ffd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:26.524205 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdc6a7-e485-4f49-a9d5-53be7f11ffd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:26.524490 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdc6a7-e485-4f49-a9d5-53be7f11ffd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:26.524770 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdc6a7-e485-4f49-a9d5-53be7f11ffd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:26.525410 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bdc6a7-e485-4f49-a9d5-53be7f11ffd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:26.527645 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bdc6a7-e485-4f49-a9d5-53be7f11ffd2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:26.614176 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1216/2471] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:24:26 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:24:26.618677 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f9fc5-572a-4eb4-bfb1-cbeb14e435a6 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:26.639979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f9fc5-572a-4eb4-bfb1-cbeb14e435a6 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:26.645095 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ced2a-f6af-45d6-822d-8882dfcb432f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:26.646613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ced2a-f6af-45d6-822d-8882dfcb432f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:26.647089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ced2a-f6af-45d6-822d-8882dfcb432f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:26.647535 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ced2a-f6af-45d6-822d-8882dfcb432f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:26.648337 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ced2a-f6af-45d6-822d-8882dfcb432f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:26.650203 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ced2a-f6af-45d6-822d-8882dfcb432f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:26.665444 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1256/2472] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:24:26.669665 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdc6a7-e485-4f49-a9d5-53be7f11ffd2 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:26.681792 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdc6a7-e485-4f49-a9d5-53be7f11ffd2 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:26.691213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62edfd-a103-40f8-8f39-3033b6108545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:26.691935 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62edfd-a103-40f8-8f39-3033b6108545 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:26.692071 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62edfd-a103-40f8-8f39-3033b6108545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:26.692269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62edfd-a103-40f8-8f39-3033b6108545 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:26.692977 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62edfd-a103-40f8-8f39-3033b6108545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:26.694627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62edfd-a103-40f8-8f39-3033b6108545 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:26.706813 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1217/2473] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:24:26.711979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ced2a-f6af-45d6-822d-8882dfcb432f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:26.722435 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ced2a-f6af-45d6-822d-8882dfcb432f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:26.728368 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9683677-ca51-44be-b679-2ce9f68f628b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:26.729048 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9683677-ca51-44be-b679-2ce9f68f628b admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:26.729316 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9683677-ca51-44be-b679-2ce9f68f628b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:26.729635 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9683677-ca51-44be-b679-2ce9f68f628b admin admin] PATH_INFO: `/v3/projects/3b9ac8393e6142cea3c0a8cf26da5b64/users/d125613b28fa4191b96d927aedf51b09/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:26.744526 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9683677-ca51-44be-b679-2ce9f68f628b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9ac8393e6142cea3c0a8cf26da5b64, user_id=d125613b28fa4191b96d927aedf51b09, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:26.747233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9683677-ca51-44be-b679-2ce9f68f628b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:26.797448 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1257/2474] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:24:26 2022] PUT /identity/v3/projects/3b9ac8393e6142cea3c0a8cf26da5b64/users/d125613b28fa4191b96d927aedf51b09/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:24:26.802438 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd587d-b1be-4e7e-a65c-94d3a1bb5953 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:26.805743 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd587d-b1be-4e7e-a65c-94d3a1bb5953 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:26.805743 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd587d-b1be-4e7e-a65c-94d3a1bb5953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:26.822561 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-2bcd587d-b1be-4e7e-a65c-94d3a1bb5953 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:24:26.823792 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2bcd587d-b1be-4e7e-a65c-94d3a1bb5953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:26.832271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:26.883531 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1218/2475] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:24:26.897647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9683677-ca51-44be-b679-2ce9f68f628b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:26.899347 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b9683677-ca51-44be-b679-2ce9f68f628b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:26.914359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:26.956994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9683677-ca51-44be-b679-2ce9f68f628b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:26.961405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130e3cc-0260-4279-a0a9-552f090b1938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:26.962047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130e3cc-0260-4279-a0a9-552f090b1938 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:26.962322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130e3cc-0260-4279-a0a9-552f090b1938 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:26.962590 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130e3cc-0260-4279-a0a9-552f090b1938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:26.971613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130e3cc-0260-4279-a0a9-552f090b1938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:26.974643 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130e3cc-0260-4279-a0a9-552f090b1938 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:26.982734 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1258/2476] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:24:29.852388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeed31-9802-4009-be47-868fbe640e65 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:29.853285 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeed31-9802-4009-be47-868fbe640e65 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:29.853606 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeed31-9802-4009-be47-868fbe640e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:29.874048 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1bbeed31-9802-4009-be47-868fbe640e65 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:24:29.875264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1bbeed31-9802-4009-be47-868fbe640e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:29.883380 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1219/2477] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 9 19:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:24:29.908633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130e3cc-0260-4279-a0a9-552f090b1938 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:29.910185 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9130e3cc-0260-4279-a0a9-552f090b1938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:29.986320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130e3cc-0260-4279-a0a9-552f090b1938 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:29.991981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526ec13-2501-428b-9289-1946b955e325 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:29.992643 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526ec13-2501-428b-9289-1946b955e325 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:29.992929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526ec13-2501-428b-9289-1946b955e325 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:29.993203 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526ec13-2501-428b-9289-1946b955e325 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:30.002386 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526ec13-2501-428b-9289-1946b955e325 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:30.004164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526ec13-2501-428b-9289-1946b955e325 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:30.016603 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1259/2478] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:24:33.639345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeed31-9802-4009-be47-868fbe640e65 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:33.645106 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1bbeed31-9802-4009-be47-868fbe640e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:33.658177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeed31-9802-4009-be47-868fbe640e65 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:33.662868 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f9641-b94b-4beb-ae82-c3dd3c37702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:33.663525 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f9641-b94b-4beb-ae82-c3dd3c37702b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:33.663804 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f9641-b94b-4beb-ae82-c3dd3c37702b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:33.664163 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f9641-b94b-4beb-ae82-c3dd3c37702b admin admin] PATH_INFO: `/v3/users/46fb993dd5d7441fa70a8bc930cccff8` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:33.666414 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f9641-b94b-4beb-ae82-c3dd3c37702b admin admin] RBAC: Authorizing `identity:delete_user(user_id=46fb993dd5d7441fa70a8bc930cccff8)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:33.668369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f9641-b94b-4beb-ae82-c3dd3c37702b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:33.857724 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4c1f9641-b94b-4beb-ae82-c3dd3c37702b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46fb993dd5d7441fa70a8bc930cccff8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:33.868308 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4c1f9641-b94b-4beb-ae82-c3dd3c37702b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46fb993dd5d7441fa70a8bc930cccff8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:33.869046 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4c1f9641-b94b-4beb-ae82-c3dd3c37702b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46fb993dd5d7441fa70a8bc930cccff8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:33.869719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4c1f9641-b94b-4beb-ae82-c3dd3c37702b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46fb993dd5d7441fa70a8bc930cccff8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:33.969060 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4c1f9641-b94b-4beb-ae82-c3dd3c37702b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46fb993dd5d7441fa70a8bc930cccff8'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:34.003486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1220/2479] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:24:33 2022] DELETE /identity/v3/users/46fb993dd5d7441fa70a8bc930cccff8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:24:34.289566 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318c1c8-cecb-41bc-8123-16b3ee97fad3 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:34.290019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318c1c8-cecb-41bc-8123-16b3ee97fad3 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:34.290198 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318c1c8-cecb-41bc-8123-16b3ee97fad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:34.321094 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2318c1c8-cecb-41bc-8123-16b3ee97fad3 None None] MFA Rules not processed for user `d125613b28fa4191b96d927aedf51b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:24:34.322360 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2318c1c8-cecb-41bc-8123-16b3ee97fad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:34.387562 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1260/2480] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:24:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:24:34.404510 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f9641-b94b-4beb-ae82-c3dd3c37702b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:34.406100 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4c1f9641-b94b-4beb-ae82-c3dd3c37702b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:34.428016 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318c1c8-cecb-41bc-8123-16b3ee97fad3 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:34.429543 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2318c1c8-cecb-41bc-8123-16b3ee97fad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:34.486810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:34.498682 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f9641-b94b-4beb-ae82-c3dd3c37702b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:34.504600 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40119253-4696-41e7-9124-032b782839e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:34.505221 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40119253-4696-41e7-9124-032b782839e8 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:34.506135 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40119253-4696-41e7-9124-032b782839e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:34.506514 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40119253-4696-41e7-9124-032b782839e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:34.514990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40119253-4696-41e7-9124-032b782839e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:34.516700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40119253-4696-41e7-9124-032b782839e8 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:34.525914 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318c1c8-cecb-41bc-8123-16b3ee97fad3 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:34.531580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b596e-18e3-46c7-a3a1-207169358fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:34.533702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b596e-18e3-46c7-a3a1-207169358fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:34.534005 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b596e-18e3-46c7-a3a1-207169358fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:34.534278 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b596e-18e3-46c7-a3a1-207169358fcc admin admin] PATH_INFO: `/v3/projects/3599247f04a348fda3e8b6ff2a569b51` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:34.535569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b596e-18e3-46c7-a3a1-207169358fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3599247f04a348fda3e8b6ff2a569b51)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:34.539608 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b596e-18e3-46c7-a3a1-207169358fcc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:34.539781 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1221/2481] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:24:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:24:34.695363 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ef2b596e-18e3-46c7-a3a1-207169358fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3599247f04a348fda3e8b6ff2a569b51', 'request_id': 'req-ef2b596e-18e3-46c7-a3a1-207169358fcc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:34.700711 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ef2b596e-18e3-46c7-a3a1-207169358fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3599247f04a348fda3e8b6ff2a569b51', 'request_id': 'req-ef2b596e-18e3-46c7-a3a1-207169358fcc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:34.779911 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ef2b596e-18e3-46c7-a3a1-207169358fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3599247f04a348fda3e8b6ff2a569b51', 'request_id': 'req-ef2b596e-18e3-46c7-a3a1-207169358fcc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:34.793596 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ef2b596e-18e3-46c7-a3a1-207169358fcc admin admin] The token cache is being invalidate because project 3599247f04a348fda3e8b6ff2a569b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:24:34.793889 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ef2b596e-18e3-46c7-a3a1-207169358fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:34.794559 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ef2b596e-18e3-46c7-a3a1-207169358fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:34.796173 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1261/2482] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:24:34 2022] DELETE /identity/v3/projects/3599247f04a348fda3e8b6ff2a569b51 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:24:34.800376 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40119253-4696-41e7-9124-032b782839e8 service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:34.807965 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:34.816228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40119253-4696-41e7-9124-032b782839e8 service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:34.877063 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb8574-4bb7-4b6b-bbf7-a2c5f880496a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:34.877814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb8574-4bb7-4b6b-bbf7-a2c5f880496a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:34.878095 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb8574-4bb7-4b6b-bbf7-a2c5f880496a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:34.880429 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb8574-4bb7-4b6b-bbf7-a2c5f880496a admin admin] PATH_INFO: `/v3/users/50a0e8f237ea44a3a33b29c3b75b4380` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:34.880429 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb8574-4bb7-4b6b-bbf7-a2c5f880496a admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a0e8f237ea44a3a33b29c3b75b4380)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:34.881744 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb8574-4bb7-4b6b-bbf7-a2c5f880496a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:35.119572 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c8cb8574-4bb7-4b6b-bbf7-a2c5f880496a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a0e8f237ea44a3a33b29c3b75b4380'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:35.127533 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c8cb8574-4bb7-4b6b-bbf7-a2c5f880496a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a0e8f237ea44a3a33b29c3b75b4380'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:35.128418 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c8cb8574-4bb7-4b6b-bbf7-a2c5f880496a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a0e8f237ea44a3a33b29c3b75b4380'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:35.129193 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c8cb8574-4bb7-4b6b-bbf7-a2c5f880496a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a0e8f237ea44a3a33b29c3b75b4380'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:35.212467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c8cb8574-4bb7-4b6b-bbf7-a2c5f880496a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a0e8f237ea44a3a33b29c3b75b4380'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:35.238133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1222/2483] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:24:34 2022] DELETE /identity/v3/users/50a0e8f237ea44a3a33b29c3b75b4380 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:24:35.759526 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b596e-18e3-46c7-a3a1-207169358fcc admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:35.761728 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ef2b596e-18e3-46c7-a3a1-207169358fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:35.775911 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b596e-18e3-46c7-a3a1-207169358fcc admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:35.843384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d570c1-e211-4615-afe8-ae7b67ff1a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:35.844132 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d570c1-e211-4615-afe8-ae7b67ff1a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:35.844410 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d570c1-e211-4615-afe8-ae7b67ff1a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:35.844683 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d570c1-e211-4615-afe8-ae7b67ff1a05 admin admin] PATH_INFO: `/v3/projects/d4d581a6029549d7a4f53cb77e28c486` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:35.845883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d570c1-e211-4615-afe8-ae7b67ff1a05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4d581a6029549d7a4f53cb77e28c486)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:35.847924 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d570c1-e211-4615-afe8-ae7b67ff1a05 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:35.967002 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a7d570c1-e211-4615-afe8-ae7b67ff1a05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4d581a6029549d7a4f53cb77e28c486', 'request_id': 'req-a7d570c1-e211-4615-afe8-ae7b67ff1a05'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:35.972819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a7d570c1-e211-4615-afe8-ae7b67ff1a05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4d581a6029549d7a4f53cb77e28c486', 'request_id': 'req-a7d570c1-e211-4615-afe8-ae7b67ff1a05'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:35.978525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:36.047483 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a7d570c1-e211-4615-afe8-ae7b67ff1a05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4d581a6029549d7a4f53cb77e28c486', 'request_id': 'req-a7d570c1-e211-4615-afe8-ae7b67ff1a05'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:36.060049 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a7d570c1-e211-4615-afe8-ae7b67ff1a05 admin admin] The token cache is being invalidate because project d4d581a6029549d7a4f53cb77e28c486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:24:36.060333 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a7d570c1-e211-4615-afe8-ae7b67ff1a05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:36.061885 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a7d570c1-e211-4615-afe8-ae7b67ff1a05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:24:36.067140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1262/2484] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:24:35 2022] DELETE /identity/v3/projects/d4d581a6029549d7a4f53cb77e28c486 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:24:36.068660 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbca740-2304-40b5-864c-997f6d3eb28f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:36.069277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbca740-2304-40b5-864c-997f6d3eb28f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:36.069277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbca740-2304-40b5-864c-997f6d3eb28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:36.090318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-5dbca740-2304-40b5-864c-997f6d3eb28f None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:24:36.092184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5dbca740-2304-40b5-864c-997f6d3eb28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:36.161626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1223/2485] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:24:36.169952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1f7a7-aaf5-4bd5-bcf9-5b4bcac36398 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:36.170237 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1f7a7-aaf5-4bd5-bcf9-5b4bcac36398 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:36.170515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1f7a7-aaf5-4bd5-bcf9-5b4bcac36398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:36.192649 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-62d1f7a7-aaf5-4bd5-bcf9-5b4bcac36398 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:24:36.194206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-62d1f7a7-aaf5-4bd5-bcf9-5b4bcac36398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:36.203977 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1263/2486] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:24:36.208012 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbca740-2304-40b5-864c-997f6d3eb28f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:36.218925 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbca740-2304-40b5-864c-997f6d3eb28f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:36.225217 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fe3cb-0b07-41d1-a8b0-2de3969cd7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:36.230108 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fe3cb-0b07-41d1-a8b0-2de3969cd7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:36.230402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fe3cb-0b07-41d1-a8b0-2de3969cd7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:36.230683 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fe3cb-0b07-41d1-a8b0-2de3969cd7a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:36.231366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fe3cb-0b07-41d1-a8b0-2de3969cd7a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:24:36.231671 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fe3cb-0b07-41d1-a8b0-2de3969cd7a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:36.233297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fe3cb-0b07-41d1-a8b0-2de3969cd7a9 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:36.248593 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1224/2487] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:24:36.251913 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1f7a7-aaf5-4bd5-bcf9-5b4bcac36398 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:36.263753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1f7a7-aaf5-4bd5-bcf9-5b4bcac36398 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:36.270725 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796e688-b78a-4043-a66c-86236d817f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:36.271641 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796e688-b78a-4043-a66c-86236d817f63 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:36.272009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796e688-b78a-4043-a66c-86236d817f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:36.272287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796e688-b78a-4043-a66c-86236d817f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:36.272939 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796e688-b78a-4043-a66c-86236d817f63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:36.275034 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796e688-b78a-4043-a66c-86236d817f63 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:36.393543 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1264/2488] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:24:36 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:24:36.398294 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fe3cb-0b07-41d1-a8b0-2de3969cd7a9 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:36.408650 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fe3cb-0b07-41d1-a8b0-2de3969cd7a9 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:36.418122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:36.473810 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a9e92-54d2-459b-835a-9f178c063899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:36.474685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a9e92-54d2-459b-835a-9f178c063899 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:36.474966 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a9e92-54d2-459b-835a-9f178c063899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:36.475243 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a9e92-54d2-459b-835a-9f178c063899 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:36.475920 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a9e92-54d2-459b-835a-9f178c063899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:36.478043 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a9e92-54d2-459b-835a-9f178c063899 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:36.598589 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1225/2489] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:24:36 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:24:36.602871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796e688-b78a-4043-a66c-86236d817f63 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:36.617079 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796e688-b78a-4043-a66c-86236d817f63 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:36.623314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dba69b-d15d-4a56-b863-29002b675276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:36.623314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dba69b-d15d-4a56-b863-29002b675276 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:36.623314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dba69b-d15d-4a56-b863-29002b675276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:36.623314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dba69b-d15d-4a56-b863-29002b675276 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:36.629931 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dba69b-d15d-4a56-b863-29002b675276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:36.629931 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dba69b-d15d-4a56-b863-29002b675276 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:36.638627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1265/2490] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:24:36.642774 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a9e92-54d2-459b-835a-9f178c063899 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:36.654315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a9e92-54d2-459b-835a-9f178c063899 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:36.659681 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8c655-e0a9-42c7-9505-866804b29fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:36.660426 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8c655-e0a9-42c7-9505-866804b29fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:36.660803 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8c655-e0a9-42c7-9505-866804b29fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:36.661173 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8c655-e0a9-42c7-9505-866804b29fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:36.662338 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8c655-e0a9-42c7-9505-866804b29fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:36.664053 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8c655-e0a9-42c7-9505-866804b29fe9 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:36.677941 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1226/2491] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:24:36.681525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dba69b-d15d-4a56-b863-29002b675276 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:36.696934 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dba69b-d15d-4a56-b863-29002b675276 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:36.702402 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ea4ac-9931-4493-8aac-3960e0990dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:36.703211 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ea4ac-9931-4493-8aac-3960e0990dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:36.703625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ea4ac-9931-4493-8aac-3960e0990dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:36.703996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ea4ac-9931-4493-8aac-3960e0990dc2 admin admin] PATH_INFO: `/v3/projects/9f976d3c0ec647caa6e003edcb024b28/users/dc00c0a80f7b4ea5acd190b44fe46429/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:36.722967 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ea4ac-9931-4493-8aac-3960e0990dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f976d3c0ec647caa6e003edcb024b28, user_id=dc00c0a80f7b4ea5acd190b44fe46429, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:36.726228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ea4ac-9931-4493-8aac-3960e0990dc2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:36.836452 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96319cd2-d8e1-4672-b4a3-baacda71ed57 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:36.837098 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96319cd2-d8e1-4672-b4a3-baacda71ed57 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:36.837547 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96319cd2-d8e1-4672-b4a3-baacda71ed57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:36.844761 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1266/2492] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:24:36 2022] PUT /identity/v3/projects/9f976d3c0ec647caa6e003edcb024b28/users/dc00c0a80f7b4ea5acd190b44fe46429/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:24:36.866454 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-96319cd2-d8e1-4672-b4a3-baacda71ed57 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:24:36.867843 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-96319cd2-d8e1-4672-b4a3-baacda71ed57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:36.948021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1227/2493] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:24:36.958593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ea4ac-9931-4493-8aac-3960e0990dc2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:36.960648 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6f7ea4ac-9931-4493-8aac-3960e0990dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:37.043329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ea4ac-9931-4493-8aac-3960e0990dc2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:37.047428 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5802c33-9a04-40c0-8d4e-634b1a9cbe32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:37.048045 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5802c33-9a04-40c0-8d4e-634b1a9cbe32 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:37.048524 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5802c33-9a04-40c0-8d4e-634b1a9cbe32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:37.048801 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5802c33-9a04-40c0-8d4e-634b1a9cbe32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:37.060753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5802c33-9a04-40c0-8d4e-634b1a9cbe32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:37.062636 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5802c33-9a04-40c0-8d4e-634b1a9cbe32 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:37.076583 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1267/2494] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:24:37.152261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d31b6-3f60-419a-8ade-fef8c79d51f7 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:37.153051 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d31b6-3f60-419a-8ade-fef8c79d51f7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:37.153323 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d31b6-3f60-419a-8ade-fef8c79d51f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:37.172655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-052d31b6-3f60-419a-8ade-fef8c79d51f7 None None] MFA Rules not processed for user `d125613b28fa4191b96d927aedf51b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:24:37.174012 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-052d31b6-3f60-419a-8ade-fef8c79d51f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:37.259511 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1228/2495] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:24:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:24:43.473429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44eaa6-aab1-46ee-9eb4-ac597474ed58 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:43.473902 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44eaa6-aab1-46ee-9eb4-ac597474ed58 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:43.475393 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44eaa6-aab1-46ee-9eb4-ac597474ed58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:43.503161 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2f44eaa6-aab1-46ee-9eb4-ac597474ed58 None None] MFA Rules not processed for user `dc00c0a80f7b4ea5acd190b44fe46429`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:24:43.504674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2f44eaa6-aab1-46ee-9eb4-ac597474ed58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:43.576075 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1268/2496] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:24:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:24:43.580565 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d31b6-3f60-419a-8ade-fef8c79d51f7 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:43.592996 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d31b6-3f60-419a-8ade-fef8c79d51f7 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:43.598437 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bebd7-7292-4a1a-a9d3-f858f1de10d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:43.599086 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bebd7-7292-4a1a-a9d3-f858f1de10d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:43.599368 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bebd7-7292-4a1a-a9d3-f858f1de10d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:43.600171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bebd7-7292-4a1a-a9d3-f858f1de10d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:43.600838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bebd7-7292-4a1a-a9d3-f858f1de10d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:43.602806 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bebd7-7292-4a1a-a9d3-f858f1de10d8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:43.690949 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1229/2497] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:24:43 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:24:43.695301 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44eaa6-aab1-46ee-9eb4-ac597474ed58 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:43.706746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44eaa6-aab1-46ee-9eb4-ac597474ed58 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:43.726471 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:43.771629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3eb9a4-8c83-408e-9d3b-a25b8ad0f1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:43.772363 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3eb9a4-8c83-408e-9d3b-a25b8ad0f1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:43.772994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3eb9a4-8c83-408e-9d3b-a25b8ad0f1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:43.773339 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3eb9a4-8c83-408e-9d3b-a25b8ad0f1a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:43.774086 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3eb9a4-8c83-408e-9d3b-a25b8ad0f1a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:43.776108 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3eb9a4-8c83-408e-9d3b-a25b8ad0f1a3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:43.858630 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1269/2498] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:24:43 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:24:43.862751 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bebd7-7292-4a1a-a9d3-f858f1de10d8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:43.873749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bebd7-7292-4a1a-a9d3-f858f1de10d8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:43.878805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56bf43-ef1a-4344-a59d-f95b37dfce46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:43.879414 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56bf43-ef1a-4344-a59d-f95b37dfce46 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:43.879874 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56bf43-ef1a-4344-a59d-f95b37dfce46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:43.880147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56bf43-ef1a-4344-a59d-f95b37dfce46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:43.881396 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56bf43-ef1a-4344-a59d-f95b37dfce46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:43.883105 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56bf43-ef1a-4344-a59d-f95b37dfce46 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:43.893243 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1230/2499] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:24:43.898262 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3eb9a4-8c83-408e-9d3b-a25b8ad0f1a3 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:43.909049 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3eb9a4-8c83-408e-9d3b-a25b8ad0f1a3 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:43.914733 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8cb9c-edc9-4229-8a83-7a68fdf17feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:43.915398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8cb9c-edc9-4229-8a83-7a68fdf17feb admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:43.915676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8cb9c-edc9-4229-8a83-7a68fdf17feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:43.915946 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8cb9c-edc9-4229-8a83-7a68fdf17feb admin admin] PATH_INFO: `/v3/projects/29649b91a75c4cd1bbeed4b1caf93057/users/d10d0dcb949b4f4d8736edf0410e2371/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:43.932904 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8cb9c-edc9-4229-8a83-7a68fdf17feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=29649b91a75c4cd1bbeed4b1caf93057, user_id=d10d0dcb949b4f4d8736edf0410e2371, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:43.935635 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8cb9c-edc9-4229-8a83-7a68fdf17feb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:44.077262 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1270/2500] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:24:43 2022] PUT /identity/v3/projects/29649b91a75c4cd1bbeed4b1caf93057/users/d10d0dcb949b4f4d8736edf0410e2371/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:24:44.081156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56bf43-ef1a-4344-a59d-f95b37dfce46 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:44.087840 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:44.094068 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56bf43-ef1a-4344-a59d-f95b37dfce46 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:44.167268 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963653a4-078e-419f-89dd-5117f5c41caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:44.168130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963653a4-078e-419f-89dd-5117f5c41caa admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:44.168465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963653a4-078e-419f-89dd-5117f5c41caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:44.168860 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963653a4-078e-419f-89dd-5117f5c41caa admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:44.169708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963653a4-078e-419f-89dd-5117f5c41caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:44.171472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963653a4-078e-419f-89dd-5117f5c41caa admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:44.186715 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1231/2501] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:24:44.187564 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8cb9c-edc9-4229-8a83-7a68fdf17feb admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:44.204388 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8cb9c-edc9-4229-8a83-7a68fdf17feb admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:44.210968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624878a6-2701-4c78-abd6-1e057dfb6310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:44.211778 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624878a6-2701-4c78-abd6-1e057dfb6310 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:44.212066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624878a6-2701-4c78-abd6-1e057dfb6310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:44.212338 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624878a6-2701-4c78-abd6-1e057dfb6310 admin admin] PATH_INFO: `/v3/projects/29649b91a75c4cd1bbeed4b1caf93057/users/d10d0dcb949b4f4d8736edf0410e2371/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:44.219156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624878a6-2701-4c78-abd6-1e057dfb6310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29649b91a75c4cd1bbeed4b1caf93057, user_id=d10d0dcb949b4f4d8736edf0410e2371, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:44.222690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624878a6-2701-4c78-abd6-1e057dfb6310 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:44.245689 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1271/2502] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:24:44 2022] PUT /identity/v3/projects/29649b91a75c4cd1bbeed4b1caf93057/users/d10d0dcb949b4f4d8736edf0410e2371/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:24:50.327397 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62865d58-fe89-4b38-8247-11f858cf91f7 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:50.330036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62865d58-fe89-4b38-8247-11f858cf91f7 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:50.331244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62865d58-fe89-4b38-8247-11f858cf91f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:50.362943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-62865d58-fe89-4b38-8247-11f858cf91f7 None None] MFA Rules not processed for user `d10d0dcb949b4f4d8736edf0410e2371`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:24:50.364178 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-62865d58-fe89-4b38-8247-11f858cf91f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:50.440590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1232/2503] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:24:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:24:50.454485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624878a6-2701-4c78-abd6-1e057dfb6310 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:50.461236 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-624878a6-2701-4c78-abd6-1e057dfb6310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:50.556526 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624878a6-2701-4c78-abd6-1e057dfb6310 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:50.562253 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def805f7-a145-47d6-ae55-a8ef3f857a7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:50.562869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def805f7-a145-47d6-ae55-a8ef3f857a7d service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:50.563154 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def805f7-a145-47d6-ae55-a8ef3f857a7d service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:50.563429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def805f7-a145-47d6-ae55-a8ef3f857a7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:50.629251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def805f7-a145-47d6-ae55-a8ef3f857a7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:50.631492 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def805f7-a145-47d6-ae55-a8ef3f857a7d service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:50.649965 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1272/2504] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:24:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:24:53.249318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62865d58-fe89-4b38-8247-11f858cf91f7 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:24:53.250792 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-62865d58-fe89-4b38-8247-11f858cf91f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:53.292029 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cae4c-7fe0-4a43-8981-48ce181e89ea None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:53.293574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cae4c-7fe0-4a43-8981-48ce181e89ea None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:53.294031 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376cae4c-7fe0-4a43-8981-48ce181e89ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:53.314691 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-376cae4c-7fe0-4a43-8981-48ce181e89ea None None] MFA Rules not processed for user `dc00c0a80f7b4ea5acd190b44fe46429`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:24:53.316202 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-376cae4c-7fe0-4a43-8981-48ce181e89ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:53.330920 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62865d58-fe89-4b38-8247-11f858cf91f7 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:24:53.334796 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1273/2505] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:24:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:24:53.335666 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc0510-e903-4076-853e-8c1f7296b107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:24:53.336293 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc0510-e903-4076-853e-8c1f7296b107 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:24:53.336607 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc0510-e903-4076-853e-8c1f7296b107 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:24:53.336840 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc0510-e903-4076-853e-8c1f7296b107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:24:53.338637 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-64bc0510-e903-4076-853e-8c1f7296b107 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:24:53.383231 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:53.403083 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc0510-e903-4076-853e-8c1f7296b107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:24:53.404894 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc0510-e903-4076-853e-8c1f7296b107 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:24:53.415852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1233/2506] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:24:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:25:02.573140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da726c81-0e50-4e96-bb08-6697921cefa5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:25:02.573842 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da726c81-0e50-4e96-bb08-6697921cefa5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:25:02.573842 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da726c81-0e50-4e96-bb08-6697921cefa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:25:02.581016 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:25:02.596950 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-da726c81-0e50-4e96-bb08-6697921cefa5 None None] MFA Rules not processed for user `740e3901a15d49ee9891858ebf7086e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:25:02.598182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-da726c81-0e50-4e96-bb08-6697921cefa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:25:02.605064 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1274/2507] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:25:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:25:03.424061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=10 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:25:10.158699 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc0510-e903-4076-853e-8c1f7296b107 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:25:10.160719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-64bc0510-e903-4076-853e-8c1f7296b107 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:25:10.228814 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc0510-e903-4076-853e-8c1f7296b107 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:25:10.234675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21027c-cc97-498a-81af-33cb9ef8524a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:25:10.235325 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21027c-cc97-498a-81af-33cb9ef8524a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:25:10.235609 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21027c-cc97-498a-81af-33cb9ef8524a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:25:10.235885 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21027c-cc97-498a-81af-33cb9ef8524a admin admin] PATH_INFO: `/v3/users/80fa78fd284947f19c8aaf4d996af3a1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:25:10.237055 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21027c-cc97-498a-81af-33cb9ef8524a admin admin] RBAC: Authorizing `identity:delete_user(user_id=80fa78fd284947f19c8aaf4d996af3a1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:25:10.239049 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21027c-cc97-498a-81af-33cb9ef8524a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:25:10.440889 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9f21027c-cc97-498a-81af-33cb9ef8524a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80fa78fd284947f19c8aaf4d996af3a1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:25:10.448560 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9f21027c-cc97-498a-81af-33cb9ef8524a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80fa78fd284947f19c8aaf4d996af3a1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:25:10.449899 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9f21027c-cc97-498a-81af-33cb9ef8524a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80fa78fd284947f19c8aaf4d996af3a1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:25:10.450518 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9f21027c-cc97-498a-81af-33cb9ef8524a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80fa78fd284947f19c8aaf4d996af3a1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:25:10.528468 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-9f21027c-cc97-498a-81af-33cb9ef8524a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80fa78fd284947f19c8aaf4d996af3a1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:25:10.547125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1234/2508] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:25:10 2022] DELETE /identity/v3/users/80fa78fd284947f19c8aaf4d996af3a1 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:25:10.840401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da726c81-0e50-4e96-bb08-6697921cefa5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:25:10.851556 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da726c81-0e50-4e96-bb08-6697921cefa5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:25:10.918979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6256f-ae41-45db-88e9-1ffe8bdb9921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:25:10.919651 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6256f-ae41-45db-88e9-1ffe8bdb9921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:25:10.919890 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6256f-ae41-45db-88e9-1ffe8bdb9921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:25:10.920159 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6256f-ae41-45db-88e9-1ffe8bdb9921 admin admin] PATH_INFO: `/v3/projects/2ffd314db2844f3fa1fd48f8029a095c` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:25:10.921286 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6256f-ae41-45db-88e9-1ffe8bdb9921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ffd314db2844f3fa1fd48f8029a095c)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:25:10.923228 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6256f-ae41-45db-88e9-1ffe8bdb9921 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:25:11.054435 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-20f6256f-ae41-45db-88e9-1ffe8bdb9921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ffd314db2844f3fa1fd48f8029a095c', 'request_id': 'req-20f6256f-ae41-45db-88e9-1ffe8bdb9921'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:25:11.060265 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-20f6256f-ae41-45db-88e9-1ffe8bdb9921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ffd314db2844f3fa1fd48f8029a095c', 'request_id': 'req-20f6256f-ae41-45db-88e9-1ffe8bdb9921'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:25:11.134088 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-20f6256f-ae41-45db-88e9-1ffe8bdb9921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ffd314db2844f3fa1fd48f8029a095c', 'request_id': 'req-20f6256f-ae41-45db-88e9-1ffe8bdb9921'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:25:11.145990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-20f6256f-ae41-45db-88e9-1ffe8bdb9921 admin admin] The token cache is being invalidate because project 2ffd314db2844f3fa1fd48f8029a095c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:25:11.146280 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-20f6256f-ae41-45db-88e9-1ffe8bdb9921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:25:11.146913 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-20f6256f-ae41-45db-88e9-1ffe8bdb9921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:25:11.148400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1275/2509] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:25:10 2022] DELETE /identity/v3/projects/2ffd314db2844f3fa1fd48f8029a095c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:25:20.546703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:25:21.143078 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:25:34.058352 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab36a5-0107-4453-8d93-1f6bd1490ce1 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:25:34.060157 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab36a5-0107-4453-8d93-1f6bd1490ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:25:34.060157 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab36a5-0107-4453-8d93-1f6bd1490ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:25:34.079310 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c2ab36a5-0107-4453-8d93-1f6bd1490ce1 None None] MFA Rules not processed for user `5c29eab582a64a8991b171766d321e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:25:34.080564 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c2ab36a5-0107-4453-8d93-1f6bd1490ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:25:34.139680 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1235/2510] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Aug 9 19:25:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:25:34.283551 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6256f-ae41-45db-88e9-1ffe8bdb9921 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:25:34.284989 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-20f6256f-ae41-45db-88e9-1ffe8bdb9921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:25:34.359242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6256f-ae41-45db-88e9-1ffe8bdb9921 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:25:34.364441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb3748-817f-48fe-b2ee-2c2e8227203b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac48cd591b44f2999d2f172262019da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:25:34.365171 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb3748-817f-48fe-b2ee-2c2e8227203b service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:25:34.365472 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb3748-817f-48fe-b2ee-2c2e8227203b service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:25:34.365767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb3748-817f-48fe-b2ee-2c2e8227203b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:25:34.374252 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb3748-817f-48fe-b2ee-2c2e8227203b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:25:34.375919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb3748-817f-48fe-b2ee-2c2e8227203b service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:25:34.385204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1276/2511] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Aug 9 19:25:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 19:25:34.433147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab36a5-0107-4453-8d93-1f6bd1490ce1 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:25:34.436102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c2ab36a5-0107-4453-8d93-1f6bd1490ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:25:34.508136 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab36a5-0107-4453-8d93-1f6bd1490ce1 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:25:34.516311 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d6121-ba4d-4fbf-b15c-5b21fac79645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:25:34.517018 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d6121-ba4d-4fbf-b15c-5b21fac79645 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:25:34.517371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d6121-ba4d-4fbf-b15c-5b21fac79645 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:25:34.517752 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d6121-ba4d-4fbf-b15c-5b21fac79645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:25:34.519822 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-503d6121-ba4d-4fbf-b15c-5b21fac79645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:25:34.617215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d6121-ba4d-4fbf-b15c-5b21fac79645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:25:34.618749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d6121-ba4d-4fbf-b15c-5b21fac79645 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:25:34.632282 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1236/2512] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:25:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:25:44.380858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=32 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:25:44.627110 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=75 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:25:52.849140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadc7e2-ff0c-40ba-a163-57940591db57 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:25:52.849692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadc7e2-ff0c-40ba-a163-57940591db57 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:25:52.849692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadc7e2-ff0c-40ba-a163-57940591db57 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:25:52.851316 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1277/2513] 10.222.0.65 () {54 vars in 921 bytes} [Tue Aug 9 19:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:25:52.857358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd7d8d-cdd6-4321-8127-850ce20746ef None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:25:52.857872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd7d8d-cdd6-4321-8127-850ce20746ef None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:25:52.858060 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd7d8d-cdd6-4321-8127-850ce20746ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:25:52.922238 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-bcdd7d8d-cdd6-4321-8127-850ce20746ef None None] MFA Rules not processed for user `2cfda1bec35145f3bbcc13fae0b7af2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:25:52.923459 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-bcdd7d8d-cdd6-4321-8127-850ce20746ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:25:53.045176 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1237/2514] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Aug 9 19:25:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:25:53.056967 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadc7e2-ff0c-40ba-a163-57940591db57 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:25:53.058698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-afadc7e2-ff0c-40ba-a163-57940591db57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:25:53.116819 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadc7e2-ff0c-40ba-a163-57940591db57 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:25:53.120350 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601da81e-2efa-46ad-970d-5bfc15c41835 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d8000eb20445b78ee56ac372cd024c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:25:53.120954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601da81e-2efa-46ad-970d-5bfc15c41835 service glance] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:25:53.121234 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601da81e-2efa-46ad-970d-5bfc15c41835 service glance] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:25:53.121548 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601da81e-2efa-46ad-970d-5bfc15c41835 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:25:53.131429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601da81e-2efa-46ad-970d-5bfc15c41835 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:25:53.132858 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601da81e-2efa-46ad-970d-5bfc15c41835 service glance] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:25:53.143856 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1278/2515] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:25:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:25:53.384332 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaae757-1302-4ff5-8e22-0e70d69328c0 None None] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:25:53.384619 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaae757-1302-4ff5-8e22-0e70d69328c0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:25:53.384893 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaae757-1302-4ff5-8e22-0e70d69328c0 None None] PATH_INFO: `/` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:25:53.386282 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1238/2516] 10.222.0.65 () {54 vars in 921 bytes} [Tue Aug 9 19:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:25:53.391573 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab891d-2fd3-490f-9f1b-52165ae1b1bb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:25:53.391857 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab891d-2fd3-490f-9f1b-52165ae1b1bb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:25:53.392130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab891d-2fd3-490f-9f1b-52165ae1b1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:25:53.412335 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-84ab891d-2fd3-490f-9f1b-52165ae1b1bb None None] MFA Rules not processed for user `a62d954163ca4bf298f461b4d253269e`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:25:53.413543 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-84ab891d-2fd3-490f-9f1b-52165ae1b1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:25:53.419908 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1279/2517] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Aug 9 19:25:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:25:53.431646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaae757-1302-4ff5-8e22-0e70d69328c0 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:25:53.442465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaae757-1302-4ff5-8e22-0e70d69328c0 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:25:53.445961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797efb25-8684-47ac-8c62-efdb7e65dcc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:25:53.446544 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797efb25-8684-47ac-8c62-efdb7e65dcc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:25:53.446820 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797efb25-8684-47ac-8c62-efdb7e65dcc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:25:53.447088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797efb25-8684-47ac-8c62-efdb7e65dcc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:25:53.454588 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797efb25-8684-47ac-8c62-efdb7e65dcc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:25:53.456008 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797efb25-8684-47ac-8c62-efdb7e65dcc0 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:25:53.463554 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1239/2518] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:25:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:25:53.546906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74473aaf-8126-49bc-a93c-4b7e62d3edc0 None None] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:25:53.547199 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74473aaf-8126-49bc-a93c-4b7e62d3edc0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:25:53.547475 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74473aaf-8126-49bc-a93c-4b7e62d3edc0 None None] PATH_INFO: `/` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:25:53.548862 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1280/2519] 10.222.0.65 () {54 vars in 921 bytes} [Tue Aug 9 19:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 19:25:53.554087 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06e530-e19f-4872-8d2c-63a540b071e0 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:25:53.554428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06e530-e19f-4872-8d2c-63a540b071e0 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:25:53.554706 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06e530-e19f-4872-8d2c-63a540b071e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:25:53.574536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-0d06e530-e19f-4872-8d2c-63a540b071e0 None None] MFA Rules not processed for user `2cfda1bec35145f3bbcc13fae0b7af2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:25:53.575835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0d06e530-e19f-4872-8d2c-63a540b071e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:25:53.585931 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1240/2520] 10.222.0.65 () {58 vars in 1018 bytes} [Tue Aug 9 19:25:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:25:53.596426 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74473aaf-8126-49bc-a93c-4b7e62d3edc0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:25:53.607792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74473aaf-8126-49bc-a93c-4b7e62d3edc0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:25:53.612407 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51535cd-7d47-429e-ab89-e165fd0efc39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:25:53.613035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51535cd-7d47-429e-ab89-e165fd0efc39 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:25:53.613317 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51535cd-7d47-429e-ab89-e165fd0efc39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:25:53.613624 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51535cd-7d47-429e-ab89-e165fd0efc39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:25:53.623741 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51535cd-7d47-429e-ab89-e165fd0efc39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:25:53.626033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51535cd-7d47-429e-ab89-e165fd0efc39 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:25:53.636688 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1281/2521] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:25:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:25:57.000132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3d585-92c0-4c48-99dc-36e12857a862 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:25:57.000647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3d585-92c0-4c48-99dc-36e12857a862 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:25:57.000755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3d585-92c0-4c48-99dc-36e12857a862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:25:57.019167 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a9a3d585-92c0-4c48-99dc-36e12857a862 None None] MFA Rules not processed for user `5c29eab582a64a8991b171766d321e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:25:57.020354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a9a3d585-92c0-4c48-99dc-36e12857a862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:25:57.027333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1241/2522] 10.222.0.65 () {58 vars in 1009 bytes} [Tue Aug 9 19:25:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:25:57.039627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51535cd-7d47-429e-ab89-e165fd0efc39 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:25:57.051415 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51535cd-7d47-429e-ab89-e165fd0efc39 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:25:57.056365 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570aada8-3168-4bec-b991-9b78beffd4c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac48cd591b44f2999d2f172262019da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:25:57.056956 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570aada8-3168-4bec-b991-9b78beffd4c5 service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:25:57.057238 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570aada8-3168-4bec-b991-9b78beffd4c5 service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:25:57.057662 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570aada8-3168-4bec-b991-9b78beffd4c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:25:57.066350 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570aada8-3168-4bec-b991-9b78beffd4c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:25:57.068022 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570aada8-3168-4bec-b991-9b78beffd4c5 service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:25:57.075916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1282/2523] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Aug 9 19:25:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 19:26:07.014090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=85 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:26:07.072782 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=41 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:26:22.153693 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61273f-263a-4bb1-8b7c-2e0e3baf50e6 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:26:22.154184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61273f-263a-4bb1-8b7c-2e0e3baf50e6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:26:22.154280 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61273f-263a-4bb1-8b7c-2e0e3baf50e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:26:22.173509 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3a61273f-263a-4bb1-8b7c-2e0e3baf50e6 None None] MFA Rules not processed for user `5c29eab582a64a8991b171766d321e39`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:26:22.174714 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3a61273f-263a-4bb1-8b7c-2e0e3baf50e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:26:22.181870 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1242/2524] 10.222.0.65 () {58 vars in 967 bytes} [Tue Aug 9 19:26:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:26:22.194372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570aada8-3168-4bec-b991-9b78beffd4c5 service swift] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:26:22.205309 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570aada8-3168-4bec-b991-9b78beffd4c5 service swift] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:26:22.210249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c4a3e-e4e9-4159-89b1-5669d4216521 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aac48cd591b44f2999d2f172262019da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:26:22.210834 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c4a3e-e4e9-4159-89b1-5669d4216521 service swift] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:26:22.211113 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c4a3e-e4e9-4159-89b1-5669d4216521 service swift] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:26:22.211379 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c4a3e-e4e9-4159-89b1-5669d4216521 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:26:22.219163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c4a3e-e4e9-4159-89b1-5669d4216521 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:26:22.220720 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c4a3e-e4e9-4159-89b1-5669d4216521 service swift] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:26:22.228474 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1283/2525] 10.222.0.65 () {60 vars in 1384 bytes} [Tue Aug 9 19:26:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 19:26:32.168159 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:26:32.225343 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=6 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:26:35.446301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ebda7-d846-4b80-b714-739cbc3e7ebc None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:26:35.446812 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ebda7-d846-4b80-b714-739cbc3e7ebc None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:26:35.446924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ebda7-d846-4b80-b714-739cbc3e7ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:26:35.465555 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-392ebda7-d846-4b80-b714-739cbc3e7ebc None None] MFA Rules not processed for user `d125613b28fa4191b96d927aedf51b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:26:35.466770 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-392ebda7-d846-4b80-b714-739cbc3e7ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:26:35.521953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1243/2526] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:26:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:26:37.338317 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c4a3e-e4e9-4159-89b1-5669d4216521 service swift] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:26:37.339811 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-556c4a3e-e4e9-4159-89b1-5669d4216521 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:26:37.432903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c4a3e-e4e9-4159-89b1-5669d4216521 service swift] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:26:37.437878 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c79d2-b09c-46a7-a0f4-83ccec3585d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6172f0733384291992624ef6a527ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:26:37.438476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c79d2-b09c-46a7-a0f4-83ccec3585d8 service placement] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:26:37.438754 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c79d2-b09c-46a7-a0f4-83ccec3585d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:26:37.439076 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c79d2-b09c-46a7-a0f4-83ccec3585d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:26:37.440758 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8e0c79d2-b09c-46a7-a0f4-83ccec3585d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:26:37.451889 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c79d2-b09c-46a7-a0f4-83ccec3585d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:26:37.453484 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c79d2-b09c-46a7-a0f4-83ccec3585d8 service placement] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:26:37.463517 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1284/2527] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:26:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:26:45.514989 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=25 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:26:47.459449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=41 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:23.398646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ebda7-d846-4b80-b714-739cbc3e7ebc None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:23.400087 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-392ebda7-d846-4b80-b714-739cbc3e7ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:23.434272 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ebda7-d846-4b80-b714-739cbc3e7ebc None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:23.437817 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fc5b1-4451-47f3-affd-d34a9a6f241b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:23.438420 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fc5b1-4451-47f3-affd-d34a9a6f241b service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:23.438701 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fc5b1-4451-47f3-affd-d34a9a6f241b service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:23.438973 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fc5b1-4451-47f3-affd-d34a9a6f241b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:23.440706 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5b9fc5b1-4451-47f3-affd-d34a9a6f241b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:23.524986 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fc5b1-4451-47f3-affd-d34a9a6f241b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:23.526458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fc5b1-4451-47f3-affd-d34a9a6f241b service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:23.545718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1244/2528] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:27:27.105837 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c79d2-b09c-46a7-a0f4-83ccec3585d8 service placement] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:27.106399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8e0c79d2-b09c-46a7-a0f4-83ccec3585d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:27.120920 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c79d2-b09c-46a7-a0f4-83ccec3585d8 service placement] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:27.125510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1dc8de-0560-4fc7-9091-532e6d558661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:27.128574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1dc8de-0560-4fc7-9091-532e6d558661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:27.128574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1dc8de-0560-4fc7-9091-532e6d558661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:27.128574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1dc8de-0560-4fc7-9091-532e6d558661 admin admin] PATH_INFO: `/v3/users/740e3901a15d49ee9891858ebf7086e9` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:27.128574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1dc8de-0560-4fc7-9091-532e6d558661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=740e3901a15d49ee9891858ebf7086e9)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:27.129745 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1dc8de-0560-4fc7-9091-532e6d558661 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:27.285194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cf1dc8de-0560-4fc7-9091-532e6d558661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740e3901a15d49ee9891858ebf7086e9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:27.339005 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cf1dc8de-0560-4fc7-9091-532e6d558661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740e3901a15d49ee9891858ebf7086e9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:27.339626 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cf1dc8de-0560-4fc7-9091-532e6d558661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740e3901a15d49ee9891858ebf7086e9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:27.340225 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cf1dc8de-0560-4fc7-9091-532e6d558661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740e3901a15d49ee9891858ebf7086e9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:27.347372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-cf1dc8de-0560-4fc7-9091-532e6d558661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740e3901a15d49ee9891858ebf7086e9'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:27.365368 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1285/2529] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:27:27 2022] DELETE /identity/v3/users/740e3901a15d49ee9891858ebf7086e9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:27.609533 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fc5b1-4451-47f3-affd-d34a9a6f241b service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:27.621803 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fc5b1-4451-47f3-affd-d34a9a6f241b service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:27.681141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bbe21-d1a3-40f5-973d-030b0bcaee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:27.681802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bbe21-d1a3-40f5-973d-030b0bcaee2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:27.682085 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bbe21-d1a3-40f5-973d-030b0bcaee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:27.682356 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bbe21-d1a3-40f5-973d-030b0bcaee2c admin admin] PATH_INFO: `/v3/projects/d57bb28290a542de9fdfd87824118442` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:27.683475 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bbe21-d1a3-40f5-973d-030b0bcaee2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d57bb28290a542de9fdfd87824118442)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:27.685385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bbe21-d1a3-40f5-973d-030b0bcaee2c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:27.795329 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:27.796451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ff0bbe21-d1a3-40f5-973d-030b0bcaee2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd57bb28290a542de9fdfd87824118442', 'request_id': 'req-ff0bbe21-d1a3-40f5-973d-030b0bcaee2c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:27.801760 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ff0bbe21-d1a3-40f5-973d-030b0bcaee2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd57bb28290a542de9fdfd87824118442', 'request_id': 'req-ff0bbe21-d1a3-40f5-973d-030b0bcaee2c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:27.868950 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ff0bbe21-d1a3-40f5-973d-030b0bcaee2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd57bb28290a542de9fdfd87824118442', 'request_id': 'req-ff0bbe21-d1a3-40f5-973d-030b0bcaee2c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:27.880262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ff0bbe21-d1a3-40f5-973d-030b0bcaee2c admin admin] The token cache is being invalidate because project d57bb28290a542de9fdfd87824118442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:27:27.880548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ff0bbe21-d1a3-40f5-973d-030b0bcaee2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:27.881168 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ff0bbe21-d1a3-40f5-973d-030b0bcaee2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:27.883364 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1245/2530] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:27:27 2022] DELETE /identity/v3/projects/d57bb28290a542de9fdfd87824118442 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:27.888393 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8220101-72c5-4791-9272-c993d1fd6576 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:27.888679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8220101-72c5-4791-9272-c993d1fd6576 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:27.888954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8220101-72c5-4791-9272-c993d1fd6576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:27.936101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c8220101-72c5-4791-9272-c993d1fd6576 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:27.937352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c8220101-72c5-4791-9272-c993d1fd6576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:27.994297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1286/2531] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:28.002277 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572acb22-4695-450c-bd51-557acfbe76a6 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:28.002564 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572acb22-4695-450c-bd51-557acfbe76a6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:28.002838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572acb22-4695-450c-bd51-557acfbe76a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:28.022998 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-572acb22-4695-450c-bd51-557acfbe76a6 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:28.024195 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-572acb22-4695-450c-bd51-557acfbe76a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:28.031938 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1246/2532] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:27:28.036982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8220101-72c5-4791-9272-c993d1fd6576 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:28.053428 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8220101-72c5-4791-9272-c993d1fd6576 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:28.058182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59141ff9-11b8-4a4a-989b-11c17fcc8ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:28.061288 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59141ff9-11b8-4a4a-989b-11c17fcc8ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:28.061288 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59141ff9-11b8-4a4a-989b-11c17fcc8ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:28.061288 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59141ff9-11b8-4a4a-989b-11c17fcc8ff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:28.061288 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59141ff9-11b8-4a4a-989b-11c17fcc8ff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:27:28.061288 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59141ff9-11b8-4a4a-989b-11c17fcc8ff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:28.061908 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59141ff9-11b8-4a4a-989b-11c17fcc8ff7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:28.073838 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1287/2533] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:27:28.078233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572acb22-4695-450c-bd51-557acfbe76a6 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:28.088210 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572acb22-4695-450c-bd51-557acfbe76a6 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:28.092892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f34a6d-98c5-45ab-b749-186a30317ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:28.093536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f34a6d-98c5-45ab-b749-186a30317ece admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:28.093820 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f34a6d-98c5-45ab-b749-186a30317ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:28.094089 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f34a6d-98c5-45ab-b749-186a30317ece admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:28.094712 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f34a6d-98c5-45ab-b749-186a30317ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:28.096652 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f34a6d-98c5-45ab-b749-186a30317ece admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:28.192302 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1247/2534] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:27:28 2022] POST /identity/v3/projects => generated 403 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:27:28.197282 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59141ff9-11b8-4a4a-989b-11c17fcc8ff7 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:28.207373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59141ff9-11b8-4a4a-989b-11c17fcc8ff7 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:28.239922 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:28.263806 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a82ee-0b05-460c-860b-44e603cba4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:28.264425 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a82ee-0b05-460c-860b-44e603cba4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:28.264703 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a82ee-0b05-460c-860b-44e603cba4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:28.264974 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a82ee-0b05-460c-860b-44e603cba4a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:28.265631 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a82ee-0b05-460c-860b-44e603cba4a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:28.267539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a82ee-0b05-460c-860b-44e603cba4a9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:28.348869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1288/2535] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:27:28 2022] POST /identity/v3/users => generated 302 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:27:28.353444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f34a6d-98c5-45ab-b749-186a30317ece admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:28.364805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f34a6d-98c5-45ab-b749-186a30317ece admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:28.370039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953266c9-b19b-4ad6-879d-7809fb8f40d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:28.370721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953266c9-b19b-4ad6-879d-7809fb8f40d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:28.371000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953266c9-b19b-4ad6-879d-7809fb8f40d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:28.371258 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953266c9-b19b-4ad6-879d-7809fb8f40d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:28.371898 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953266c9-b19b-4ad6-879d-7809fb8f40d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:28.373545 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953266c9-b19b-4ad6-879d-7809fb8f40d6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:28.384148 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1248/2536] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:27:28.388347 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a82ee-0b05-460c-860b-44e603cba4a9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:28.398318 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a82ee-0b05-460c-860b-44e603cba4a9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:28.402978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1a685-fe76-488e-8a7d-6983c487ebae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:28.404131 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1a685-fe76-488e-8a7d-6983c487ebae admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:28.404131 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1a685-fe76-488e-8a7d-6983c487ebae admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:28.404131 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1a685-fe76-488e-8a7d-6983c487ebae admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:28.404864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1a685-fe76-488e-8a7d-6983c487ebae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:28.406485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1a685-fe76-488e-8a7d-6983c487ebae admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:28.417215 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1289/2537] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:27:28.421209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953266c9-b19b-4ad6-879d-7809fb8f40d6 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:28.431890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953266c9-b19b-4ad6-879d-7809fb8f40d6 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:28.436523 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb38244-858e-4441-a16d-380e08a36a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:28.437166 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb38244-858e-4441-a16d-380e08a36a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:28.437446 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb38244-858e-4441-a16d-380e08a36a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:28.437746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb38244-858e-4441-a16d-380e08a36a82 admin admin] PATH_INFO: `/v3/projects/0626eba349c34107859c8a695a381f30/users/65d8d2be942d4394bcb38d62739df0c9/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:28.452693 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb38244-858e-4441-a16d-380e08a36a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0626eba349c34107859c8a695a381f30, user_id=65d8d2be942d4394bcb38d62739df0c9, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:28.455387 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb38244-858e-4441-a16d-380e08a36a82 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:28.532190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1249/2538] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:27:28 2022] PUT /identity/v3/projects/0626eba349c34107859c8a695a381f30/users/65d8d2be942d4394bcb38d62739df0c9/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:28.537702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f8d16-7edb-4e7a-8e13-1f2b0eed3d47 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:28.538519 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f8d16-7edb-4e7a-8e13-1f2b0eed3d47 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:28.538794 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f8d16-7edb-4e7a-8e13-1f2b0eed3d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:28.558152 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ac0f8d16-7edb-4e7a-8e13-1f2b0eed3d47 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:28.559358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ac0f8d16-7edb-4e7a-8e13-1f2b0eed3d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:28.616051 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1290/2539] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:28.626328 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb38244-858e-4441-a16d-380e08a36a82 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:28.628193 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-cfb38244-858e-4441-a16d-380e08a36a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:28.685687 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb38244-858e-4441-a16d-380e08a36a82 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:28.689365 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d18b7-106d-499a-96ed-cba39218aa29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:28.690000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d18b7-106d-499a-96ed-cba39218aa29 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:28.690284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d18b7-106d-499a-96ed-cba39218aa29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:28.690559 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d18b7-106d-499a-96ed-cba39218aa29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:28.699896 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d18b7-106d-499a-96ed-cba39218aa29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:28.701325 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d18b7-106d-499a-96ed-cba39218aa29 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:28.711057 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1250/2540] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:27:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:27:29.978042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887afd53-6c02-45b7-a22e-0efdeb2a8f96 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:29.978042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887afd53-6c02-45b7-a22e-0efdeb2a8f96 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:29.978042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887afd53-6c02-45b7-a22e-0efdeb2a8f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:30.003509 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-887afd53-6c02-45b7-a22e-0efdeb2a8f96 None None] MFA Rules not processed for user `65d8d2be942d4394bcb38d62739df0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:30.004824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-887afd53-6c02-45b7-a22e-0efdeb2a8f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:30.072320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1291/2541] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:29 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:30.076761 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d18b7-106d-499a-96ed-cba39218aa29 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:30.086623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d18b7-106d-499a-96ed-cba39218aa29 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:30.091254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79b1f9-400b-4f2b-83a1-058de26b55e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:30.091850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79b1f9-400b-4f2b-83a1-058de26b55e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:30.092137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79b1f9-400b-4f2b-83a1-058de26b55e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:30.092474 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79b1f9-400b-4f2b-83a1-058de26b55e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:30.093130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79b1f9-400b-4f2b-83a1-058de26b55e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:30.095067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79b1f9-400b-4f2b-83a1-058de26b55e2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:30.198402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1251/2542] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:27:30 2022] POST /identity/v3/projects => generated 405 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:27:30.202257 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887afd53-6c02-45b7-a22e-0efdeb2a8f96 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:30.213787 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887afd53-6c02-45b7-a22e-0efdeb2a8f96 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:30.256372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:30.269128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991337ad-d422-4e28-b375-cf2fe3a48fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:30.269777 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991337ad-d422-4e28-b375-cf2fe3a48fff admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:30.270057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991337ad-d422-4e28-b375-cf2fe3a48fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:30.270333 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991337ad-d422-4e28-b375-cf2fe3a48fff admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:30.270958 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991337ad-d422-4e28-b375-cf2fe3a48fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:30.273496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991337ad-d422-4e28-b375-cf2fe3a48fff admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:30.373431 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1292/2543] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:27:30 2022] POST /identity/v3/users => generated 309 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:27:30.377409 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79b1f9-400b-4f2b-83a1-058de26b55e2 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:30.388372 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79b1f9-400b-4f2b-83a1-058de26b55e2 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:30.392954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8d869-c633-401c-ade7-b74e8a481885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:30.393584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8d869-c633-401c-ade7-b74e8a481885 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:30.393868 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8d869-c633-401c-ade7-b74e8a481885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:30.394143 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8d869-c633-401c-ade7-b74e8a481885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:30.394788 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8d869-c633-401c-ade7-b74e8a481885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:30.396394 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8d869-c633-401c-ade7-b74e8a481885 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:30.407456 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1252/2544] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:27:30.411687 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991337ad-d422-4e28-b375-cf2fe3a48fff admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:30.421899 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991337ad-d422-4e28-b375-cf2fe3a48fff admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:30.426566 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad291e-0479-4eba-aa12-a92a20d171a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:30.427209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad291e-0479-4eba-aa12-a92a20d171a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:30.427490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad291e-0479-4eba-aa12-a92a20d171a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:30.427767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad291e-0479-4eba-aa12-a92a20d171a5 admin admin] PATH_INFO: `/v3/projects/9d5143b0a0f946a4bda03a42b4f7314a/users/6f6f1394fea94ebebe7c33998939193d/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:30.442818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad291e-0479-4eba-aa12-a92a20d171a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5143b0a0f946a4bda03a42b4f7314a, user_id=6f6f1394fea94ebebe7c33998939193d, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:30.446174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad291e-0479-4eba-aa12-a92a20d171a5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:30.498651 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1293/2545] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:27:30 2022] PUT /identity/v3/projects/9d5143b0a0f946a4bda03a42b4f7314a/users/6f6f1394fea94ebebe7c33998939193d/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:27:30.502653 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8d869-c633-401c-ade7-b74e8a481885 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:30.513688 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8d869-c633-401c-ade7-b74e8a481885 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:30.552627 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:30.570011 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742423c0-05c3-4657-80f8-be29620f65a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:30.570593 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742423c0-05c3-4657-80f8-be29620f65a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:30.570873 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742423c0-05c3-4657-80f8-be29620f65a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:30.571144 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742423c0-05c3-4657-80f8-be29620f65a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:30.571781 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742423c0-05c3-4657-80f8-be29620f65a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:30.573403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742423c0-05c3-4657-80f8-be29620f65a5 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:30.583553 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1253/2546] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:27:30.587832 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad291e-0479-4eba-aa12-a92a20d171a5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:30.598320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad291e-0479-4eba-aa12-a92a20d171a5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:30.603092 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f02bf-5c27-41fc-8f3d-1d6a7e61e169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:30.603740 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f02bf-5c27-41fc-8f3d-1d6a7e61e169 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:30.604021 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f02bf-5c27-41fc-8f3d-1d6a7e61e169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:30.604295 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f02bf-5c27-41fc-8f3d-1d6a7e61e169 admin admin] PATH_INFO: `/v3/projects/9d5143b0a0f946a4bda03a42b4f7314a/users/6f6f1394fea94ebebe7c33998939193d/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:30.606317 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f02bf-5c27-41fc-8f3d-1d6a7e61e169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5143b0a0f946a4bda03a42b4f7314a, user_id=6f6f1394fea94ebebe7c33998939193d, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:30.609077 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f02bf-5c27-41fc-8f3d-1d6a7e61e169 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:30.619742 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1294/2547] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:27:30 2022] PUT /identity/v3/projects/9d5143b0a0f946a4bda03a42b4f7314a/users/6f6f1394fea94ebebe7c33998939193d/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:31.899227 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b48f4c-c6ca-49fe-a5be-4002c2eab3e2 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:31.899752 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b48f4c-c6ca-49fe-a5be-4002c2eab3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:31.899752 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b48f4c-c6ca-49fe-a5be-4002c2eab3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:31.930970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-61b48f4c-c6ca-49fe-a5be-4002c2eab3e2 None None] MFA Rules not processed for user `6f6f1394fea94ebebe7c33998939193d`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:31.932390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-61b48f4c-c6ca-49fe-a5be-4002c2eab3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:32.002771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1254/2548] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:31 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:32.523131 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f02bf-5c27-41fc-8f3d-1d6a7e61e169 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:32.525054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-709f02bf-5c27-41fc-8f3d-1d6a7e61e169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:32.598566 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f02bf-5c27-41fc-8f3d-1d6a7e61e169 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:32.604859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae15295-e015-446e-8bfe-2e2e10bc076a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6172f0733384291992624ef6a527ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:32.605507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae15295-e015-446e-8bfe-2e2e10bc076a service placement] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:32.605800 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae15295-e015-446e-8bfe-2e2e10bc076a service placement] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:32.606152 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae15295-e015-446e-8bfe-2e2e10bc076a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:32.607857 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-dae15295-e015-446e-8bfe-2e2e10bc076a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:32.620139 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae15295-e015-446e-8bfe-2e2e10bc076a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:32.621776 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae15295-e015-446e-8bfe-2e2e10bc076a service placement] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:32.632948 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1295/2549] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:27:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:27:33.318606 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b48f4c-c6ca-49fe-a5be-4002c2eab3e2 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:33.387866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b48f4c-c6ca-49fe-a5be-4002c2eab3e2 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:33.392705 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8ce9f-abe4-42d9-b999-057f961c77ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:33.393344 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8ce9f-abe4-42d9-b999-057f961c77ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:33.393658 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8ce9f-abe4-42d9-b999-057f961c77ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:33.393935 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8ce9f-abe4-42d9-b999-057f961c77ea admin admin] PATH_INFO: `/v3/users/65d8d2be942d4394bcb38d62739df0c9` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:33.395091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8ce9f-abe4-42d9-b999-057f961c77ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=65d8d2be942d4394bcb38d62739df0c9)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:33.397083 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8ce9f-abe4-42d9-b999-057f961c77ea admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:33.587137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-69e8ce9f-abe4-42d9-b999-057f961c77ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65d8d2be942d4394bcb38d62739df0c9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:33.594015 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-69e8ce9f-abe4-42d9-b999-057f961c77ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65d8d2be942d4394bcb38d62739df0c9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:33.594647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-69e8ce9f-abe4-42d9-b999-057f961c77ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65d8d2be942d4394bcb38d62739df0c9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:33.595267 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-69e8ce9f-abe4-42d9-b999-057f961c77ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65d8d2be942d4394bcb38d62739df0c9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:33.664927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-69e8ce9f-abe4-42d9-b999-057f961c77ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65d8d2be942d4394bcb38d62739df0c9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:33.667425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:33.684139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1255/2550] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:27:33 2022] DELETE /identity/v3/users/65d8d2be942d4394bcb38d62739df0c9 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:33.964326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae15295-e015-446e-8bfe-2e2e10bc076a service placement] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:33.979290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae15295-e015-446e-8bfe-2e2e10bc076a service placement] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:34.081112 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e01145-89dc-4ca7-a5f7-c0400dd2c7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:34.081798 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e01145-89dc-4ca7-a5f7-c0400dd2c7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:34.082074 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e01145-89dc-4ca7-a5f7-c0400dd2c7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:34.082346 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e01145-89dc-4ca7-a5f7-c0400dd2c7bc admin admin] PATH_INFO: `/v3/projects/0626eba349c34107859c8a695a381f30` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:34.083480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e01145-89dc-4ca7-a5f7-c0400dd2c7bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0626eba349c34107859c8a695a381f30)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:34.085590 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e01145-89dc-4ca7-a5f7-c0400dd2c7bc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:34.327331 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:34.340152 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-19e01145-89dc-4ca7-a5f7-c0400dd2c7bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0626eba349c34107859c8a695a381f30', 'request_id': 'req-19e01145-89dc-4ca7-a5f7-c0400dd2c7bc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:34.345549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-19e01145-89dc-4ca7-a5f7-c0400dd2c7bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0626eba349c34107859c8a695a381f30', 'request_id': 'req-19e01145-89dc-4ca7-a5f7-c0400dd2c7bc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:34.408710 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-19e01145-89dc-4ca7-a5f7-c0400dd2c7bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0626eba349c34107859c8a695a381f30', 'request_id': 'req-19e01145-89dc-4ca7-a5f7-c0400dd2c7bc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:34.422249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-19e01145-89dc-4ca7-a5f7-c0400dd2c7bc admin admin] The token cache is being invalidate because project 0626eba349c34107859c8a695a381f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:27:34.422544 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-19e01145-89dc-4ca7-a5f7-c0400dd2c7bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:34.423290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-19e01145-89dc-4ca7-a5f7-c0400dd2c7bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:34.424809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1296/2551] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:27:33 2022] DELETE /identity/v3/projects/0626eba349c34107859c8a695a381f30 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:34.429027 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8ce9f-abe4-42d9-b999-057f961c77ea admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:34.430486 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-69e8ce9f-abe4-42d9-b999-057f961c77ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:34.443546 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8ce9f-abe4-42d9-b999-057f961c77ea admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:34.501680 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b780849-ebe1-4c4d-b630-c721194a7475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:34.502321 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b780849-ebe1-4c4d-b630-c721194a7475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:34.502602 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b780849-ebe1-4c4d-b630-c721194a7475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:34.502868 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b780849-ebe1-4c4d-b630-c721194a7475 admin admin] PATH_INFO: `/v3/users/6f6f1394fea94ebebe7c33998939193d` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:34.504042 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b780849-ebe1-4c4d-b630-c721194a7475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f6f1394fea94ebebe7c33998939193d)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:34.506020 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b780849-ebe1-4c4d-b630-c721194a7475 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:34.706680 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0b780849-ebe1-4c4d-b630-c721194a7475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f6f1394fea94ebebe7c33998939193d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:34.714071 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0b780849-ebe1-4c4d-b630-c721194a7475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f6f1394fea94ebebe7c33998939193d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:34.714794 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0b780849-ebe1-4c4d-b630-c721194a7475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f6f1394fea94ebebe7c33998939193d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:34.715401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0b780849-ebe1-4c4d-b630-c721194a7475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f6f1394fea94ebebe7c33998939193d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:34.807783 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-0b780849-ebe1-4c4d-b630-c721194a7475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f6f1394fea94ebebe7c33998939193d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:34.827026 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1256/2552] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:27:34 2022] DELETE /identity/v3/users/6f6f1394fea94ebebe7c33998939193d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:27:35.101616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e01145-89dc-4ca7-a5f7-c0400dd2c7bc admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:35.103449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-19e01145-89dc-4ca7-a5f7-c0400dd2c7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:35.120071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e01145-89dc-4ca7-a5f7-c0400dd2c7bc admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:35.188734 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51310d1-8ecf-46e5-b836-5e07e57ad742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:35.189433 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51310d1-8ecf-46e5-b836-5e07e57ad742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:35.189769 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51310d1-8ecf-46e5-b836-5e07e57ad742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:35.190036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51310d1-8ecf-46e5-b836-5e07e57ad742 admin admin] PATH_INFO: `/v3/projects/9d5143b0a0f946a4bda03a42b4f7314a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:35.191138 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51310d1-8ecf-46e5-b836-5e07e57ad742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d5143b0a0f946a4bda03a42b4f7314a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:35.193033 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51310d1-8ecf-46e5-b836-5e07e57ad742 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:35.304541 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a51310d1-8ecf-46e5-b836-5e07e57ad742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5143b0a0f946a4bda03a42b4f7314a', 'request_id': 'req-a51310d1-8ecf-46e5-b836-5e07e57ad742'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:35.309967 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a51310d1-8ecf-46e5-b836-5e07e57ad742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5143b0a0f946a4bda03a42b4f7314a', 'request_id': 'req-a51310d1-8ecf-46e5-b836-5e07e57ad742'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:35.367212 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a51310d1-8ecf-46e5-b836-5e07e57ad742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5143b0a0f946a4bda03a42b4f7314a', 'request_id': 'req-a51310d1-8ecf-46e5-b836-5e07e57ad742'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:35.378532 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a51310d1-8ecf-46e5-b836-5e07e57ad742 admin admin] The token cache is being invalidate because project 9d5143b0a0f946a4bda03a42b4f7314a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:27:35.378814 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a51310d1-8ecf-46e5-b836-5e07e57ad742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:35.379633 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a51310d1-8ecf-46e5-b836-5e07e57ad742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:35.381086 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1297/2553] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:27:35 2022] DELETE /identity/v3/projects/9d5143b0a0f946a4bda03a42b4f7314a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:35.386804 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f10ff-48f2-4d9e-bcd3-a9d918ecec8c None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:35.387101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f10ff-48f2-4d9e-bcd3-a9d918ecec8c None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:35.387406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f10ff-48f2-4d9e-bcd3-a9d918ecec8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:35.407554 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-062f10ff-48f2-4d9e-bcd3-a9d918ecec8c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:35.408789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-062f10ff-48f2-4d9e-bcd3-a9d918ecec8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:35.466776 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1257/2554] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:35.475838 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52117ea-0e2c-4158-a031-e0b01279efb2 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:35.476193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52117ea-0e2c-4158-a031-e0b01279efb2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:35.476467 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52117ea-0e2c-4158-a031-e0b01279efb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:35.495647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-b52117ea-0e2c-4158-a031-e0b01279efb2 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:35.496834 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-b52117ea-0e2c-4158-a031-e0b01279efb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:35.504996 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1298/2555] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:35.509929 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f10ff-48f2-4d9e-bcd3-a9d918ecec8c None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:35.514787 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:35.520059 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f10ff-48f2-4d9e-bcd3-a9d918ecec8c None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:35.525323 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18e46b-66f9-46ad-b450-05a243782093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:35.525962 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18e46b-66f9-46ad-b450-05a243782093 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:35.526293 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18e46b-66f9-46ad-b450-05a243782093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:35.526517 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18e46b-66f9-46ad-b450-05a243782093 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:35.527160 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18e46b-66f9-46ad-b450-05a243782093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:27:35.527464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18e46b-66f9-46ad-b450-05a243782093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:35.529057 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18e46b-66f9-46ad-b450-05a243782093 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:35.541594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1258/2556] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:27:35.545864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52117ea-0e2c-4158-a031-e0b01279efb2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:35.555172 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52117ea-0e2c-4158-a031-e0b01279efb2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:35.559811 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42166fa4-0713-4461-91b5-1c01f3f11f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:35.560451 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42166fa4-0713-4461-91b5-1c01f3f11f0c admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:35.560727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42166fa4-0713-4461-91b5-1c01f3f11f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:35.560995 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42166fa4-0713-4461-91b5-1c01f3f11f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:35.561644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42166fa4-0713-4461-91b5-1c01f3f11f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:35.563566 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42166fa4-0713-4461-91b5-1c01f3f11f0c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:35.676006 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1299/2557] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:27:35 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:27:35.680910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18e46b-66f9-46ad-b450-05a243782093 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:35.691037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18e46b-66f9-46ad-b450-05a243782093 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:35.746589 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16ae6b-ce97-4920-9787-a9f1eec7c3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:35.747184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16ae6b-ce97-4920-9787-a9f1eec7c3bc admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:35.747464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16ae6b-ce97-4920-9787-a9f1eec7c3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:35.747743 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16ae6b-ce97-4920-9787-a9f1eec7c3bc admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:35.748354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16ae6b-ce97-4920-9787-a9f1eec7c3bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:35.750293 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16ae6b-ce97-4920-9787-a9f1eec7c3bc admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:35.848188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1259/2558] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:27:35 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:27:35.852388 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42166fa4-0713-4461-91b5-1c01f3f11f0c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:35.862632 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42166fa4-0713-4461-91b5-1c01f3f11f0c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:35.867982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e783df9-568a-4293-9e6f-672e79f3bda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:35.868569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e783df9-568a-4293-9e6f-672e79f3bda0 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:35.873916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e783df9-568a-4293-9e6f-672e79f3bda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:35.873916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e783df9-568a-4293-9e6f-672e79f3bda0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:35.873916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e783df9-568a-4293-9e6f-672e79f3bda0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:35.873916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e783df9-568a-4293-9e6f-672e79f3bda0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:35.881034 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1300/2559] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:27:35.885585 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16ae6b-ce97-4920-9787-a9f1eec7c3bc admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:35.895771 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16ae6b-ce97-4920-9787-a9f1eec7c3bc admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:35.902824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586a667-4183-42db-8e1c-dc4b82738faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:35.902824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586a667-4183-42db-8e1c-dc4b82738faf admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:35.902824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586a667-4183-42db-8e1c-dc4b82738faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:35.902824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586a667-4183-42db-8e1c-dc4b82738faf admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:35.903224 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586a667-4183-42db-8e1c-dc4b82738faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:35.903911 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586a667-4183-42db-8e1c-dc4b82738faf admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:35.915012 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1260/2560] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:27:35.919129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e783df9-568a-4293-9e6f-672e79f3bda0 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:35.929672 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e783df9-568a-4293-9e6f-672e79f3bda0 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:35.934311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6825083-54fb-4746-956a-ad2f98378271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:35.934939 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6825083-54fb-4746-956a-ad2f98378271 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:35.935215 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6825083-54fb-4746-956a-ad2f98378271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:35.935484 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6825083-54fb-4746-956a-ad2f98378271 admin admin] PATH_INFO: `/v3/projects/364571568e514a9ebb3d9d968b112649/users/45edf89ab7af4883a60a3365e50b667e/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:35.938767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:35.950930 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6825083-54fb-4746-956a-ad2f98378271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=364571568e514a9ebb3d9d968b112649, user_id=45edf89ab7af4883a60a3365e50b667e, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:35.953632 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6825083-54fb-4746-956a-ad2f98378271 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:36.035782 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1301/2561] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:27:35 2022] PUT /identity/v3/projects/364571568e514a9ebb3d9d968b112649/users/45edf89ab7af4883a60a3365e50b667e/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:36.046943 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd75311-66e1-4dbd-9c32-4661e243b8b3 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:36.047223 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd75311-66e1-4dbd-9c32-4661e243b8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:36.047493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd75311-66e1-4dbd-9c32-4661e243b8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:36.082915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-7dd75311-66e1-4dbd-9c32-4661e243b8b3 None None] MFA Rules not processed for user `45edf89ab7af4883a60a3365e50b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:36.084052 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7dd75311-66e1-4dbd-9c32-4661e243b8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:36.147190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1261/2562] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:36.152358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6825083-54fb-4746-956a-ad2f98378271 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:36.215710 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6825083-54fb-4746-956a-ad2f98378271 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:36.220322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2459be6-4f1a-49e4-bd12-5f5e5975b6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:36.220925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2459be6-4f1a-49e4-bd12-5f5e5975b6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:36.221319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2459be6-4f1a-49e4-bd12-5f5e5975b6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:36.221627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2459be6-4f1a-49e4-bd12-5f5e5975b6c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:36.224257 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2459be6-4f1a-49e4-bd12-5f5e5975b6c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:36.224257 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2459be6-4f1a-49e4-bd12-5f5e5975b6c0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:36.318297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1302/2563] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:27:36 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:27:36.322574 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd75311-66e1-4dbd-9c32-4661e243b8b3 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:36.333271 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd75311-66e1-4dbd-9c32-4661e243b8b3 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:36.388429 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:36.394512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa35518-3c91-428c-a099-c544d1d64da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:36.395150 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa35518-3c91-428c-a099-c544d1d64da6 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:36.395410 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa35518-3c91-428c-a099-c544d1d64da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:36.395687 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa35518-3c91-428c-a099-c544d1d64da6 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:36.396346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa35518-3c91-428c-a099-c544d1d64da6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:36.399403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa35518-3c91-428c-a099-c544d1d64da6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:36.549980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1262/2564] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:27:36 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:27:36.554009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2459be6-4f1a-49e4-bd12-5f5e5975b6c0 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:36.564948 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2459be6-4f1a-49e4-bd12-5f5e5975b6c0 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:36.569998 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db818a-f555-4b5a-98de-3d0121aee652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:36.576713 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db818a-f555-4b5a-98de-3d0121aee652 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:36.577141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db818a-f555-4b5a-98de-3d0121aee652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:36.577287 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db818a-f555-4b5a-98de-3d0121aee652 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:36.578019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db818a-f555-4b5a-98de-3d0121aee652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:36.582463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db818a-f555-4b5a-98de-3d0121aee652 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:36.595880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1303/2565] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:27:36.600099 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa35518-3c91-428c-a099-c544d1d64da6 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:36.610856 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa35518-3c91-428c-a099-c544d1d64da6 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:36.615743 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971a448-afd4-484e-9e95-bf0f1412bd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:36.616542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971a448-afd4-484e-9e95-bf0f1412bd16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:36.617223 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971a448-afd4-484e-9e95-bf0f1412bd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:36.617223 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971a448-afd4-484e-9e95-bf0f1412bd16 admin admin] PATH_INFO: `/v3/projects/46abcd2735f2491e8b2861e163b5547b/users/bf8725fb079b4db09afacf15a20118e8/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:36.632986 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971a448-afd4-484e-9e95-bf0f1412bd16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46abcd2735f2491e8b2861e163b5547b, user_id=bf8725fb079b4db09afacf15a20118e8, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:36.636259 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971a448-afd4-484e-9e95-bf0f1412bd16 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:36.740442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1263/2566] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:27:36 2022] PUT /identity/v3/projects/46abcd2735f2491e8b2861e163b5547b/users/bf8725fb079b4db09afacf15a20118e8/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:36.745411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db818a-f555-4b5a-98de-3d0121aee652 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:36.755452 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db818a-f555-4b5a-98de-3d0121aee652 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:36.814682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49297f4b-fc3e-45e6-be1c-8a4785731423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:36.815288 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49297f4b-fc3e-45e6-be1c-8a4785731423 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:36.815921 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49297f4b-fc3e-45e6-be1c-8a4785731423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:36.815921 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49297f4b-fc3e-45e6-be1c-8a4785731423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:36.816447 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49297f4b-fc3e-45e6-be1c-8a4785731423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:36.818086 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49297f4b-fc3e-45e6-be1c-8a4785731423 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:36.828213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1304/2567] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:27:36.832485 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971a448-afd4-484e-9e95-bf0f1412bd16 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:36.843334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971a448-afd4-484e-9e95-bf0f1412bd16 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:36.848014 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073d080-6ed4-4d49-80ea-b9fb6d520c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:36.850049 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073d080-6ed4-4d49-80ea-b9fb6d520c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:36.850049 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073d080-6ed4-4d49-80ea-b9fb6d520c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:36.850049 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073d080-6ed4-4d49-80ea-b9fb6d520c7e admin admin] PATH_INFO: `/v3/projects/46abcd2735f2491e8b2861e163b5547b/users/bf8725fb079b4db09afacf15a20118e8/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:36.851882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073d080-6ed4-4d49-80ea-b9fb6d520c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=46abcd2735f2491e8b2861e163b5547b, user_id=bf8725fb079b4db09afacf15a20118e8, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:36.854639 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073d080-6ed4-4d49-80ea-b9fb6d520c7e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:36.865005 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1264/2568] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:27:36 2022] PUT /identity/v3/projects/46abcd2735f2491e8b2861e163b5547b/users/bf8725fb079b4db09afacf15a20118e8/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:36.875915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cae1cb-002d-481f-85e0-e8f507cccde2 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:36.876207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cae1cb-002d-481f-85e0-e8f507cccde2 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:36.876486 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cae1cb-002d-481f-85e0-e8f507cccde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:36.906074 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d6cae1cb-002d-481f-85e0-e8f507cccde2 None None] MFA Rules not processed for user `bf8725fb079b4db09afacf15a20118e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:36.907290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d6cae1cb-002d-481f-85e0-e8f507cccde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:36.951816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:36.976153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1305/2569] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:36.987537 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073d080-6ed4-4d49-80ea-b9fb6d520c7e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:36.993590 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9073d080-6ed4-4d49-80ea-b9fb6d520c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:37.076592 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073d080-6ed4-4d49-80ea-b9fb6d520c7e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:37.080570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeca3d0-10fa-4a09-8629-3b63c798dd4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:37.081182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeca3d0-10fa-4a09-8629-3b63c798dd4c service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:37.081536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeca3d0-10fa-4a09-8629-3b63c798dd4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:37.081822 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeca3d0-10fa-4a09-8629-3b63c798dd4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:37.092625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeca3d0-10fa-4a09-8629-3b63c798dd4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:37.094188 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeca3d0-10fa-4a09-8629-3b63c798dd4c service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:37.105728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1265/2570] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:27:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:27:37.137277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cae1cb-002d-481f-85e0-e8f507cccde2 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:37.201382 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cae1cb-002d-481f-85e0-e8f507cccde2 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:37.206305 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47f1e5-3216-4240-94db-33674822b866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:37.206942 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47f1e5-3216-4240-94db-33674822b866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:37.207223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47f1e5-3216-4240-94db-33674822b866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:37.207499 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47f1e5-3216-4240-94db-33674822b866 admin admin] PATH_INFO: `/v3/users/45edf89ab7af4883a60a3365e50b667e` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:37.208650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47f1e5-3216-4240-94db-33674822b866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45edf89ab7af4883a60a3365e50b667e)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:37.210743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47f1e5-3216-4240-94db-33674822b866 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:37.456787 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fa47f1e5-3216-4240-94db-33674822b866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45edf89ab7af4883a60a3365e50b667e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:37.526279 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fa47f1e5-3216-4240-94db-33674822b866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45edf89ab7af4883a60a3365e50b667e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:37.526903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fa47f1e5-3216-4240-94db-33674822b866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45edf89ab7af4883a60a3365e50b667e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:37.527509 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fa47f1e5-3216-4240-94db-33674822b866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45edf89ab7af4883a60a3365e50b667e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:37.535273 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fa47f1e5-3216-4240-94db-33674822b866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45edf89ab7af4883a60a3365e50b667e'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:37.552676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1306/2571] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:27:37 2022] DELETE /identity/v3/users/45edf89ab7af4883a60a3365e50b667e => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:37.557859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5aa3c-cd55-46a9-a8ec-b792fcc49a45 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:37.558314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5aa3c-cd55-46a9-a8ec-b792fcc49a45 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:37.558432 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5aa3c-cd55-46a9-a8ec-b792fcc49a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:37.578350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-46a5aa3c-cd55-46a9-a8ec-b792fcc49a45 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:37.579569 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-46a5aa3c-cd55-46a9-a8ec-b792fcc49a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:37.636641 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1266/2572] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:37.646382 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47f1e5-3216-4240-94db-33674822b866 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:37.647820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-fa47f1e5-3216-4240-94db-33674822b866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:37.710253 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47f1e5-3216-4240-94db-33674822b866 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:37.714845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a23082-408a-4bfa-b34c-412a16698bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:37.715733 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a23082-408a-4bfa-b34c-412a16698bfb service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:37.715962 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a23082-408a-4bfa-b34c-412a16698bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:37.716331 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a23082-408a-4bfa-b34c-412a16698bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:37.729107 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a23082-408a-4bfa-b34c-412a16698bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:37.730753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a23082-408a-4bfa-b34c-412a16698bfb service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:37.758862 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1307/2573] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:27:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:27:38.237697 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5aa3c-cd55-46a9-a8ec-b792fcc49a45 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:38.241684 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-46a5aa3c-cd55-46a9-a8ec-b792fcc49a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:38.252183 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5aa3c-cd55-46a9-a8ec-b792fcc49a45 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:38.257377 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae3eba-d182-4c49-a9bc-afbbbe66f374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:38.258147 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae3eba-d182-4c49-a9bc-afbbbe66f374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:38.258422 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae3eba-d182-4c49-a9bc-afbbbe66f374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:38.258695 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae3eba-d182-4c49-a9bc-afbbbe66f374 admin admin] PATH_INFO: `/v3/projects/364571568e514a9ebb3d9d968b112649` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:38.259903 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae3eba-d182-4c49-a9bc-afbbbe66f374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=364571568e514a9ebb3d9d968b112649)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:38.261801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae3eba-d182-4c49-a9bc-afbbbe66f374 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:38.329982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:38.345269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1eae3eba-d182-4c49-a9bc-afbbbe66f374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '364571568e514a9ebb3d9d968b112649', 'request_id': 'req-1eae3eba-d182-4c49-a9bc-afbbbe66f374'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:38.350726 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1eae3eba-d182-4c49-a9bc-afbbbe66f374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '364571568e514a9ebb3d9d968b112649', 'request_id': 'req-1eae3eba-d182-4c49-a9bc-afbbbe66f374'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:38.407704 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1eae3eba-d182-4c49-a9bc-afbbbe66f374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '364571568e514a9ebb3d9d968b112649', 'request_id': 'req-1eae3eba-d182-4c49-a9bc-afbbbe66f374'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:38.420185 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1eae3eba-d182-4c49-a9bc-afbbbe66f374 admin admin] The token cache is being invalidate because project 364571568e514a9ebb3d9d968b112649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:27:38.420471 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1eae3eba-d182-4c49-a9bc-afbbbe66f374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:38.421353 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1eae3eba-d182-4c49-a9bc-afbbbe66f374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:38.425647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1267/2574] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:27:38 2022] DELETE /identity/v3/projects/364571568e514a9ebb3d9d968b112649 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:38.426704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a23082-408a-4bfa-b34c-412a16698bfb service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:38.432251 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:38.437048 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a23082-408a-4bfa-b34c-412a16698bfb service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:38.496405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5c055-7ae5-4d02-9fb0-63b5e8bcce92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:38.497052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5c055-7ae5-4d02-9fb0-63b5e8bcce92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:38.497299 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5c055-7ae5-4d02-9fb0-63b5e8bcce92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:38.497629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5c055-7ae5-4d02-9fb0-63b5e8bcce92 admin admin] PATH_INFO: `/v3/users/bf8725fb079b4db09afacf15a20118e8` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:38.498773 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5c055-7ae5-4d02-9fb0-63b5e8bcce92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf8725fb079b4db09afacf15a20118e8)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:38.501301 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5c055-7ae5-4d02-9fb0-63b5e8bcce92 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:38.676761 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bbe5c055-7ae5-4d02-9fb0-63b5e8bcce92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf8725fb079b4db09afacf15a20118e8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:38.749440 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bbe5c055-7ae5-4d02-9fb0-63b5e8bcce92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf8725fb079b4db09afacf15a20118e8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:38.753004 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bbe5c055-7ae5-4d02-9fb0-63b5e8bcce92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf8725fb079b4db09afacf15a20118e8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:38.753004 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bbe5c055-7ae5-4d02-9fb0-63b5e8bcce92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf8725fb079b4db09afacf15a20118e8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:38.760823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bbe5c055-7ae5-4d02-9fb0-63b5e8bcce92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf8725fb079b4db09afacf15a20118e8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:38.782151 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1308/2575] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:27:38 2022] DELETE /identity/v3/users/bf8725fb079b4db09afacf15a20118e8 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:39.217762 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae3eba-d182-4c49-a9bc-afbbbe66f374 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:39.217762 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1eae3eba-d182-4c49-a9bc-afbbbe66f374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:39.231403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae3eba-d182-4c49-a9bc-afbbbe66f374 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:39.289914 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25dc95-9233-4b2b-bfc2-578f55147393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:39.290580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25dc95-9233-4b2b-bfc2-578f55147393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:39.290861 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25dc95-9233-4b2b-bfc2-578f55147393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:39.291132 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25dc95-9233-4b2b-bfc2-578f55147393 admin admin] PATH_INFO: `/v3/projects/46abcd2735f2491e8b2861e163b5547b` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:39.292253 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25dc95-9233-4b2b-bfc2-578f55147393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46abcd2735f2491e8b2861e163b5547b)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:39.294247 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25dc95-9233-4b2b-bfc2-578f55147393 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:39.406800 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6b25dc95-9233-4b2b-bfc2-578f55147393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46abcd2735f2491e8b2861e163b5547b', 'request_id': 'req-6b25dc95-9233-4b2b-bfc2-578f55147393'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:39.412266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6b25dc95-9233-4b2b-bfc2-578f55147393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46abcd2735f2491e8b2861e163b5547b', 'request_id': 'req-6b25dc95-9233-4b2b-bfc2-578f55147393'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:39.532066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6b25dc95-9233-4b2b-bfc2-578f55147393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46abcd2735f2491e8b2861e163b5547b', 'request_id': 'req-6b25dc95-9233-4b2b-bfc2-578f55147393'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:39.544588 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6b25dc95-9233-4b2b-bfc2-578f55147393 admin admin] The token cache is being invalidate because project 46abcd2735f2491e8b2861e163b5547b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:27:39.544881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6b25dc95-9233-4b2b-bfc2-578f55147393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:39.545547 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-6b25dc95-9233-4b2b-bfc2-578f55147393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:39.547034 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1268/2576] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:27:39 2022] DELETE /identity/v3/projects/46abcd2735f2491e8b2861e163b5547b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:39.551873 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172e5fb-657f-435a-bf1c-933136fb9412 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:39.552368 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172e5fb-657f-435a-bf1c-933136fb9412 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:39.552483 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172e5fb-657f-435a-bf1c-933136fb9412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:39.571212 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2172e5fb-657f-435a-bf1c-933136fb9412 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:39.572407 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2172e5fb-657f-435a-bf1c-933136fb9412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:39.630285 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1309/2577] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:39.639421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292adf0c-9d79-47d5-9f2f-453546f09b91 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:39.639711 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292adf0c-9d79-47d5-9f2f-453546f09b91 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:39.639986 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292adf0c-9d79-47d5-9f2f-453546f09b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:39.659655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-292adf0c-9d79-47d5-9f2f-453546f09b91 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:39.660849 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-292adf0c-9d79-47d5-9f2f-453546f09b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:39.669728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1269/2578] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:39.674005 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172e5fb-657f-435a-bf1c-933136fb9412 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:39.683653 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172e5fb-657f-435a-bf1c-933136fb9412 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:39.688209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ba630-0e5c-40cb-ad58-bd543be04ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:39.688810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ba630-0e5c-40cb-ad58-bd543be04ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:39.689087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ba630-0e5c-40cb-ad58-bd543be04ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:39.689360 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ba630-0e5c-40cb-ad58-bd543be04ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:39.690038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ba630-0e5c-40cb-ad58-bd543be04ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:27:39.690343 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ba630-0e5c-40cb-ad58-bd543be04ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:39.691930 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ba630-0e5c-40cb-ad58-bd543be04ea2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:39.704046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1310/2579] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:27:39.708326 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292adf0c-9d79-47d5-9f2f-453546f09b91 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:39.718478 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292adf0c-9d79-47d5-9f2f-453546f09b91 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:39.723189 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcbcaf-673c-4a79-b07c-8ae868feebf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:39.723825 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcbcaf-673c-4a79-b07c-8ae868feebf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:39.724104 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcbcaf-673c-4a79-b07c-8ae868feebf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:39.724377 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcbcaf-673c-4a79-b07c-8ae868feebf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:39.724997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcbcaf-673c-4a79-b07c-8ae868feebf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:39.727675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcbcaf-673c-4a79-b07c-8ae868feebf7 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:39.828744 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1270/2580] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:27:39 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:27:39.830204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ba630-0e5c-40cb-ad58-bd543be04ea2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:39.844423 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ba630-0e5c-40cb-ad58-bd543be04ea2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:39.849349 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:39.883028 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcbcaf-673c-4a79-b07c-8ae868feebf7 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:39.885058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c5dcbcaf-673c-4a79-b07c-8ae868feebf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:39.903951 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2510d-50de-44b6-9714-e2561ff3ff4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:39.904552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2510d-50de-44b6-9714-e2561ff3ff4c admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:39.904831 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2510d-50de-44b6-9714-e2561ff3ff4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:39.905106 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2510d-50de-44b6-9714-e2561ff3ff4c admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:39.905766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2510d-50de-44b6-9714-e2561ff3ff4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:39.905954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:39.907712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2510d-50de-44b6-9714-e2561ff3ff4c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:39.941841 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcbcaf-673c-4a79-b07c-8ae868feebf7 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:39.946003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359a99a-c898-494a-a2e6-576bccca2958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:39.946603 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359a99a-c898-494a-a2e6-576bccca2958 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:39.946880 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359a99a-c898-494a-a2e6-576bccca2958 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:39.947151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359a99a-c898-494a-a2e6-576bccca2958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:39.949033 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7359a99a-c898-494a-a2e6-576bccca2958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:39.961182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359a99a-c898-494a-a2e6-576bccca2958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:39.962632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359a99a-c898-494a-a2e6-576bccca2958 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:39.972108 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1271/2581] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:27:39.986699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1311/2582] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:27:39 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:27:39.988180 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359a99a-c898-494a-a2e6-576bccca2958 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:39.997829 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359a99a-c898-494a-a2e6-576bccca2958 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:40.002442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21c0ff-a448-4914-ac5f-a3117bc60d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:40.003035 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21c0ff-a448-4914-ac5f-a3117bc60d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:40.003319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21c0ff-a448-4914-ac5f-a3117bc60d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:40.003592 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21c0ff-a448-4914-ac5f-a3117bc60d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:40.004229 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21c0ff-a448-4914-ac5f-a3117bc60d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:40.005872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21c0ff-a448-4914-ac5f-a3117bc60d2d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:40.017354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1272/2583] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:27:40.021276 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2510d-50de-44b6-9714-e2561ff3ff4c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:40.032387 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2510d-50de-44b6-9714-e2561ff3ff4c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:40.037269 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77634963-8b6d-4481-8a08-856d89afe7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:40.038953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77634963-8b6d-4481-8a08-856d89afe7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:40.038953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77634963-8b6d-4481-8a08-856d89afe7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:40.038953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77634963-8b6d-4481-8a08-856d89afe7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:40.039492 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77634963-8b6d-4481-8a08-856d89afe7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:40.041162 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77634963-8b6d-4481-8a08-856d89afe7e7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:40.052083 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1312/2584] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:27:40.056199 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21c0ff-a448-4914-ac5f-a3117bc60d2d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:40.066468 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21c0ff-a448-4914-ac5f-a3117bc60d2d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:40.071608 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8c09-79d6-4b35-b5e1-b8ae466c1e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:40.072267 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8c09-79d6-4b35-b5e1-b8ae466c1e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:40.072549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8c09-79d6-4b35-b5e1-b8ae466c1e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:40.072817 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8c09-79d6-4b35-b5e1-b8ae466c1e5c admin admin] PATH_INFO: `/v3/projects/12c73185cd1844d99e094e04d7b2a9a2/users/2119c88754924ce991a00dfabd303bbc/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:40.089044 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a8c09-79d6-4b35-b5e1-b8ae466c1e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c73185cd1844d99e094e04d7b2a9a2, user_id=2119c88754924ce991a00dfabd303bbc, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:40.091865 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a8c09-79d6-4b35-b5e1-b8ae466c1e5c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:40.180794 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1273/2585] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:27:40 2022] PUT /identity/v3/projects/12c73185cd1844d99e094e04d7b2a9a2/users/2119c88754924ce991a00dfabd303bbc/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:40.191140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114ad26-d361-40eb-83ad-6ddc31c9e81a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:40.191487 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114ad26-d361-40eb-83ad-6ddc31c9e81a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:40.191823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114ad26-d361-40eb-83ad-6ddc31c9e81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:40.220053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5114ad26-d361-40eb-83ad-6ddc31c9e81a None None] MFA Rules not processed for user `2119c88754924ce991a00dfabd303bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:40.221293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5114ad26-d361-40eb-83ad-6ddc31c9e81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:40.289784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1313/2586] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:40.301434 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8c09-79d6-4b35-b5e1-b8ae466c1e5c admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:40.303274 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6b6a8c09-79d6-4b35-b5e1-b8ae466c1e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:40.361136 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8c09-79d6-4b35-b5e1-b8ae466c1e5c admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:40.364804 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d53817-38e7-4a42-88ea-4a0e99dbcd18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:40.365407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d53817-38e7-4a42-88ea-4a0e99dbcd18 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:40.365717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d53817-38e7-4a42-88ea-4a0e99dbcd18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:40.366475 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d53817-38e7-4a42-88ea-4a0e99dbcd18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:40.374914 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d53817-38e7-4a42-88ea-4a0e99dbcd18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:40.376344 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d53817-38e7-4a42-88ea-4a0e99dbcd18 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:40.386798 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1274/2587] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:27:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:27:40.408123 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114ad26-d361-40eb-83ad-6ddc31c9e81a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:40.468927 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114ad26-d361-40eb-83ad-6ddc31c9e81a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:40.473592 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9eddcc-207c-4434-b196-19c44b0511a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:40.474203 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eddcc-207c-4434-b196-19c44b0511a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:40.474486 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eddcc-207c-4434-b196-19c44b0511a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:40.474748 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eddcc-207c-4434-b196-19c44b0511a1 admin admin] PATH_INFO: `/v3/users/2119c88754924ce991a00dfabd303bbc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:40.475898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9eddcc-207c-4434-b196-19c44b0511a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2119c88754924ce991a00dfabd303bbc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:40.478064 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9eddcc-207c-4434-b196-19c44b0511a1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:40.500570 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:40.684862 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3d9eddcc-207c-4434-b196-19c44b0511a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2119c88754924ce991a00dfabd303bbc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:40.756691 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3d9eddcc-207c-4434-b196-19c44b0511a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2119c88754924ce991a00dfabd303bbc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:40.757416 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3d9eddcc-207c-4434-b196-19c44b0511a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2119c88754924ce991a00dfabd303bbc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:40.758071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3d9eddcc-207c-4434-b196-19c44b0511a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2119c88754924ce991a00dfabd303bbc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:40.765600 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3d9eddcc-207c-4434-b196-19c44b0511a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2119c88754924ce991a00dfabd303bbc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:40.784628 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1314/2588] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:27:40 2022] DELETE /identity/v3/users/2119c88754924ce991a00dfabd303bbc => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:40.790287 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18204f7f-4c57-4d8b-a9e3-98d751b10ad6 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:40.790600 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18204f7f-4c57-4d8b-a9e3-98d751b10ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:40.790875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18204f7f-4c57-4d8b-a9e3-98d751b10ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:40.810137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-18204f7f-4c57-4d8b-a9e3-98d751b10ad6 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:40.811332 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-18204f7f-4c57-4d8b-a9e3-98d751b10ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:40.872728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1275/2589] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:40.882892 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9eddcc-207c-4434-b196-19c44b0511a1 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:40.884976 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3d9eddcc-207c-4434-b196-19c44b0511a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:40.963274 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9eddcc-207c-4434-b196-19c44b0511a1 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:40.967058 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a7f65-ebb3-437e-b394-2b7d736b21b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:40.967668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a7f65-ebb3-437e-b394-2b7d736b21b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:40.967949 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a7f65-ebb3-437e-b394-2b7d736b21b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:40.968222 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a7f65-ebb3-437e-b394-2b7d736b21b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:40.978962 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a7f65-ebb3-437e-b394-2b7d736b21b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:40.980417 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a7f65-ebb3-437e-b394-2b7d736b21b1 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:40.991080 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1315/2590] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:27:41.437089 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18204f7f-4c57-4d8b-a9e3-98d751b10ad6 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:41.440296 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-18204f7f-4c57-4d8b-a9e3-98d751b10ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:41.452918 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18204f7f-4c57-4d8b-a9e3-98d751b10ad6 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:41.460470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23a9d2-40c1-48f5-9d72-2131637ea89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:41.461280 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23a9d2-40c1-48f5-9d72-2131637ea89f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:41.461618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23a9d2-40c1-48f5-9d72-2131637ea89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:41.461909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23a9d2-40c1-48f5-9d72-2131637ea89f admin admin] PATH_INFO: `/v3/projects/12c73185cd1844d99e094e04d7b2a9a2` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:41.463135 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23a9d2-40c1-48f5-9d72-2131637ea89f admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c73185cd1844d99e094e04d7b2a9a2)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:41.465206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23a9d2-40c1-48f5-9d72-2131637ea89f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:41.497708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:41.582608 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ea23a9d2-40c1-48f5-9d72-2131637ea89f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c73185cd1844d99e094e04d7b2a9a2', 'request_id': 'req-ea23a9d2-40c1-48f5-9d72-2131637ea89f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:41.593011 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ea23a9d2-40c1-48f5-9d72-2131637ea89f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c73185cd1844d99e094e04d7b2a9a2', 'request_id': 'req-ea23a9d2-40c1-48f5-9d72-2131637ea89f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:41.665330 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ea23a9d2-40c1-48f5-9d72-2131637ea89f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c73185cd1844d99e094e04d7b2a9a2', 'request_id': 'req-ea23a9d2-40c1-48f5-9d72-2131637ea89f'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:41.678078 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ea23a9d2-40c1-48f5-9d72-2131637ea89f admin admin] The token cache is being invalidate because project 12c73185cd1844d99e094e04d7b2a9a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:27:41.678369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ea23a9d2-40c1-48f5-9d72-2131637ea89f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:41.679743 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ea23a9d2-40c1-48f5-9d72-2131637ea89f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:41.681273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1276/2591] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:27:41 2022] DELETE /identity/v3/projects/12c73185cd1844d99e094e04d7b2a9a2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:41.686286 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21204a85-84ac-4cd6-8b0d-eff580c4e1cd None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:41.688943 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21204a85-84ac-4cd6-8b0d-eff580c4e1cd None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:41.688943 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21204a85-84ac-4cd6-8b0d-eff580c4e1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:41.710193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-21204a85-84ac-4cd6-8b0d-eff580c4e1cd None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:41.711500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-21204a85-84ac-4cd6-8b0d-eff580c4e1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:41.788388 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1316/2592] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:41.796454 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45990409-0d0e-46f3-8576-5197331eb30e None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:41.797105 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45990409-0d0e-46f3-8576-5197331eb30e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:41.797105 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45990409-0d0e-46f3-8576-5197331eb30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:41.818359 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-45990409-0d0e-46f3-8576-5197331eb30e None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:41.820174 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-45990409-0d0e-46f3-8576-5197331eb30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:41.830110 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1277/2593] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:41.834423 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21204a85-84ac-4cd6-8b0d-eff580c4e1cd None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:41.845315 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21204a85-84ac-4cd6-8b0d-eff580c4e1cd None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:41.851772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e0edf-ff6a-4cbc-b557-2b41cca7e141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:41.852655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e0edf-ff6a-4cbc-b557-2b41cca7e141 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:41.853210 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e0edf-ff6a-4cbc-b557-2b41cca7e141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:41.853616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e0edf-ff6a-4cbc-b557-2b41cca7e141 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:41.854365 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e0edf-ff6a-4cbc-b557-2b41cca7e141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:27:41.854764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e0edf-ff6a-4cbc-b557-2b41cca7e141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:41.856449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e0edf-ff6a-4cbc-b557-2b41cca7e141 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:41.869500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1317/2594] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:27:41.873708 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45990409-0d0e-46f3-8576-5197331eb30e None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:41.884541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45990409-0d0e-46f3-8576-5197331eb30e None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:41.898993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde9c9c-b6b4-446c-a98d-d2fd639e8275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:41.898993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde9c9c-b6b4-446c-a98d-d2fd639e8275 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:41.898993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde9c9c-b6b4-446c-a98d-d2fd639e8275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:41.898993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde9c9c-b6b4-446c-a98d-d2fd639e8275 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:41.899429 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde9c9c-b6b4-446c-a98d-d2fd639e8275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:41.899429 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde9c9c-b6b4-446c-a98d-d2fd639e8275 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:41.981393 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1278/2595] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:27:41 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:27:41.985683 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e0edf-ff6a-4cbc-b557-2b41cca7e141 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:41.996594 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e0edf-ff6a-4cbc-b557-2b41cca7e141 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:42.022439 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:42.055701 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c237e41-abc2-4e5b-883e-1a907ed3b4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:42.056300 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c237e41-abc2-4e5b-883e-1a907ed3b4dd admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:42.056579 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c237e41-abc2-4e5b-883e-1a907ed3b4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:42.056849 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c237e41-abc2-4e5b-883e-1a907ed3b4dd admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:42.057547 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c237e41-abc2-4e5b-883e-1a907ed3b4dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:42.059474 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c237e41-abc2-4e5b-883e-1a907ed3b4dd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:42.150010 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1318/2596] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:27:41 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:27:42.154865 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde9c9c-b6b4-446c-a98d-d2fd639e8275 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:42.166412 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde9c9c-b6b4-446c-a98d-d2fd639e8275 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:42.171471 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd6693-52f1-423c-b1cc-3839cd004bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:42.172089 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd6693-52f1-423c-b1cc-3839cd004bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:42.172371 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd6693-52f1-423c-b1cc-3839cd004bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:42.172648 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd6693-52f1-423c-b1cc-3839cd004bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:42.173305 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd6693-52f1-423c-b1cc-3839cd004bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:42.174969 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd6693-52f1-423c-b1cc-3839cd004bb4 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:42.186521 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1279/2597] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:27:42.190629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c237e41-abc2-4e5b-883e-1a907ed3b4dd admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:42.200852 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c237e41-abc2-4e5b-883e-1a907ed3b4dd admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:42.205411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc895c-db60-4e00-a362-a310e62323cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:42.208463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc895c-db60-4e00-a362-a310e62323cf admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:42.208463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc895c-db60-4e00-a362-a310e62323cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:42.208463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc895c-db60-4e00-a362-a310e62323cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:42.208463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc895c-db60-4e00-a362-a310e62323cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:42.208847 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc895c-db60-4e00-a362-a310e62323cf admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:42.218679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1319/2598] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:27:42.222997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd6693-52f1-423c-b1cc-3839cd004bb4 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:42.233628 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd6693-52f1-423c-b1cc-3839cd004bb4 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:42.238257 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7547f7d-88d1-44f6-ab4b-d13ebf10136d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:42.238912 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7547f7d-88d1-44f6-ab4b-d13ebf10136d admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:42.239235 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7547f7d-88d1-44f6-ab4b-d13ebf10136d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:42.239506 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7547f7d-88d1-44f6-ab4b-d13ebf10136d admin admin] PATH_INFO: `/v3/projects/76b5ff582966420aa4aa101a0664e110/users/eeb9a34b27b742a4be6ea7e038d786a4/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:42.259939 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7547f7d-88d1-44f6-ab4b-d13ebf10136d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b5ff582966420aa4aa101a0664e110, user_id=eeb9a34b27b742a4be6ea7e038d786a4, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:42.262919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7547f7d-88d1-44f6-ab4b-d13ebf10136d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:42.334882 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1280/2599] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:27:42 2022] PUT /identity/v3/projects/76b5ff582966420aa4aa101a0664e110/users/eeb9a34b27b742a4be6ea7e038d786a4/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:42.346142 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8363972-de52-4a50-9ef2-d496c643bd80 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:42.346461 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8363972-de52-4a50-9ef2-d496c643bd80 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:42.346742 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8363972-de52-4a50-9ef2-d496c643bd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:42.382380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-f8363972-de52-4a50-9ef2-d496c643bd80 None None] MFA Rules not processed for user `eeb9a34b27b742a4be6ea7e038d786a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:42.383605 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f8363972-de52-4a50-9ef2-d496c643bd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:42.458338 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1320/2600] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:42.470532 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7547f7d-88d1-44f6-ab4b-d13ebf10136d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:42.472406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b7547f7d-88d1-44f6-ab4b-d13ebf10136d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:42.540482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7547f7d-88d1-44f6-ab4b-d13ebf10136d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:42.544821 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a04f91-a70b-4ffe-aad6-ee4feda8a872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:42.545565 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a04f91-a70b-4ffe-aad6-ee4feda8a872 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:42.545972 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a04f91-a70b-4ffe-aad6-ee4feda8a872 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:42.546390 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a04f91-a70b-4ffe-aad6-ee4feda8a872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:42.556209 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a04f91-a70b-4ffe-aad6-ee4feda8a872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:42.557679 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a04f91-a70b-4ffe-aad6-ee4feda8a872 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:42.567089 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1281/2601] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:27:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:27:43.430815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8363972-de52-4a50-9ef2-d496c643bd80 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:43.432291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f8363972-de52-4a50-9ef2-d496c643bd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:43.497715 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8363972-de52-4a50-9ef2-d496c643bd80 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:43.502642 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc427875-4f5d-49fe-829e-44ca70aa5d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:43.503282 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc427875-4f5d-49fe-829e-44ca70aa5d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:43.503560 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc427875-4f5d-49fe-829e-44ca70aa5d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:43.503828 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc427875-4f5d-49fe-829e-44ca70aa5d1d admin admin] PATH_INFO: `/v3/users/57a4a9f362d948ebaac0cae4a51dbf1d` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:43.504954 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc427875-4f5d-49fe-829e-44ca70aa5d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a4a9f362d948ebaac0cae4a51dbf1d)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:43.507725 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc427875-4f5d-49fe-829e-44ca70aa5d1d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:43.714866 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:43.722762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fc427875-4f5d-49fe-829e-44ca70aa5d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a4a9f362d948ebaac0cae4a51dbf1d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:43.800828 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fc427875-4f5d-49fe-829e-44ca70aa5d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a4a9f362d948ebaac0cae4a51dbf1d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:43.801427 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fc427875-4f5d-49fe-829e-44ca70aa5d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a4a9f362d948ebaac0cae4a51dbf1d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:43.802065 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fc427875-4f5d-49fe-829e-44ca70aa5d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a4a9f362d948ebaac0cae4a51dbf1d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:43.809872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-fc427875-4f5d-49fe-829e-44ca70aa5d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a4a9f362d948ebaac0cae4a51dbf1d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:43.827229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1321/2602] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:27:43 2022] DELETE /identity/v3/users/57a4a9f362d948ebaac0cae4a51dbf1d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:44.077329 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a04f91-a70b-4ffe-aad6-ee4feda8a872 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:44.089610 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a04f91-a70b-4ffe-aad6-ee4feda8a872 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:44.138386 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:44.148321 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bfd3c-8bf5-4dd4-b3f9-4f0f7421f443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:44.148954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bfd3c-8bf5-4dd4-b3f9-4f0f7421f443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:44.149236 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bfd3c-8bf5-4dd4-b3f9-4f0f7421f443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:44.149541 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bfd3c-8bf5-4dd4-b3f9-4f0f7421f443 admin admin] PATH_INFO: `/v3/projects/1413436acbb4483d95cab0406a3baae7` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:44.159784 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bfd3c-8bf5-4dd4-b3f9-4f0f7421f443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1413436acbb4483d95cab0406a3baae7)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:44.164433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bfd3c-8bf5-4dd4-b3f9-4f0f7421f443 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:44.276129 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b81bfd3c-8bf5-4dd4-b3f9-4f0f7421f443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1413436acbb4483d95cab0406a3baae7', 'request_id': 'req-b81bfd3c-8bf5-4dd4-b3f9-4f0f7421f443'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:44.281751 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b81bfd3c-8bf5-4dd4-b3f9-4f0f7421f443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1413436acbb4483d95cab0406a3baae7', 'request_id': 'req-b81bfd3c-8bf5-4dd4-b3f9-4f0f7421f443'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:44.355164 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b81bfd3c-8bf5-4dd4-b3f9-4f0f7421f443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1413436acbb4483d95cab0406a3baae7', 'request_id': 'req-b81bfd3c-8bf5-4dd4-b3f9-4f0f7421f443'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:44.368083 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b81bfd3c-8bf5-4dd4-b3f9-4f0f7421f443 admin admin] The token cache is being invalidate because project 1413436acbb4483d95cab0406a3baae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:27:44.368378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b81bfd3c-8bf5-4dd4-b3f9-4f0f7421f443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:44.369043 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b81bfd3c-8bf5-4dd4-b3f9-4f0f7421f443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:44.370547 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1282/2603] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:27:44 2022] DELETE /identity/v3/projects/1413436acbb4483d95cab0406a3baae7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:44.375663 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ae25d-4ffa-494d-84df-b181f439176a None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:44.376028 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ae25d-4ffa-494d-84df-b181f439176a None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:44.376373 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ae25d-4ffa-494d-84df-b181f439176a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:44.399389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-601ae25d-4ffa-494d-84df-b181f439176a None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:44.401556 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-601ae25d-4ffa-494d-84df-b181f439176a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:44.460690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1322/2604] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:44.468842 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd15a0-a16a-422c-841d-28fe358d6df1 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:44.469128 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd15a0-a16a-422c-841d-28fe358d6df1 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:44.473358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd15a0-a16a-422c-841d-28fe358d6df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:44.488849 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-81dd15a0-a16a-422c-841d-28fe358d6df1 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:44.490108 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-81dd15a0-a16a-422c-841d-28fe358d6df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:44.498118 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1283/2605] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:44.502496 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ae25d-4ffa-494d-84df-b181f439176a None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:44.512976 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ae25d-4ffa-494d-84df-b181f439176a None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:44.518038 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a395198-2bdd-4981-97fe-14ee7f98b1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:44.518641 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a395198-2bdd-4981-97fe-14ee7f98b1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:44.518917 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a395198-2bdd-4981-97fe-14ee7f98b1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:44.519211 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a395198-2bdd-4981-97fe-14ee7f98b1e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:44.519875 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a395198-2bdd-4981-97fe-14ee7f98b1e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:27:44.520227 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a395198-2bdd-4981-97fe-14ee7f98b1e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:44.521915 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a395198-2bdd-4981-97fe-14ee7f98b1e0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:44.534430 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1323/2606] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:27:44.539362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd15a0-a16a-422c-841d-28fe358d6df1 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:44.548650 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd15a0-a16a-422c-841d-28fe358d6df1 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:44.553427 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae1414-e729-41cf-a018-67f37bb3b6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:44.554307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae1414-e729-41cf-a018-67f37bb3b6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:44.554582 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae1414-e729-41cf-a018-67f37bb3b6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:44.554852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae1414-e729-41cf-a018-67f37bb3b6d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:44.555467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae1414-e729-41cf-a018-67f37bb3b6d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:44.557342 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae1414-e729-41cf-a018-67f37bb3b6d3 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:44.626069 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1284/2607] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:27:44 2022] POST /identity/v3/projects => generated 363 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:27:44.630302 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a395198-2bdd-4981-97fe-14ee7f98b1e0 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:44.641010 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a395198-2bdd-4981-97fe-14ee7f98b1e0 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:44.699375 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce8aa4-a4fe-4ee2-9d64-9ac97bda29e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:44.700398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce8aa4-a4fe-4ee2-9d64-9ac97bda29e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:44.700545 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce8aa4-a4fe-4ee2-9d64-9ac97bda29e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:44.700789 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce8aa4-a4fe-4ee2-9d64-9ac97bda29e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:44.701411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce8aa4-a4fe-4ee2-9d64-9ac97bda29e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:44.703358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce8aa4-a4fe-4ee2-9d64-9ac97bda29e1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:44.789970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1324/2608] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:27:44 2022] POST /identity/v3/users => generated 282 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:27:44.795136 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae1414-e729-41cf-a018-67f37bb3b6d3 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:44.806325 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae1414-e729-41cf-a018-67f37bb3b6d3 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:44.811089 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c0eba-8151-464d-aabd-ec19cce15b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:44.811684 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c0eba-8151-464d-aabd-ec19cce15b03 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:44.811964 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c0eba-8151-464d-aabd-ec19cce15b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:44.812278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c0eba-8151-464d-aabd-ec19cce15b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:44.812975 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c0eba-8151-464d-aabd-ec19cce15b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:44.814601 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c0eba-8151-464d-aabd-ec19cce15b03 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:44.825427 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1285/2609] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:27:44.830050 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce8aa4-a4fe-4ee2-9d64-9ac97bda29e1 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:44.840668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce8aa4-a4fe-4ee2-9d64-9ac97bda29e1 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:44.845411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa820c-3612-43c7-823f-d0772f04dad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:44.846040 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa820c-3612-43c7-823f-d0772f04dad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:44.846352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa820c-3612-43c7-823f-d0772f04dad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:44.846625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa820c-3612-43c7-823f-d0772f04dad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:44.847289 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa820c-3612-43c7-823f-d0772f04dad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:44.848881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa820c-3612-43c7-823f-d0772f04dad1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:44.859967 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1325/2610] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:27:44.863414 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c0eba-8151-464d-aabd-ec19cce15b03 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:44.874133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c0eba-8151-464d-aabd-ec19cce15b03 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:44.878824 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b4f89-5c08-4e9e-b295-762de7a70ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:44.879465 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b4f89-5c08-4e9e-b295-762de7a70ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:44.879745 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b4f89-5c08-4e9e-b295-762de7a70ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:44.880016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b4f89-5c08-4e9e-b295-762de7a70ac4 admin admin] PATH_INFO: `/v3/projects/c2ed7ba2a9384a7fa491b01015f92219/users/04049236ac3a45ea9087de1304094881/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:44.901610 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b4f89-5c08-4e9e-b295-762de7a70ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2ed7ba2a9384a7fa491b01015f92219, user_id=04049236ac3a45ea9087de1304094881, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:44.901610 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b4f89-5c08-4e9e-b295-762de7a70ac4 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:45.007795 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1286/2611] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:27:44 2022] PUT /identity/v3/projects/c2ed7ba2a9384a7fa491b01015f92219/users/04049236ac3a45ea9087de1304094881/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:45.018537 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d16c3-bfb3-48f0-945d-4fb6265fee16 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:45.018818 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d16c3-bfb3-48f0-945d-4fb6265fee16 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:45.019090 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d16c3-bfb3-48f0-945d-4fb6265fee16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:45.046804 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-123d16c3-bfb3-48f0-945d-4fb6265fee16 None None] MFA Rules not processed for user `04049236ac3a45ea9087de1304094881`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:45.048065 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-123d16c3-bfb3-48f0-945d-4fb6265fee16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:45.056458 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:45.111829 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1326/2612] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:45.116299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b4f89-5c08-4e9e-b295-762de7a70ac4 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:45.179330 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b4f89-5c08-4e9e-b295-762de7a70ac4 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:45.184279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad83c4-5b32-4831-bfd6-32c8b2969f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:45.184877 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad83c4-5b32-4831-bfd6-32c8b2969f2a admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:45.185160 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad83c4-5b32-4831-bfd6-32c8b2969f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:45.185435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad83c4-5b32-4831-bfd6-32c8b2969f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:45.186103 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad83c4-5b32-4831-bfd6-32c8b2969f2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:45.188008 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad83c4-5b32-4831-bfd6-32c8b2969f2a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:45.192574 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:45.289524 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1287/2613] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:27:45 2022] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:27:45.293607 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d16c3-bfb3-48f0-945d-4fb6265fee16 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:45.304246 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d16c3-bfb3-48f0-945d-4fb6265fee16 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:45.359824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d335511-b104-4bc8-bcb0-60f49b488437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:45.360440 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d335511-b104-4bc8-bcb0-60f49b488437 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:45.360726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d335511-b104-4bc8-bcb0-60f49b488437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:45.361057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d335511-b104-4bc8-bcb0-60f49b488437 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:45.361712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d335511-b104-4bc8-bcb0-60f49b488437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:45.363690 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d335511-b104-4bc8-bcb0-60f49b488437 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:45.440617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1327/2614] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:27:45 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:27:45.444697 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad83c4-5b32-4831-bfd6-32c8b2969f2a admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:45.455629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad83c4-5b32-4831-bfd6-32c8b2969f2a admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:45.460386 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eead9-2433-4f8e-a9bf-fdcb520a6c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:45.461207 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eead9-2433-4f8e-a9bf-fdcb520a6c9e admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:45.461521 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eead9-2433-4f8e-a9bf-fdcb520a6c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:45.461799 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eead9-2433-4f8e-a9bf-fdcb520a6c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:45.462439 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183eead9-2433-4f8e-a9bf-fdcb520a6c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:45.467511 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183eead9-2433-4f8e-a9bf-fdcb520a6c9e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:45.473848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1288/2615] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:27:45.478213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d335511-b104-4bc8-bcb0-60f49b488437 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:45.488281 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d335511-b104-4bc8-bcb0-60f49b488437 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:45.493775 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86983c-1b54-4166-bdf2-f363398b7861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:45.494419 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86983c-1b54-4166-bdf2-f363398b7861 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:45.494692 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86983c-1b54-4166-bdf2-f363398b7861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:45.494961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86983c-1b54-4166-bdf2-f363398b7861 admin admin] PATH_INFO: `/v3/projects/6f157c486b6844af94f7dc9adc663574/users/33ded530c3064f0f8cd112bdc15ac23a/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:45.511765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86983c-1b54-4166-bdf2-f363398b7861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f157c486b6844af94f7dc9adc663574, user_id=33ded530c3064f0f8cd112bdc15ac23a, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:45.514821 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86983c-1b54-4166-bdf2-f363398b7861 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:45.594890 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1328/2616] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:27:45 2022] PUT /identity/v3/projects/6f157c486b6844af94f7dc9adc663574/users/33ded530c3064f0f8cd112bdc15ac23a/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:45.599115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eead9-2433-4f8e-a9bf-fdcb520a6c9e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:45.609646 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eead9-2433-4f8e-a9bf-fdcb520a6c9e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:45.665527 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45216244-d221-4dbf-b617-39dfbfa63b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:45.666126 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45216244-d221-4dbf-b617-39dfbfa63b95 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:45.666403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45216244-d221-4dbf-b617-39dfbfa63b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:45.666672 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45216244-d221-4dbf-b617-39dfbfa63b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:45.667299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45216244-d221-4dbf-b617-39dfbfa63b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:45.668988 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45216244-d221-4dbf-b617-39dfbfa63b95 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:45.678584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1289/2617] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:27:45.683503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86983c-1b54-4166-bdf2-f363398b7861 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:45.693525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86983c-1b54-4166-bdf2-f363398b7861 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:45.698671 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395ff16-e732-4a50-a350-dd4c18265f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:45.699314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395ff16-e732-4a50-a350-dd4c18265f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:45.699594 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395ff16-e732-4a50-a350-dd4c18265f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:45.699868 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395ff16-e732-4a50-a350-dd4c18265f7e admin admin] PATH_INFO: `/v3/projects/6f157c486b6844af94f7dc9adc663574/users/33ded530c3064f0f8cd112bdc15ac23a/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:45.701780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395ff16-e732-4a50-a350-dd4c18265f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f157c486b6844af94f7dc9adc663574, user_id=33ded530c3064f0f8cd112bdc15ac23a, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:45.704411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395ff16-e732-4a50-a350-dd4c18265f7e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:45.714277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1329/2618] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:27:45 2022] PUT /identity/v3/projects/6f157c486b6844af94f7dc9adc663574/users/33ded530c3064f0f8cd112bdc15ac23a/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:27:45.725364 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8c608-3d28-4cd3-ae81-41ca181dac8b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:45.725666 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8c608-3d28-4cd3-ae81-41ca181dac8b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:45.725967 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8c608-3d28-4cd3-ae81-41ca181dac8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:45.753247 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-48d8c608-3d28-4cd3-ae81-41ca181dac8b None None] MFA Rules not processed for user `33ded530c3064f0f8cd112bdc15ac23a`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:45.754513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-48d8c608-3d28-4cd3-ae81-41ca181dac8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:45.826018 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1290/2619] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:45.837527 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395ff16-e732-4a50-a350-dd4c18265f7e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:45.839296 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c395ff16-e732-4a50-a350-dd4c18265f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:45.901348 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395ff16-e732-4a50-a350-dd4c18265f7e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:45.904982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c69f62-ce81-4a87-aec3-12b679f8d9e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:45.905617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c69f62-ce81-4a87-aec3-12b679f8d9e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:45.905898 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c69f62-ce81-4a87-aec3-12b679f8d9e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:45.906169 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c69f62-ce81-4a87-aec3-12b679f8d9e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:45.915866 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c69f62-ce81-4a87-aec3-12b679f8d9e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:45.917229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c69f62-ce81-4a87-aec3-12b679f8d9e9 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:45.926695 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1330/2620] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:27:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:27:46.140193 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8c608-3d28-4cd3-ae81-41ca181dac8b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:46.150848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8c608-3d28-4cd3-ae81-41ca181dac8b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:46.154570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47dbb13-03a5-4c67-acf1-086966c8a477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:46.155171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dbb13-03a5-4c67-acf1-086966c8a477 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:46.168123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dbb13-03a5-4c67-acf1-086966c8a477 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:46.168123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47dbb13-03a5-4c67-acf1-086966c8a477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:46.221052 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:46.224312 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47dbb13-03a5-4c67-acf1-086966c8a477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:46.225816 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47dbb13-03a5-4c67-acf1-086966c8a477 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:46.235253 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1291/2621] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:27:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:27:54.686264 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c69f62-ce81-4a87-aec3-12b679f8d9e9 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:54.691718 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:54.748433 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c69f62-ce81-4a87-aec3-12b679f8d9e9 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:54.753115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f224e-0194-4503-9ef0-ad8cd90270dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:54.753773 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f224e-0194-4503-9ef0-ad8cd90270dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:54.754057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f224e-0194-4503-9ef0-ad8cd90270dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:54.754333 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f224e-0194-4503-9ef0-ad8cd90270dd admin admin] PATH_INFO: `/v3/users/04049236ac3a45ea9087de1304094881` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:54.755468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f224e-0194-4503-9ef0-ad8cd90270dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=04049236ac3a45ea9087de1304094881)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:54.757400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f224e-0194-4503-9ef0-ad8cd90270dd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:54.941399 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dc3f224e-0194-4503-9ef0-ad8cd90270dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04049236ac3a45ea9087de1304094881'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:55.002138 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dc3f224e-0194-4503-9ef0-ad8cd90270dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04049236ac3a45ea9087de1304094881'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:55.002823 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dc3f224e-0194-4503-9ef0-ad8cd90270dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04049236ac3a45ea9087de1304094881'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:55.003485 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dc3f224e-0194-4503-9ef0-ad8cd90270dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04049236ac3a45ea9087de1304094881'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:55.011244 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-dc3f224e-0194-4503-9ef0-ad8cd90270dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04049236ac3a45ea9087de1304094881'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:55.028707 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1331/2622] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:27:54 2022] DELETE /identity/v3/users/04049236ac3a45ea9087de1304094881 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:55.033275 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc1388-17a3-46f6-beea-ced671b351a8 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:55.033797 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc1388-17a3-46f6-beea-ced671b351a8 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:55.033915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc1388-17a3-46f6-beea-ced671b351a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:55.053137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-96dc1388-17a3-46f6-beea-ced671b351a8 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:55.054442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-96dc1388-17a3-46f6-beea-ced671b351a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:55.112996 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1292/2623] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:55.123447 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f224e-0194-4503-9ef0-ad8cd90270dd admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:55.124871 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-dc3f224e-0194-4503-9ef0-ad8cd90270dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:55.182220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f224e-0194-4503-9ef0-ad8cd90270dd admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:55.186623 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702994b-6ae0-4d26-a393-89b331b52284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:55.187219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702994b-6ae0-4d26-a393-89b331b52284 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:55.187498 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702994b-6ae0-4d26-a393-89b331b52284 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:55.187766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702994b-6ae0-4d26-a393-89b331b52284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:55.196560 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702994b-6ae0-4d26-a393-89b331b52284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:55.197959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702994b-6ae0-4d26-a393-89b331b52284 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:55.207735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1332/2624] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:27:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:27:55.602772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc1388-17a3-46f6-beea-ced671b351a8 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:55.604228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-96dc1388-17a3-46f6-beea-ced671b351a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:55.619146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc1388-17a3-46f6-beea-ced671b351a8 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:55.624665 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab5986-0b5f-4efd-9bb4-d6067d0403c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:55.625297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab5986-0b5f-4efd-9bb4-d6067d0403c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:55.625621 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab5986-0b5f-4efd-9bb4-d6067d0403c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:55.625899 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab5986-0b5f-4efd-9bb4-d6067d0403c9 admin admin] PATH_INFO: `/v3/projects/c2ed7ba2a9384a7fa491b01015f92219` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:55.627039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab5986-0b5f-4efd-9bb4-d6067d0403c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2ed7ba2a9384a7fa491b01015f92219)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:55.629081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab5986-0b5f-4efd-9bb4-d6067d0403c9 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:55.758234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5cab5986-0b5f-4efd-9bb4-d6067d0403c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2ed7ba2a9384a7fa491b01015f92219', 'request_id': 'req-5cab5986-0b5f-4efd-9bb4-d6067d0403c9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:55.762718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5cab5986-0b5f-4efd-9bb4-d6067d0403c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2ed7ba2a9384a7fa491b01015f92219', 'request_id': 'req-5cab5986-0b5f-4efd-9bb4-d6067d0403c9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:55.831116 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5cab5986-0b5f-4efd-9bb4-d6067d0403c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2ed7ba2a9384a7fa491b01015f92219', 'request_id': 'req-5cab5986-0b5f-4efd-9bb4-d6067d0403c9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:55.843285 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5cab5986-0b5f-4efd-9bb4-d6067d0403c9 admin admin] The token cache is being invalidate because project c2ed7ba2a9384a7fa491b01015f92219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:27:55.843579 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5cab5986-0b5f-4efd-9bb4-d6067d0403c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:55.844217 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5cab5986-0b5f-4efd-9bb4-d6067d0403c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:55.845754 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1293/2625] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:27:55 2022] DELETE /identity/v3/projects/c2ed7ba2a9384a7fa491b01015f92219 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:55.849825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702994b-6ae0-4d26-a393-89b331b52284 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:55.859498 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702994b-6ae0-4d26-a393-89b331b52284 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:55.882735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:55.914461 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0909c8-fb0d-4ee1-8402-d189453985c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:55.915082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0909c8-fb0d-4ee1-8402-d189453985c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:55.915360 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0909c8-fb0d-4ee1-8402-d189453985c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:55.915629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0909c8-fb0d-4ee1-8402-d189453985c3 admin admin] PATH_INFO: `/v3/users/33ded530c3064f0f8cd112bdc15ac23a` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:55.916729 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0909c8-fb0d-4ee1-8402-d189453985c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ded530c3064f0f8cd112bdc15ac23a)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:55.918707 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0909c8-fb0d-4ee1-8402-d189453985c3 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:56.140971 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9e0909c8-fb0d-4ee1-8402-d189453985c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ded530c3064f0f8cd112bdc15ac23a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:56.225041 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9e0909c8-fb0d-4ee1-8402-d189453985c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ded530c3064f0f8cd112bdc15ac23a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:56.225709 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9e0909c8-fb0d-4ee1-8402-d189453985c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ded530c3064f0f8cd112bdc15ac23a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:56.226304 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9e0909c8-fb0d-4ee1-8402-d189453985c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ded530c3064f0f8cd112bdc15ac23a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:56.233979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-9e0909c8-fb0d-4ee1-8402-d189453985c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ded530c3064f0f8cd112bdc15ac23a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:56.251405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1333/2626] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:27:55 2022] DELETE /identity/v3/users/33ded530c3064f0f8cd112bdc15ac23a => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:56.638703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab5986-0b5f-4efd-9bb4-d6067d0403c9 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:56.640291 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5cab5986-0b5f-4efd-9bb4-d6067d0403c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:56.658356 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab5986-0b5f-4efd-9bb4-d6067d0403c9 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:56.719372 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003aec9-966d-4e92-88d6-73c3dcaf920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:56.720062 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003aec9-966d-4e92-88d6-73c3dcaf920d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:56.720351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003aec9-966d-4e92-88d6-73c3dcaf920d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:56.720625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003aec9-966d-4e92-88d6-73c3dcaf920d admin admin] PATH_INFO: `/v3/projects/6f157c486b6844af94f7dc9adc663574` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:56.721855 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003aec9-966d-4e92-88d6-73c3dcaf920d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f157c486b6844af94f7dc9adc663574)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:56.723765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003aec9-966d-4e92-88d6-73c3dcaf920d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:56.746252 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:56.848304 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2003aec9-966d-4e92-88d6-73c3dcaf920d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f157c486b6844af94f7dc9adc663574', 'request_id': 'req-2003aec9-966d-4e92-88d6-73c3dcaf920d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:56.853682 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2003aec9-966d-4e92-88d6-73c3dcaf920d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f157c486b6844af94f7dc9adc663574', 'request_id': 'req-2003aec9-966d-4e92-88d6-73c3dcaf920d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:56.934357 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2003aec9-966d-4e92-88d6-73c3dcaf920d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f157c486b6844af94f7dc9adc663574', 'request_id': 'req-2003aec9-966d-4e92-88d6-73c3dcaf920d'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:56.946233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2003aec9-966d-4e92-88d6-73c3dcaf920d admin admin] The token cache is being invalidate because project 6f157c486b6844af94f7dc9adc663574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:27:56.946655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2003aec9-966d-4e92-88d6-73c3dcaf920d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:56.947135 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2003aec9-966d-4e92-88d6-73c3dcaf920d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:27:56.948715 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1294/2627] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:27:56 2022] DELETE /identity/v3/projects/6f157c486b6844af94f7dc9adc663574 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:56.953868 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc4d00-fd5b-40ec-98a1-f13f535b64b1 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:56.954405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc4d00-fd5b-40ec-98a1-f13f535b64b1 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:56.954506 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc4d00-fd5b-40ec-98a1-f13f535b64b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:56.974209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d1bc4d00-fd5b-40ec-98a1-f13f535b64b1 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:56.975549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d1bc4d00-fd5b-40ec-98a1-f13f535b64b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:57.036541 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1334/2628] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:57.045153 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d85d7-b1f6-4659-be8b-f63b7869b27d None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:57.045442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d85d7-b1f6-4659-be8b-f63b7869b27d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:57.045751 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d85d7-b1f6-4659-be8b-f63b7869b27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:57.066586 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4c4d85d7-b1f6-4659-be8b-f63b7869b27d None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:57.067793 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4c4d85d7-b1f6-4659-be8b-f63b7869b27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:57.076172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1295/2629] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:57.080482 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc4d00-fd5b-40ec-98a1-f13f535b64b1 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:57.090084 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc4d00-fd5b-40ec-98a1-f13f535b64b1 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:57.094609 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de5b2c-b66d-4bb9-a7cf-a5c3b068d6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:57.095197 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de5b2c-b66d-4bb9-a7cf-a5c3b068d6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:57.095469 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de5b2c-b66d-4bb9-a7cf-a5c3b068d6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:57.095739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de5b2c-b66d-4bb9-a7cf-a5c3b068d6a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:57.096378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de5b2c-b66d-4bb9-a7cf-a5c3b068d6a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:27:57.096676 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de5b2c-b66d-4bb9-a7cf-a5c3b068d6a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:57.098291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de5b2c-b66d-4bb9-a7cf-a5c3b068d6a0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:57.110047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1335/2630] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:27:57.114278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d85d7-b1f6-4659-be8b-f63b7869b27d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:57.124455 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d85d7-b1f6-4659-be8b-f63b7869b27d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:57.129273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd57f83-cd7b-4a01-815d-3430cd7d369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:57.129915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd57f83-cd7b-4a01-815d-3430cd7d369f admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:57.130184 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd57f83-cd7b-4a01-815d-3430cd7d369f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:57.130469 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd57f83-cd7b-4a01-815d-3430cd7d369f admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:57.131070 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd57f83-cd7b-4a01-815d-3430cd7d369f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:57.132960 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd57f83-cd7b-4a01-815d-3430cd7d369f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:57.220954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1296/2631] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:27:57 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:27:57.225039 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de5b2c-b66d-4bb9-a7cf-a5c3b068d6a0 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:57.235653 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de5b2c-b66d-4bb9-a7cf-a5c3b068d6a0 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:57.265537 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:57.291139 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03c471-7db5-41a0-b3c7-0bcb91cefd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:57.292276 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03c471-7db5-41a0-b3c7-0bcb91cefd5e admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:57.292639 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03c471-7db5-41a0-b3c7-0bcb91cefd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:57.292913 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03c471-7db5-41a0-b3c7-0bcb91cefd5e admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:57.293559 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03c471-7db5-41a0-b3c7-0bcb91cefd5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:57.295497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03c471-7db5-41a0-b3c7-0bcb91cefd5e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:57.380512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1336/2632] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:27:57 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:27:57.384779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd57f83-cd7b-4a01-815d-3430cd7d369f admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:57.395675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd57f83-cd7b-4a01-815d-3430cd7d369f admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:57.400351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ace00b-62c2-41fb-90d4-c211b1f65dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:57.400996 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ace00b-62c2-41fb-90d4-c211b1f65dba admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:57.401953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ace00b-62c2-41fb-90d4-c211b1f65dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:57.402367 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ace00b-62c2-41fb-90d4-c211b1f65dba admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:57.403013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ace00b-62c2-41fb-90d4-c211b1f65dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:57.404645 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ace00b-62c2-41fb-90d4-c211b1f65dba admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:57.415268 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1297/2633] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:27:57.420035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03c471-7db5-41a0-b3c7-0bcb91cefd5e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:57.430168 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03c471-7db5-41a0-b3c7-0bcb91cefd5e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:57.435020 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34588db9-20de-429b-b731-f07bb38e9bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:57.435617 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588db9-20de-429b-b731-f07bb38e9bad admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:57.435893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588db9-20de-429b-b731-f07bb38e9bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:57.436162 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588db9-20de-429b-b731-f07bb38e9bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:57.436792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34588db9-20de-429b-b731-f07bb38e9bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:57.438417 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34588db9-20de-429b-b731-f07bb38e9bad admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:57.449109 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1337/2634] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:27:57.453594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ace00b-62c2-41fb-90d4-c211b1f65dba admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:57.464779 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ace00b-62c2-41fb-90d4-c211b1f65dba admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:57.469598 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fd608-13a2-4900-be3f-6efb17249567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:57.470252 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fd608-13a2-4900-be3f-6efb17249567 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:57.470536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fd608-13a2-4900-be3f-6efb17249567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:57.470811 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fd608-13a2-4900-be3f-6efb17249567 admin admin] PATH_INFO: `/v3/projects/2812446765604567b0a70e9a425e3edd/users/e6d11eb37c95408aa068cc045243e859/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:57.488109 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766fd608-13a2-4900-be3f-6efb17249567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2812446765604567b0a70e9a425e3edd, user_id=e6d11eb37c95408aa068cc045243e859, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:57.490727 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766fd608-13a2-4900-be3f-6efb17249567 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:57.551565 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1298/2635] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:27:57 2022] PUT /identity/v3/projects/2812446765604567b0a70e9a425e3edd/users/e6d11eb37c95408aa068cc045243e859/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:57.563233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e9974-c78f-4695-a291-7bcc4cc2bfb7 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:57.563524 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e9974-c78f-4695-a291-7bcc4cc2bfb7 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:57.563803 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e9974-c78f-4695-a291-7bcc4cc2bfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:57.592097 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-303e9974-c78f-4695-a291-7bcc4cc2bfb7 None None] MFA Rules not processed for user `e6d11eb37c95408aa068cc045243e859`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:57.593324 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-303e9974-c78f-4695-a291-7bcc4cc2bfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:57.657589 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1338/2636] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:57.662045 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fd608-13a2-4900-be3f-6efb17249567 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:57.725740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fd608-13a2-4900-be3f-6efb17249567 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:57.731218 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a246ab0-35c2-4f59-bf89-83a769d35418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:57.731848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a246ab0-35c2-4f59-bf89-83a769d35418 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:57.732127 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a246ab0-35c2-4f59-bf89-83a769d35418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:57.732399 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a246ab0-35c2-4f59-bf89-83a769d35418 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:57.733045 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a246ab0-35c2-4f59-bf89-83a769d35418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:57.735012 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a246ab0-35c2-4f59-bf89-83a769d35418 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:57.866982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1299/2637] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:27:57 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:27:57.871981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e9974-c78f-4695-a291-7bcc4cc2bfb7 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:57.883175 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e9974-c78f-4695-a291-7bcc4cc2bfb7 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:57.942878 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cb824-48a1-49c0-9593-fe802be42d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:57.943492 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cb824-48a1-49c0-9593-fe802be42d86 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:57.943773 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cb824-48a1-49c0-9593-fe802be42d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:57.944054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cb824-48a1-49c0-9593-fe802be42d86 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:57.944740 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cb824-48a1-49c0-9593-fe802be42d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:57.946850 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cb824-48a1-49c0-9593-fe802be42d86 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:58.045944 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1339/2638] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:27:57 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:27:58.046954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a246ab0-35c2-4f59-bf89-83a769d35418 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:58.059202 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a246ab0-35c2-4f59-bf89-83a769d35418 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:58.064226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0413d3f-b229-4c3c-94cb-518e9eeeffd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:58.065029 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0413d3f-b229-4c3c-94cb-518e9eeeffd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:58.065274 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0413d3f-b229-4c3c-94cb-518e9eeeffd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:58.065672 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0413d3f-b229-4c3c-94cb-518e9eeeffd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:58.066423 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0413d3f-b229-4c3c-94cb-518e9eeeffd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:58.068101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0413d3f-b229-4c3c-94cb-518e9eeeffd6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:58.082615 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1300/2639] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:27:58.086810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cb824-48a1-49c0-9593-fe802be42d86 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:58.098513 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cb824-48a1-49c0-9593-fe802be42d86 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:58.107309 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d196c0d-ea46-41f4-b42f-58b9b59c2530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:58.107987 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d196c0d-ea46-41f4-b42f-58b9b59c2530 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:58.108268 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d196c0d-ea46-41f4-b42f-58b9b59c2530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:58.108663 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d196c0d-ea46-41f4-b42f-58b9b59c2530 admin admin] PATH_INFO: `/v3/projects/574658aaf1554e7fb539cb26a50d1e91/users/e501da09ef5941fab5a39866268b28c0/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:58.125899 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d196c0d-ea46-41f4-b42f-58b9b59c2530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574658aaf1554e7fb539cb26a50d1e91, user_id=e501da09ef5941fab5a39866268b28c0, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:58.128638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d196c0d-ea46-41f4-b42f-58b9b59c2530 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:58.219979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1340/2640] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:27:58 2022] PUT /identity/v3/projects/574658aaf1554e7fb539cb26a50d1e91/users/e501da09ef5941fab5a39866268b28c0/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:58.223910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0413d3f-b229-4c3c-94cb-518e9eeeffd6 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:58.234214 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0413d3f-b229-4c3c-94cb-518e9eeeffd6 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:58.247376 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:58.292090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2403d5-0f21-405b-bb04-d80d9ad406d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:58.292698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2403d5-0f21-405b-bb04-d80d9ad406d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:58.292978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2403d5-0f21-405b-bb04-d80d9ad406d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:58.293248 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2403d5-0f21-405b-bb04-d80d9ad406d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:58.294009 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2403d5-0f21-405b-bb04-d80d9ad406d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:58.295655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2403d5-0f21-405b-bb04-d80d9ad406d4 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:58.305215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1301/2641] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:27:58.310297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d196c0d-ea46-41f4-b42f-58b9b59c2530 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:58.320533 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d196c0d-ea46-41f4-b42f-58b9b59c2530 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:58.326034 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ed8e6-c21a-4fa6-8a6e-11759a37a993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:58.330674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ed8e6-c21a-4fa6-8a6e-11759a37a993 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:58.330674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ed8e6-c21a-4fa6-8a6e-11759a37a993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:58.330674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ed8e6-c21a-4fa6-8a6e-11759a37a993 admin admin] PATH_INFO: `/v3/projects/574658aaf1554e7fb539cb26a50d1e91/users/e501da09ef5941fab5a39866268b28c0/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:58.330674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ed8e6-c21a-4fa6-8a6e-11759a37a993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574658aaf1554e7fb539cb26a50d1e91, user_id=e501da09ef5941fab5a39866268b28c0, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:58.331884 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ed8e6-c21a-4fa6-8a6e-11759a37a993 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:58.334164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:27:58.342931 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1341/2642] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:27:58 2022] PUT /identity/v3/projects/574658aaf1554e7fb539cb26a50d1e91/users/e501da09ef5941fab5a39866268b28c0/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:27:58.353113 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6609e-064b-4dc4-8fea-6cce55df8b41 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:58.353421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6609e-064b-4dc4-8fea-6cce55df8b41 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:58.353736 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6609e-064b-4dc4-8fea-6cce55df8b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:58.382124 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9fa6609e-064b-4dc4-8fea-6cce55df8b41 None None] MFA Rules not processed for user `e501da09ef5941fab5a39866268b28c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:27:58.383405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9fa6609e-064b-4dc4-8fea-6cce55df8b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:58.450454 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1302/2643] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:27:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:27:58.461901 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ed8e6-c21a-4fa6-8a6e-11759a37a993 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:27:58.463627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-747ed8e6-c21a-4fa6-8a6e-11759a37a993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:27:58.522859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ed8e6-c21a-4fa6-8a6e-11759a37a993 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:27:58.526601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7723f96-85a7-4532-a2f9-58121d703026 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:27:58.527510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7723f96-85a7-4532-a2f9-58121d703026 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:27:58.527791 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7723f96-85a7-4532-a2f9-58121d703026 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:27:58.528065 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7723f96-85a7-4532-a2f9-58121d703026 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:27:58.583824 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7723f96-85a7-4532-a2f9-58121d703026 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:27:58.585320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7723f96-85a7-4532-a2f9-58121d703026 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:27:58.594001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1342/2644] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:27:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:00.656014 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6609e-064b-4dc4-8fea-6cce55df8b41 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:00.657467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9fa6609e-064b-4dc4-8fea-6cce55df8b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:00.721987 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6609e-064b-4dc4-8fea-6cce55df8b41 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:00.726662 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec908b5a-0345-42d6-90cb-c8eb404c1b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:00.727378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec908b5a-0345-42d6-90cb-c8eb404c1b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:00.727666 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec908b5a-0345-42d6-90cb-c8eb404c1b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:00.727940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec908b5a-0345-42d6-90cb-c8eb404c1b2d admin admin] PATH_INFO: `/v3/users/eeb9a34b27b742a4be6ea7e038d786a4` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:00.729078 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec908b5a-0345-42d6-90cb-c8eb404c1b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb9a34b27b742a4be6ea7e038d786a4)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:00.731622 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec908b5a-0345-42d6-90cb-c8eb404c1b2d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:00.920046 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:00.924835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ec908b5a-0345-42d6-90cb-c8eb404c1b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb9a34b27b742a4be6ea7e038d786a4'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:00.931510 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ec908b5a-0345-42d6-90cb-c8eb404c1b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb9a34b27b742a4be6ea7e038d786a4'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:00.932183 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ec908b5a-0345-42d6-90cb-c8eb404c1b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb9a34b27b742a4be6ea7e038d786a4'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:00.933426 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ec908b5a-0345-42d6-90cb-c8eb404c1b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb9a34b27b742a4be6ea7e038d786a4'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:01.001972 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ec908b5a-0345-42d6-90cb-c8eb404c1b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb9a34b27b742a4be6ea7e038d786a4'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:01.019260 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1303/2645] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:28:00 2022] DELETE /identity/v3/users/eeb9a34b27b742a4be6ea7e038d786a4 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:01.032289 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a5839-a7ac-40ea-a95e-3db0c5976dcb None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:01.032809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a5839-a7ac-40ea-a95e-3db0c5976dcb None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:01.032809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a5839-a7ac-40ea-a95e-3db0c5976dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:01.052158 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6b0a5839-a7ac-40ea-a95e-3db0c5976dcb None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:01.053446 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6b0a5839-a7ac-40ea-a95e-3db0c5976dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:01.111060 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1343/2646] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:01.121789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec908b5a-0345-42d6-90cb-c8eb404c1b2d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:01.123201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ec908b5a-0345-42d6-90cb-c8eb404c1b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:01.181176 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec908b5a-0345-42d6-90cb-c8eb404c1b2d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:01.184979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d1360-3b6f-4826-a0eb-05c7302cc28f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:01.185632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d1360-3b6f-4826-a0eb-05c7302cc28f service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:01.185919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d1360-3b6f-4826-a0eb-05c7302cc28f service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:01.186194 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d1360-3b6f-4826-a0eb-05c7302cc28f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:01.195457 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d1360-3b6f-4826-a0eb-05c7302cc28f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:01.196901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d1360-3b6f-4826-a0eb-05c7302cc28f service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:01.206775 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1304/2647] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:01.429076 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a5839-a7ac-40ea-a95e-3db0c5976dcb None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:01.430525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6b0a5839-a7ac-40ea-a95e-3db0c5976dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:01.485545 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:01.490116 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a5839-a7ac-40ea-a95e-3db0c5976dcb None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:01.493888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d995b-5877-4303-9b8e-c355eb66a007 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:01.494498 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d995b-5877-4303-9b8e-c355eb66a007 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:01.495284 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d995b-5877-4303-9b8e-c355eb66a007 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:01.495555 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d995b-5877-4303-9b8e-c355eb66a007 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:01.497320 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c95d995b-5877-4303-9b8e-c355eb66a007 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:01.563263 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d995b-5877-4303-9b8e-c355eb66a007 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:01.564726 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d995b-5877-4303-9b8e-c355eb66a007 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:01.575023 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1344/2648] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:01.586899 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d1360-3b6f-4826-a0eb-05c7302cc28f service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:01.590961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-eb7d1360-3b6f-4826-a0eb-05c7302cc28f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:01.612585 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d1360-3b6f-4826-a0eb-05c7302cc28f service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:01.621495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46355d1a-7916-4d4c-b2bc-7879b433f770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:01.621495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46355d1a-7916-4d4c-b2bc-7879b433f770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:01.621495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46355d1a-7916-4d4c-b2bc-7879b433f770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:01.621495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46355d1a-7916-4d4c-b2bc-7879b433f770 admin admin] PATH_INFO: `/v3/projects/76b5ff582966420aa4aa101a0664e110` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:01.622062 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46355d1a-7916-4d4c-b2bc-7879b433f770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b5ff582966420aa4aa101a0664e110)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:01.622713 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46355d1a-7916-4d4c-b2bc-7879b433f770 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:01.751599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-46355d1a-7916-4d4c-b2bc-7879b433f770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b5ff582966420aa4aa101a0664e110', 'request_id': 'req-46355d1a-7916-4d4c-b2bc-7879b433f770'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:01.758789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-46355d1a-7916-4d4c-b2bc-7879b433f770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b5ff582966420aa4aa101a0664e110', 'request_id': 'req-46355d1a-7916-4d4c-b2bc-7879b433f770'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:01.808320 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-46355d1a-7916-4d4c-b2bc-7879b433f770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b5ff582966420aa4aa101a0664e110', 'request_id': 'req-46355d1a-7916-4d4c-b2bc-7879b433f770'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:01.820179 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-46355d1a-7916-4d4c-b2bc-7879b433f770 admin admin] The token cache is being invalidate because project 76b5ff582966420aa4aa101a0664e110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:28:01.820462 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-46355d1a-7916-4d4c-b2bc-7879b433f770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:01.821110 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-46355d1a-7916-4d4c-b2bc-7879b433f770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:01.822603 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1305/2649] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:28:01 2022] DELETE /identity/v3/projects/76b5ff582966420aa4aa101a0664e110 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:01.828382 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b0293-b9eb-4b2a-9921-1723c19fb55c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:01.828700 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b0293-b9eb-4b2a-9921-1723c19fb55c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:01.829152 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b0293-b9eb-4b2a-9921-1723c19fb55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:01.848312 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-c84b0293-b9eb-4b2a-9921-1723c19fb55c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:01.849548 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c84b0293-b9eb-4b2a-9921-1723c19fb55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:01.907504 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1345/2650] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:01.915668 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0ae56-de5f-4471-a139-a5e80d216834 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:01.915957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0ae56-de5f-4471-a139-a5e80d216834 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:01.916234 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0ae56-de5f-4471-a139-a5e80d216834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:01.936150 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-98b0ae56-de5f-4471-a139-a5e80d216834 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:01.937358 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-98b0ae56-de5f-4471-a139-a5e80d216834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:01.945401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1306/2651] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:01.950165 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b0293-b9eb-4b2a-9921-1723c19fb55c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:01.959679 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b0293-b9eb-4b2a-9921-1723c19fb55c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:01.964305 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91abac-f970-400a-beaf-320159fce836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:01.964888 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91abac-f970-400a-beaf-320159fce836 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:01.965165 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91abac-f970-400a-beaf-320159fce836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:01.965430 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91abac-f970-400a-beaf-320159fce836 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:01.966098 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91abac-f970-400a-beaf-320159fce836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:28:01.966397 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91abac-f970-400a-beaf-320159fce836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:01.967968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91abac-f970-400a-beaf-320159fce836 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:01.979005 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1346/2652] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:28:01.983345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0ae56-de5f-4471-a139-a5e80d216834 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:01.992626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0ae56-de5f-4471-a139-a5e80d216834 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:01.997958 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90804d8-c832-4857-a236-2e0a7e1a0a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:01.998574 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90804d8-c832-4857-a236-2e0a7e1a0a7c admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:02.000472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90804d8-c832-4857-a236-2e0a7e1a0a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:02.000472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90804d8-c832-4857-a236-2e0a7e1a0a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:02.000472 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90804d8-c832-4857-a236-2e0a7e1a0a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:02.001683 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90804d8-c832-4857-a236-2e0a7e1a0a7c admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:02.082479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1307/2653] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:28:01 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:28:02.086727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91abac-f970-400a-beaf-320159fce836 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:02.097255 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91abac-f970-400a-beaf-320159fce836 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:02.156616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba6b0b-9e3b-477e-bf33-954b363ba8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:02.157216 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba6b0b-9e3b-477e-bf33-954b363ba8ff admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:02.157528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba6b0b-9e3b-477e-bf33-954b363ba8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:02.157808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba6b0b-9e3b-477e-bf33-954b363ba8ff admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:02.158440 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba6b0b-9e3b-477e-bf33-954b363ba8ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:02.160361 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba6b0b-9e3b-477e-bf33-954b363ba8ff admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:02.252900 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1347/2654] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:28:02 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:28:02.257078 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90804d8-c832-4857-a236-2e0a7e1a0a7c admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:02.267830 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90804d8-c832-4857-a236-2e0a7e1a0a7c admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:02.272611 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da379a-b1ff-4898-a369-8619a3089956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:02.273205 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da379a-b1ff-4898-a369-8619a3089956 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:02.273515 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da379a-b1ff-4898-a369-8619a3089956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:02.273789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da379a-b1ff-4898-a369-8619a3089956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:02.274424 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da379a-b1ff-4898-a369-8619a3089956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:02.276111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da379a-b1ff-4898-a369-8619a3089956 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:02.286828 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1308/2655] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:28:02.291121 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba6b0b-9e3b-477e-bf33-954b363ba8ff admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:02.301336 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba6b0b-9e3b-477e-bf33-954b363ba8ff admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:02.306060 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8377ff6-73bf-4ef2-9226-b6bc3505481e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:02.306655 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8377ff6-73bf-4ef2-9226-b6bc3505481e admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:02.306936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8377ff6-73bf-4ef2-9226-b6bc3505481e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:02.307211 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8377ff6-73bf-4ef2-9226-b6bc3505481e admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:02.307845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8377ff6-73bf-4ef2-9226-b6bc3505481e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:02.309544 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8377ff6-73bf-4ef2-9226-b6bc3505481e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:02.319710 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1348/2656] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:28:02.323689 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da379a-b1ff-4898-a369-8619a3089956 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:02.330507 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:02.334263 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da379a-b1ff-4898-a369-8619a3089956 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:02.338941 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25143101-6fcf-4dd4-afc7-f6fa95e3b9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:02.339616 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25143101-6fcf-4dd4-afc7-f6fa95e3b9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:02.344011 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25143101-6fcf-4dd4-afc7-f6fa95e3b9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:02.344011 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25143101-6fcf-4dd4-afc7-f6fa95e3b9bb admin admin] PATH_INFO: `/v3/projects/ba86399a7e664ec69420e5bdca812fec/users/bf7208937d5743fe8a9061770c554e6b/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:02.356403 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25143101-6fcf-4dd4-afc7-f6fa95e3b9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba86399a7e664ec69420e5bdca812fec, user_id=bf7208937d5743fe8a9061770c554e6b, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:02.359131 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25143101-6fcf-4dd4-afc7-f6fa95e3b9bb admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:02.460224 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1309/2657] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:28:02 2022] PUT /identity/v3/projects/ba86399a7e664ec69420e5bdca812fec/users/bf7208937d5743fe8a9061770c554e6b/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:02.472166 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c2cb5-db47-4aa8-8a2c-0b4498dae1aa None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:02.472474 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c2cb5-db47-4aa8-8a2c-0b4498dae1aa None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:02.472753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c2cb5-db47-4aa8-8a2c-0b4498dae1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:02.480820 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:02.500810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-386c2cb5-db47-4aa8-8a2c-0b4498dae1aa None None] MFA Rules not processed for user `bf7208937d5743fe8a9061770c554e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:02.502090 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-386c2cb5-db47-4aa8-8a2c-0b4498dae1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:02.567466 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1349/2658] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:02.578474 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25143101-6fcf-4dd4-afc7-f6fa95e3b9bb admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:02.580250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-25143101-6fcf-4dd4-afc7-f6fa95e3b9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:02.761906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25143101-6fcf-4dd4-afc7-f6fa95e3b9bb admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:02.766176 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68eaa9-d74f-4cac-8697-dc5a3cb81a24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:02.766807 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68eaa9-d74f-4cac-8697-dc5a3cb81a24 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:02.767084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68eaa9-d74f-4cac-8697-dc5a3cb81a24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:02.767354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68eaa9-d74f-4cac-8697-dc5a3cb81a24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:02.775402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68eaa9-d74f-4cac-8697-dc5a3cb81a24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:02.776808 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68eaa9-d74f-4cac-8697-dc5a3cb81a24 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:02.785333 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1310/2659] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:06.659661 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c2cb5-db47-4aa8-8a2c-0b4498dae1aa None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:06.724812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c2cb5-db47-4aa8-8a2c-0b4498dae1aa None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:06.729270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b987b47-3f13-4ef2-aa42-14139c6514e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:06.729916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b987b47-3f13-4ef2-aa42-14139c6514e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:06.730193 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b987b47-3f13-4ef2-aa42-14139c6514e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:06.730461 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b987b47-3f13-4ef2-aa42-14139c6514e2 admin admin] PATH_INFO: `/v3/users/bf7208937d5743fe8a9061770c554e6b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:06.731702 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b987b47-3f13-4ef2-aa42-14139c6514e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf7208937d5743fe8a9061770c554e6b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:06.733663 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b987b47-3f13-4ef2-aa42-14139c6514e2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:06.907836 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2b987b47-3f13-4ef2-aa42-14139c6514e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf7208937d5743fe8a9061770c554e6b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:06.908881 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68eaa9-d74f-4cac-8697-dc5a3cb81a24 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:06.910422 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9f68eaa9-d74f-4cac-8697-dc5a3cb81a24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:06.924140 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68eaa9-d74f-4cac-8697-dc5a3cb81a24 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:06.928766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcafe7-ca19-40df-8440-097c221eb096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:06.929408 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcafe7-ca19-40df-8440-097c221eb096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:06.929732 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcafe7-ca19-40df-8440-097c221eb096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:06.930004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcafe7-ca19-40df-8440-097c221eb096 admin admin] PATH_INFO: `/v3/users/e6d11eb37c95408aa068cc045243e859` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:06.932674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bcafe7-ca19-40df-8440-097c221eb096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d11eb37c95408aa068cc045243e859)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:06.933298 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bcafe7-ca19-40df-8440-097c221eb096 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:06.979090 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2b987b47-3f13-4ef2-aa42-14139c6514e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf7208937d5743fe8a9061770c554e6b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:06.979696 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2b987b47-3f13-4ef2-aa42-14139c6514e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf7208937d5743fe8a9061770c554e6b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:06.980294 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2b987b47-3f13-4ef2-aa42-14139c6514e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf7208937d5743fe8a9061770c554e6b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:06.987682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2b987b47-3f13-4ef2-aa42-14139c6514e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf7208937d5743fe8a9061770c554e6b'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:07.004959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1350/2660] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:28:06 2022] DELETE /identity/v3/users/bf7208937d5743fe8a9061770c554e6b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:28:07.009160 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fbb60-ab7a-4d11-94e2-d324f967c9db None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:07.009474 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fbb60-ab7a-4d11-94e2-d324f967c9db None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:07.009754 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fbb60-ab7a-4d11-94e2-d324f967c9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:07.028443 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-0c5fbb60-ab7a-4d11-94e2-d324f967c9db None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:07.029666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0c5fbb60-ab7a-4d11-94e2-d324f967c9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:07.037532 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:07.087578 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1351/2661] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:28:07.098071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fbb60-ab7a-4d11-94e2-d324f967c9db None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:07.099509 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0c5fbb60-ab7a-4d11-94e2-d324f967c9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:07.147625 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b8bcafe7-ca19-40df-8440-097c221eb096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d11eb37c95408aa068cc045243e859'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:07.155135 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fbb60-ab7a-4d11-94e2-d324f967c9db None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:07.155300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b8bcafe7-ca19-40df-8440-097c221eb096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d11eb37c95408aa068cc045243e859'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:07.155820 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b8bcafe7-ca19-40df-8440-097c221eb096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d11eb37c95408aa068cc045243e859'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:07.156466 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b8bcafe7-ca19-40df-8440-097c221eb096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d11eb37c95408aa068cc045243e859'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:07.159050 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dbe1a-9d10-4896-8d4d-0dcff22c70f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:07.159797 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dbe1a-9d10-4896-8d4d-0dcff22c70f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:07.160015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dbe1a-9d10-4896-8d4d-0dcff22c70f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:07.160490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dbe1a-9d10-4896-8d4d-0dcff22c70f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:07.162890 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-af1dbe1a-9d10-4896-8d4d-0dcff22c70f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:07.175605 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1dbe1a-9d10-4896-8d4d-0dcff22c70f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:07.177259 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1dbe1a-9d10-4896-8d4d-0dcff22c70f2 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:07.186832 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1352/2662] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:28:07.230838 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b8bcafe7-ca19-40df-8440-097c221eb096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d11eb37c95408aa068cc045243e859'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:07.250618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1311/2663] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:28:06 2022] DELETE /identity/v3/users/e6d11eb37c95408aa068cc045243e859 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:07.254982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80289cd-8032-4dc4-abd1-390ac08d4379 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:07.255334 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80289cd-8032-4dc4-abd1-390ac08d4379 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:07.255674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80289cd-8032-4dc4-abd1-390ac08d4379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:07.277372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d80289cd-8032-4dc4-abd1-390ac08d4379 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:07.279135 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d80289cd-8032-4dc4-abd1-390ac08d4379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:07.338987 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1353/2664] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:07.350085 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcafe7-ca19-40df-8440-097c221eb096 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:07.351399 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b8bcafe7-ca19-40df-8440-097c221eb096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:07.413504 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bcafe7-ca19-40df-8440-097c221eb096 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:07.417549 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b851cb-f105-49ce-a82f-8929a640a4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:07.418458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b851cb-f105-49ce-a82f-8929a640a4fa service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:07.418648 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b851cb-f105-49ce-a82f-8929a640a4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:07.418800 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b851cb-f105-49ce-a82f-8929a640a4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:07.429339 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b851cb-f105-49ce-a82f-8929a640a4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:07.430854 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b851cb-f105-49ce-a82f-8929a640a4fa service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:07.435212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:07.441412 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1312/2665] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:07.648106 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80289cd-8032-4dc4-abd1-390ac08d4379 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:07.649607 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d80289cd-8032-4dc4-abd1-390ac08d4379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:07.674490 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80289cd-8032-4dc4-abd1-390ac08d4379 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:07.680415 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e0c22-b3b5-4308-9f51-dd661a1e0bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:07.680857 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e0c22-b3b5-4308-9f51-dd661a1e0bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:07.681137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e0c22-b3b5-4308-9f51-dd661a1e0bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:07.681551 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e0c22-b3b5-4308-9f51-dd661a1e0bbc admin admin] PATH_INFO: `/v3/projects/ba86399a7e664ec69420e5bdca812fec` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:07.682769 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e0c22-b3b5-4308-9f51-dd661a1e0bbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba86399a7e664ec69420e5bdca812fec)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:07.684748 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e0c22-b3b5-4308-9f51-dd661a1e0bbc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:07.803781 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a26e0c22-b3b5-4308-9f51-dd661a1e0bbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba86399a7e664ec69420e5bdca812fec', 'request_id': 'req-a26e0c22-b3b5-4308-9f51-dd661a1e0bbc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:07.806070 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:07.810488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a26e0c22-b3b5-4308-9f51-dd661a1e0bbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba86399a7e664ec69420e5bdca812fec', 'request_id': 'req-a26e0c22-b3b5-4308-9f51-dd661a1e0bbc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:07.893924 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a26e0c22-b3b5-4308-9f51-dd661a1e0bbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba86399a7e664ec69420e5bdca812fec', 'request_id': 'req-a26e0c22-b3b5-4308-9f51-dd661a1e0bbc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:07.906073 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a26e0c22-b3b5-4308-9f51-dd661a1e0bbc admin admin] The token cache is being invalidate because project ba86399a7e664ec69420e5bdca812fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:28:07.906285 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a26e0c22-b3b5-4308-9f51-dd661a1e0bbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:07.906969 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-a26e0c22-b3b5-4308-9f51-dd661a1e0bbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:07.908464 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1354/2666] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:28:07 2022] DELETE /identity/v3/projects/ba86399a7e664ec69420e5bdca812fec => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:07.913518 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142ae48-3e1b-4259-a1d7-19dedd4ae330 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:07.914292 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142ae48-3e1b-4259-a1d7-19dedd4ae330 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:07.914292 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142ae48-3e1b-4259-a1d7-19dedd4ae330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:07.935055 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-6142ae48-3e1b-4259-a1d7-19dedd4ae330 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:07.936243 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6142ae48-3e1b-4259-a1d7-19dedd4ae330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:08.011637 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1313/2667] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:28:08.020220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234decb9-2c16-4877-a3cf-33c94949028c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:08.020505 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234decb9-2c16-4877-a3cf-33c94949028c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:08.023563 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234decb9-2c16-4877-a3cf-33c94949028c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:08.043148 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-234decb9-2c16-4877-a3cf-33c94949028c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:08.044528 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-234decb9-2c16-4877-a3cf-33c94949028c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:08.053127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1355/2668] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:08.057728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142ae48-3e1b-4259-a1d7-19dedd4ae330 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:08.076397 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142ae48-3e1b-4259-a1d7-19dedd4ae330 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:08.079838 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234decb9-2c16-4877-a3cf-33c94949028c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:08.081142 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001d492-ff98-4021-b4a8-639ef0b9e0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:08.082454 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-234decb9-2c16-4877-a3cf-33c94949028c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:08.082606 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001d492-ff98-4021-b4a8-639ef0b9e0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:08.082606 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001d492-ff98-4021-b4a8-639ef0b9e0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:08.082606 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001d492-ff98-4021-b4a8-639ef0b9e0e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:08.082924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001d492-ff98-4021-b4a8-639ef0b9e0e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:28:08.083216 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001d492-ff98-4021-b4a8-639ef0b9e0e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:08.084917 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001d492-ff98-4021-b4a8-639ef0b9e0e8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:08.097048 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1314/2669] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:28:08.101580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001d492-ff98-4021-b4a8-639ef0b9e0e8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:08.111580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001d492-ff98-4021-b4a8-639ef0b9e0e8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:08.116356 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92350c7-d489-4034-8299-bc8c6c94e578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:08.116950 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92350c7-d489-4034-8299-bc8c6c94e578 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:08.117255 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92350c7-d489-4034-8299-bc8c6c94e578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:08.117556 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92350c7-d489-4034-8299-bc8c6c94e578 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:08.118177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92350c7-d489-4034-8299-bc8c6c94e578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:08.120054 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92350c7-d489-4034-8299-bc8c6c94e578 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:08.144304 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234decb9-2c16-4877-a3cf-33c94949028c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:08.148072 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e95a29-abbf-4630-9663-3f21f80100c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:08.148807 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e95a29-abbf-4630-9663-3f21f80100c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:08.148960 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e95a29-abbf-4630-9663-3f21f80100c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:08.149233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e95a29-abbf-4630-9663-3f21f80100c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:08.151411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-19e95a29-abbf-4630-9663-3f21f80100c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:08.213637 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1315/2670] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:28:08 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:28:08.213637 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92350c7-d489-4034-8299-bc8c6c94e578 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:08.213637 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d92350c7-d489-4034-8299-bc8c6c94e578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:08.230522 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e95a29-abbf-4630-9663-3f21f80100c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:08.232532 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e95a29-abbf-4630-9663-3f21f80100c3 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:08.244880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1356/2671] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:08.245663 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e95a29-abbf-4630-9663-3f21f80100c3 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:08.256371 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e95a29-abbf-4630-9663-3f21f80100c3 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:08.282326 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92350c7-d489-4034-8299-bc8c6c94e578 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:08.287039 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d170087-e86f-4c37-ab21-4e30c74d9501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:08.287677 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d170087-e86f-4c37-ab21-4e30c74d9501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:08.287959 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d170087-e86f-4c37-ab21-4e30c74d9501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:08.288229 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d170087-e86f-4c37-ab21-4e30c74d9501 admin admin] PATH_INFO: `/v3/projects/2812446765604567b0a70e9a425e3edd` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:08.289656 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d170087-e86f-4c37-ab21-4e30c74d9501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2812446765604567b0a70e9a425e3edd)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:08.291542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d170087-e86f-4c37-ab21-4e30c74d9501 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:08.321981 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20052acd-70ae-4308-b188-a83604d86300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:08.322711 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20052acd-70ae-4308-b188-a83604d86300 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:08.323091 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20052acd-70ae-4308-b188-a83604d86300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:08.323525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20052acd-70ae-4308-b188-a83604d86300 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:08.324183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20052acd-70ae-4308-b188-a83604d86300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:08.330162 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20052acd-70ae-4308-b188-a83604d86300 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:08.397355 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4d170087-e86f-4c37-ab21-4e30c74d9501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2812446765604567b0a70e9a425e3edd', 'request_id': 'req-4d170087-e86f-4c37-ab21-4e30c74d9501'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:08.404088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4d170087-e86f-4c37-ab21-4e30c74d9501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2812446765604567b0a70e9a425e3edd', 'request_id': 'req-4d170087-e86f-4c37-ab21-4e30c74d9501'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:08.409017 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1357/2672] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:28:08 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:28:08.413102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20052acd-70ae-4308-b188-a83604d86300 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:08.419406 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:08.423102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20052acd-70ae-4308-b188-a83604d86300 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:08.471149 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4d170087-e86f-4c37-ab21-4e30c74d9501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2812446765604567b0a70e9a425e3edd', 'request_id': 'req-4d170087-e86f-4c37-ab21-4e30c74d9501'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:08.472702 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:08.478461 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597b884-e891-4d3b-846a-bba002a1a2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:08.479233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597b884-e891-4d3b-846a-bba002a1a2bd admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:08.479412 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597b884-e891-4d3b-846a-bba002a1a2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:08.479678 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597b884-e891-4d3b-846a-bba002a1a2bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:08.480314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597b884-e891-4d3b-846a-bba002a1a2bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:08.481989 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597b884-e891-4d3b-846a-bba002a1a2bd admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:08.484016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4d170087-e86f-4c37-ab21-4e30c74d9501 admin admin] The token cache is being invalidate because project 2812446765604567b0a70e9a425e3edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:28:08.484443 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4d170087-e86f-4c37-ab21-4e30c74d9501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:08.485171 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-4d170087-e86f-4c37-ab21-4e30c74d9501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:08.486875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1316/2673] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:28:08 2022] DELETE /identity/v3/projects/2812446765604567b0a70e9a425e3edd => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:08.490782 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d170087-e86f-4c37-ab21-4e30c74d9501 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:08.491670 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1358/2674] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:28:08.492227 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4d170087-e86f-4c37-ab21-4e30c74d9501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:08.495189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597b884-e891-4d3b-846a-bba002a1a2bd admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:08.497423 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3597b884-e891-4d3b-846a-bba002a1a2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:08.506165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d170087-e86f-4c37-ab21-4e30c74d9501 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:08.510157 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597b884-e891-4d3b-846a-bba002a1a2bd admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:08.515851 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a6e0a-cde1-486e-bc21-821bf0d31e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:08.516504 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a6e0a-cde1-486e-bc21-821bf0d31e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:08.516783 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a6e0a-cde1-486e-bc21-821bf0d31e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:08.517056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a6e0a-cde1-486e-bc21-821bf0d31e9d admin admin] PATH_INFO: `/v3/users/e501da09ef5941fab5a39866268b28c0` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:08.518217 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a6e0a-cde1-486e-bc21-821bf0d31e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e501da09ef5941fab5a39866268b28c0)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:08.518357 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f55fd-e9d2-434e-8ca5-b95a4a3631c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:08.518876 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f55fd-e9d2-434e-8ca5-b95a4a3631c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:08.519158 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f55fd-e9d2-434e-8ca5-b95a4a3631c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:08.519429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f55fd-e9d2-434e-8ca5-b95a4a3631c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:08.520134 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f55fd-e9d2-434e-8ca5-b95a4a3631c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:08.520260 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a6e0a-cde1-486e-bc21-821bf0d31e9d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:08.521771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f55fd-e9d2-434e-8ca5-b95a4a3631c1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:08.532032 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1359/2675] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:28:08.536125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f55fd-e9d2-434e-8ca5-b95a4a3631c1 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:08.546566 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f55fd-e9d2-434e-8ca5-b95a4a3631c1 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:08.551616 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a1531-6493-4587-854d-d7271f3b0aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:08.552279 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a1531-6493-4587-854d-d7271f3b0aec admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:08.553123 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a1531-6493-4587-854d-d7271f3b0aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:08.553123 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a1531-6493-4587-854d-d7271f3b0aec admin admin] PATH_INFO: `/v3/projects/c98de0ece50c4bd7b966f0e39ff90a58/users/d651907b461c43c4b2811cd76c3e01cc/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:08.571263 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a1531-6493-4587-854d-d7271f3b0aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c98de0ece50c4bd7b966f0e39ff90a58, user_id=d651907b461c43c4b2811cd76c3e01cc, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:08.574091 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a1531-6493-4587-854d-d7271f3b0aec admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:08.677674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1360/2676] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:28:08 2022] PUT /identity/v3/projects/c98de0ece50c4bd7b966f0e39ff90a58/users/d651907b461c43c4b2811cd76c3e01cc/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:28:08.700804 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea190a7-8572-4cc1-a026-bd0d485cddc9 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:08.700804 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea190a7-8572-4cc1-a026-bd0d485cddc9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:08.700804 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea190a7-8572-4cc1-a026-bd0d485cddc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:08.723821 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-5ea190a7-8572-4cc1-a026-bd0d485cddc9 None None] MFA Rules not processed for user `d651907b461c43c4b2811cd76c3e01cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:08.725205 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5ea190a7-8572-4cc1-a026-bd0d485cddc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:08.796330 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1361/2677] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:28:08.807918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea190a7-8572-4cc1-a026-bd0d485cddc9 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:08.809397 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-5ea190a7-8572-4cc1-a026-bd0d485cddc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:08.846980 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-991a6e0a-cde1-486e-bc21-821bf0d31e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e501da09ef5941fab5a39866268b28c0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:08.854648 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-991a6e0a-cde1-486e-bc21-821bf0d31e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e501da09ef5941fab5a39866268b28c0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:08.855416 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-991a6e0a-cde1-486e-bc21-821bf0d31e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e501da09ef5941fab5a39866268b28c0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:08.856783 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-991a6e0a-cde1-486e-bc21-821bf0d31e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e501da09ef5941fab5a39866268b28c0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:08.867422 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea190a7-8572-4cc1-a026-bd0d485cddc9 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:08.871206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11a7bb-396e-4cae-8418-de0196cf95d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:08.872048 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11a7bb-396e-4cae-8418-de0196cf95d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:08.872326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11a7bb-396e-4cae-8418-de0196cf95d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:08.872600 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11a7bb-396e-4cae-8418-de0196cf95d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:08.874458 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8d11a7bb-396e-4cae-8418-de0196cf95d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:08.885236 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11a7bb-396e-4cae-8418-de0196cf95d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:08.886701 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11a7bb-396e-4cae-8418-de0196cf95d8 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:08.895750 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1362/2678] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:08.916848 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-991a6e0a-cde1-486e-bc21-821bf0d31e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e501da09ef5941fab5a39866268b28c0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:08.922189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11a7bb-396e-4cae-8418-de0196cf95d8 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:08.923514 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8d11a7bb-396e-4cae-8418-de0196cf95d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:08.936913 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1317/2679] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:28:08 2022] DELETE /identity/v3/users/e501da09ef5941fab5a39866268b28c0 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:08.989544 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11a7bb-396e-4cae-8418-de0196cf95d8 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:09.046093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b9bc1-3763-4248-a07c-92e5ec7134cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:09.046743 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b9bc1-3763-4248-a07c-92e5ec7134cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:09.047028 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b9bc1-3763-4248-a07c-92e5ec7134cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:09.047304 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b9bc1-3763-4248-a07c-92e5ec7134cf admin admin] PATH_INFO: `/v3/users/d651907b461c43c4b2811cd76c3e01cc` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:09.048442 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b9bc1-3763-4248-a07c-92e5ec7134cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d651907b461c43c4b2811cd76c3e01cc)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:09.050414 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b9bc1-3763-4248-a07c-92e5ec7134cf admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:09.153125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:09.251085 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2d5b9bc1-3763-4248-a07c-92e5ec7134cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd651907b461c43c4b2811cd76c3e01cc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:09.339220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2d5b9bc1-3763-4248-a07c-92e5ec7134cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd651907b461c43c4b2811cd76c3e01cc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:09.339880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2d5b9bc1-3763-4248-a07c-92e5ec7134cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd651907b461c43c4b2811cd76c3e01cc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:09.340994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2d5b9bc1-3763-4248-a07c-92e5ec7134cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd651907b461c43c4b2811cd76c3e01cc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:09.348361 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-2d5b9bc1-3763-4248-a07c-92e5ec7134cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd651907b461c43c4b2811cd76c3e01cc'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:09.374611 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1363/2680] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:28:08 2022] DELETE /identity/v3/users/d651907b461c43c4b2811cd76c3e01cc => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:09.375379 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a6e0a-cde1-486e-bc21-821bf0d31e9d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:09.378477 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-991a6e0a-cde1-486e-bc21-821bf0d31e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:09.380209 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643afa22-2088-49b9-a0e2-d02434d59d96 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:09.380438 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643afa22-2088-49b9-a0e2-d02434d59d96 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:09.380725 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643afa22-2088-49b9-a0e2-d02434d59d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:09.391927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a6e0a-cde1-486e-bc21-821bf0d31e9d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:09.401562 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-643afa22-2088-49b9-a0e2-d02434d59d96 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:09.403334 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-643afa22-2088-49b9-a0e2-d02434d59d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:09.461443 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1364/2681] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:28:09.461847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaeea3-5e68-445b-84ee-80ddc88a71d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:09.462558 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaeea3-5e68-445b-84ee-80ddc88a71d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:09.462840 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaeea3-5e68-445b-84ee-80ddc88a71d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:09.463115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaeea3-5e68-445b-84ee-80ddc88a71d7 admin admin] PATH_INFO: `/v3/projects/574658aaf1554e7fb539cb26a50d1e91` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:09.464396 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaeea3-5e68-445b-84ee-80ddc88a71d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=574658aaf1554e7fb539cb26a50d1e91)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:09.466961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaeea3-5e68-445b-84ee-80ddc88a71d7 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:09.471561 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643afa22-2088-49b9-a0e2-d02434d59d96 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:09.472959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-643afa22-2088-49b9-a0e2-d02434d59d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:09.529530 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643afa22-2088-49b9-a0e2-d02434d59d96 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:09.533293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546ce91-28e3-423d-a4b0-da4a79eb3a0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:09.533948 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546ce91-28e3-423d-a4b0-da4a79eb3a0d service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:09.534393 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546ce91-28e3-423d-a4b0-da4a79eb3a0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:09.535838 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:09.536282 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546ce91-28e3-423d-a4b0-da4a79eb3a0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:09.546452 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546ce91-28e3-423d-a4b0-da4a79eb3a0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:09.547877 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546ce91-28e3-423d-a4b0-da4a79eb3a0d service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:09.557071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1365/2682] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:28:09.611892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3dcaeea3-5e68-445b-84ee-80ddc88a71d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '574658aaf1554e7fb539cb26a50d1e91', 'request_id': 'req-3dcaeea3-5e68-445b-84ee-80ddc88a71d7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:09.618259 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3dcaeea3-5e68-445b-84ee-80ddc88a71d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '574658aaf1554e7fb539cb26a50d1e91', 'request_id': 'req-3dcaeea3-5e68-445b-84ee-80ddc88a71d7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:09.738602 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3dcaeea3-5e68-445b-84ee-80ddc88a71d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '574658aaf1554e7fb539cb26a50d1e91', 'request_id': 'req-3dcaeea3-5e68-445b-84ee-80ddc88a71d7'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:09.741416 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:09.752713 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3dcaeea3-5e68-445b-84ee-80ddc88a71d7 admin admin] The token cache is being invalidate because project 574658aaf1554e7fb539cb26a50d1e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:28:09.753065 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3dcaeea3-5e68-445b-84ee-80ddc88a71d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:09.753754 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-3dcaeea3-5e68-445b-84ee-80ddc88a71d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:09.755323 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1318/2683] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:28:09 2022] DELETE /identity/v3/projects/574658aaf1554e7fb539cb26a50d1e91 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:28:09.760641 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c334090-5ba1-403d-b124-a8cef15f005e None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:09.761195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c334090-5ba1-403d-b124-a8cef15f005e None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:09.761195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c334090-5ba1-403d-b124-a8cef15f005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:09.780984 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9c334090-5ba1-403d-b124-a8cef15f005e None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:09.782250 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9c334090-5ba1-403d-b124-a8cef15f005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:09.845647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1366/2684] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:09.853652 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af7bea-394e-4822-8818-8b3c8f9ea890 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:09.854402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af7bea-394e-4822-8818-8b3c8f9ea890 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:09.854913 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af7bea-394e-4822-8818-8b3c8f9ea890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:09.878306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-b8af7bea-394e-4822-8818-8b3c8f9ea890 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:09.879536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b8af7bea-394e-4822-8818-8b3c8f9ea890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:09.889520 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1319/2685] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:09.894259 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c334090-5ba1-403d-b124-a8cef15f005e None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:09.904950 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c334090-5ba1-403d-b124-a8cef15f005e None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:09.910379 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86ca9b-b6cc-466d-8799-2268588161d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:09.911331 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86ca9b-b6cc-466d-8799-2268588161d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:09.911784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86ca9b-b6cc-466d-8799-2268588161d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:09.912264 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86ca9b-b6cc-466d-8799-2268588161d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:09.913111 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86ca9b-b6cc-466d-8799-2268588161d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:28:09.913419 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86ca9b-b6cc-466d-8799-2268588161d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:09.915377 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86ca9b-b6cc-466d-8799-2268588161d8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:09.926186 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af7bea-394e-4822-8818-8b3c8f9ea890 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:09.927735 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b8af7bea-394e-4822-8818-8b3c8f9ea890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:09.931892 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1367/2686] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:28:09.932805 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86ca9b-b6cc-466d-8799-2268588161d8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:09.943260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86ca9b-b6cc-466d-8799-2268588161d8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:09.947848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7800a-aabb-4eac-adbf-f551973ac44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:09.948555 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7800a-aabb-4eac-adbf-f551973ac44e admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:09.948699 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7800a-aabb-4eac-adbf-f551973ac44e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:09.948970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7800a-aabb-4eac-adbf-f551973ac44e admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:09.949717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7800a-aabb-4eac-adbf-f551973ac44e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:09.951788 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7800a-aabb-4eac-adbf-f551973ac44e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:09.986891 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af7bea-394e-4822-8818-8b3c8f9ea890 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:09.990743 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e7fb9-b7a1-4488-a054-40731020f59f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:09.991278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e7fb9-b7a1-4488-a054-40731020f59f service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:09.991559 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e7fb9-b7a1-4488-a054-40731020f59f service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:09.991832 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e7fb9-b7a1-4488-a054-40731020f59f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:09.993597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-950e7fb9-b7a1-4488-a054-40731020f59f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:10.067655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e7fb9-b7a1-4488-a054-40731020f59f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:10.069086 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e7fb9-b7a1-4488-a054-40731020f59f service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:10.080640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1320/2687] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:28:10.084187 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e7fb9-b7a1-4488-a054-40731020f59f service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:10.084187 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-950e7fb9-b7a1-4488-a054-40731020f59f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:10.084430 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1368/2688] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:28:09 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:28:10.088170 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7800a-aabb-4eac-adbf-f551973ac44e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:10.101005 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e7fb9-b7a1-4488-a054-40731020f59f service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:10.130182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:10.159403 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7800a-aabb-4eac-adbf-f551973ac44e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:10.164727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afe511-9695-42db-b12c-24a7ecef8fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:10.165331 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe511-9695-42db-b12c-24a7ecef8fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:10.166208 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe511-9695-42db-b12c-24a7ecef8fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:10.166530 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe511-9695-42db-b12c-24a7ecef8fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:10.167107 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afe511-9695-42db-b12c-24a7ecef8fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:10.169859 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afe511-9695-42db-b12c-24a7ecef8fe7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:10.172975 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c06b1-9253-451c-a72b-9d6ba5ab61ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:10.177922 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c06b1-9253-451c-a72b-9d6ba5ab61ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:10.177922 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c06b1-9253-451c-a72b-9d6ba5ab61ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:10.177922 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c06b1-9253-451c-a72b-9d6ba5ab61ee admin admin] PATH_INFO: `/v3/projects/c98de0ece50c4bd7b966f0e39ff90a58` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:10.177922 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c06b1-9253-451c-a72b-9d6ba5ab61ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=c98de0ece50c4bd7b966f0e39ff90a58)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:10.177922 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c06b1-9253-451c-a72b-9d6ba5ab61ee admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:10.253942 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1369/2689] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:28:10 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:28:10.258940 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afe511-9695-42db-b12c-24a7ecef8fe7 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:10.269180 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afe511-9695-42db-b12c-24a7ecef8fe7 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:10.273893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028e965-fb53-451d-8968-5caaeb82e19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:10.274483 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028e965-fb53-451d-8968-5caaeb82e19f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:10.274765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028e965-fb53-451d-8968-5caaeb82e19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:10.275037 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028e965-fb53-451d-8968-5caaeb82e19f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:10.275790 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028e965-fb53-451d-8968-5caaeb82e19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:10.277387 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028e965-fb53-451d-8968-5caaeb82e19f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:10.288224 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1370/2690] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:28:10.294278 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028e965-fb53-451d-8968-5caaeb82e19f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:10.302560 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028e965-fb53-451d-8968-5caaeb82e19f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:10.307285 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8e6e0-b7cb-4476-87ba-225605152c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:10.307847 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8e6e0-b7cb-4476-87ba-225605152c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:10.308129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8e6e0-b7cb-4476-87ba-225605152c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:10.308404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8e6e0-b7cb-4476-87ba-225605152c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:10.309036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8e6e0-b7cb-4476-87ba-225605152c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:10.311178 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8e6e0-b7cb-4476-87ba-225605152c32 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:10.317122 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:10.326543 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1371/2691] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:28:10.329439 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a24c06b1-9253-451c-a72b-9d6ba5ab61ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c98de0ece50c4bd7b966f0e39ff90a58', 'request_id': 'req-a24c06b1-9253-451c-a72b-9d6ba5ab61ee'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:10.330681 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8e6e0-b7cb-4476-87ba-225605152c32 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:10.335066 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a24c06b1-9253-451c-a72b-9d6ba5ab61ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c98de0ece50c4bd7b966f0e39ff90a58', 'request_id': 'req-a24c06b1-9253-451c-a72b-9d6ba5ab61ee'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:10.340863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8e6e0-b7cb-4476-87ba-225605152c32 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:10.397500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa9359-b4eb-49e8-bd06-128cbb659088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:10.398165 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa9359-b4eb-49e8-bd06-128cbb659088 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:10.398446 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa9359-b4eb-49e8-bd06-128cbb659088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:10.398715 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa9359-b4eb-49e8-bd06-128cbb659088 admin admin] PATH_INFO: `/v3/projects/496eb3b3afc64a90a92bce27e131c7a9/users/08ef4a4f6d824e50bfd7e422616a79c1/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:10.413330 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa9359-b4eb-49e8-bd06-128cbb659088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=496eb3b3afc64a90a92bce27e131c7a9, user_id=08ef4a4f6d824e50bfd7e422616a79c1, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:10.416353 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa9359-b4eb-49e8-bd06-128cbb659088 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:10.425056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a24c06b1-9253-451c-a72b-9d6ba5ab61ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c98de0ece50c4bd7b966f0e39ff90a58', 'request_id': 'req-a24c06b1-9253-451c-a72b-9d6ba5ab61ee'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:10.436986 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a24c06b1-9253-451c-a72b-9d6ba5ab61ee admin admin] The token cache is being invalidate because project c98de0ece50c4bd7b966f0e39ff90a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:28:10.437283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a24c06b1-9253-451c-a72b-9d6ba5ab61ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:10.437986 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a24c06b1-9253-451c-a72b-9d6ba5ab61ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:10.439513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1321/2692] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:28:10 2022] DELETE /identity/v3/projects/c98de0ece50c4bd7b966f0e39ff90a58 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:10.444135 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cfa68-fa85-46b9-8306-ed0eac182f10 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:10.444422 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cfa68-fa85-46b9-8306-ed0eac182f10 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:10.444695 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cfa68-fa85-46b9-8306-ed0eac182f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:10.464220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c69cfa68-fa85-46b9-8306-ed0eac182f10 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:10.466181 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c69cfa68-fa85-46b9-8306-ed0eac182f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:10.474314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1322/2693] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:28:10.482846 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1372/2694] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:28:10 2022] PUT /identity/v3/projects/496eb3b3afc64a90a92bce27e131c7a9/users/08ef4a4f6d824e50bfd7e422616a79c1/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:28:10.495056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f499e-5464-4927-8d40-c66ffcbb2434 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:10.495346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f499e-5464-4927-8d40-c66ffcbb2434 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:10.495616 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f499e-5464-4927-8d40-c66ffcbb2434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:10.529873 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-b90f499e-5464-4927-8d40-c66ffcbb2434 None None] MFA Rules not processed for user `08ef4a4f6d824e50bfd7e422616a79c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:10.531101 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b90f499e-5464-4927-8d40-c66ffcbb2434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:10.541487 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43597f8d-e60b-4cdd-94dc-cb64b5c9ba39 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:10.541815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43597f8d-e60b-4cdd-94dc-cb64b5c9ba39 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:10.542051 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43597f8d-e60b-4cdd-94dc-cb64b5c9ba39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:10.565785 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-43597f8d-e60b-4cdd-94dc-cb64b5c9ba39 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:10.567659 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-43597f8d-e60b-4cdd-94dc-cb64b5c9ba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:10.611395 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1323/2695] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:10.615916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f499e-5464-4927-8d40-c66ffcbb2434 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:10.617297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b90f499e-5464-4927-8d40-c66ffcbb2434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:10.652317 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1373/2696] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:10.656830 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43597f8d-e60b-4cdd-94dc-cb64b5c9ba39 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:10.667072 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43597f8d-e60b-4cdd-94dc-cb64b5c9ba39 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:10.673625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcaa7fd-3215-41d0-8733-df23474aff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:10.674242 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaa7fd-3215-41d0-8733-df23474aff54 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:10.674521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaa7fd-3215-41d0-8733-df23474aff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:10.675618 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcaa7fd-3215-41d0-8733-df23474aff54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:10.676409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcaa7fd-3215-41d0-8733-df23474aff54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:28:10.676742 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcaa7fd-3215-41d0-8733-df23474aff54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:10.678558 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcaa7fd-3215-41d0-8733-df23474aff54 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:10.692685 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1374/2697] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:28:10.697397 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcaa7fd-3215-41d0-8733-df23474aff54 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:10.709907 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcaa7fd-3215-41d0-8733-df23474aff54 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:10.714857 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce04795-feb7-45fa-a75a-89da37929643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:10.715552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce04795-feb7-45fa-a75a-89da37929643 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:10.715897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce04795-feb7-45fa-a75a-89da37929643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:10.716515 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce04795-feb7-45fa-a75a-89da37929643 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:10.717170 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce04795-feb7-45fa-a75a-89da37929643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:10.719339 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce04795-feb7-45fa-a75a-89da37929643 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:10.725790 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f499e-5464-4927-8d40-c66ffcbb2434 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:10.731991 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:10.732174 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5fefa-a3e4-4e7e-8b1c-954498cc30c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:10.732641 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5fefa-a3e4-4e7e-8b1c-954498cc30c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:10.732928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5fefa-a3e4-4e7e-8b1c-954498cc30c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:10.733185 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5fefa-a3e4-4e7e-8b1c-954498cc30c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:10.733863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5fefa-a3e4-4e7e-8b1c-954498cc30c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:10.735762 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd5fefa-a3e4-4e7e-8b1c-954498cc30c1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:10.873806 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1324/2698] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:28:10 2022] POST /identity/v3/projects => generated 379 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:28:10.874469 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1375/2699] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:28:10 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:28:10.878205 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5fefa-a3e4-4e7e-8b1c-954498cc30c1 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:10.878472 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce04795-feb7-45fa-a75a-89da37929643 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:10.918871 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:10.948128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce04795-feb7-45fa-a75a-89da37929643 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:10.952458 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5fefa-a3e4-4e7e-8b1c-954498cc30c1 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:10.955521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b7ee6-6c8d-47de-bcbf-e876859cc2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:10.956134 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b7ee6-6c8d-47de-bcbf-e876859cc2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:10.956411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b7ee6-6c8d-47de-bcbf-e876859cc2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:10.956682 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b7ee6-6c8d-47de-bcbf-e876859cc2b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:10.957306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b7ee6-6c8d-47de-bcbf-e876859cc2b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:10.959751 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b7ee6-6c8d-47de-bcbf-e876859cc2b4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:10.959900 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf095c-b944-45bc-87d3-6bb0ada199b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:10.960789 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf095c-b944-45bc-87d3-6bb0ada199b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:10.961055 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf095c-b944-45bc-87d3-6bb0ada199b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:10.961393 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf095c-b944-45bc-87d3-6bb0ada199b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:10.966676 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf095c-b944-45bc-87d3-6bb0ada199b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:10.966676 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf095c-b944-45bc-87d3-6bb0ada199b2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:11.046185 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1376/2700] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:28:10 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:28:11.047401 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b7ee6-6c8d-47de-bcbf-e876859cc2b4 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:11.062829 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b7ee6-6c8d-47de-bcbf-e876859cc2b4 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:11.063746 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9aa31-0a56-40d9-93a7-5545b625f2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:11.064387 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9aa31-0a56-40d9-93a7-5545b625f2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:11.064670 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9aa31-0a56-40d9-93a7-5545b625f2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:11.064945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9aa31-0a56-40d9-93a7-5545b625f2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:11.065717 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9aa31-0a56-40d9-93a7-5545b625f2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:11.067221 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9aa31-0a56-40d9-93a7-5545b625f2f2 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:11.078517 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1377/2701] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:28:11.082494 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9aa31-0a56-40d9-93a7-5545b625f2f2 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:11.092249 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1325/2702] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:28:10 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:28:11.093266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf095c-b944-45bc-87d3-6bb0ada199b2 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:11.094815 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9aa31-0a56-40d9-93a7-5545b625f2f2 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:11.099792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73337c22-6341-466a-b9f0-7b41c3e15a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:11.100355 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73337c22-6341-466a-b9f0-7b41c3e15a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:11.100631 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73337c22-6341-466a-b9f0-7b41c3e15a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:11.100908 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73337c22-6341-466a-b9f0-7b41c3e15a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:11.101623 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73337c22-6341-466a-b9f0-7b41c3e15a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:11.103162 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73337c22-6341-466a-b9f0-7b41c3e15a12 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:11.104055 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf095c-b944-45bc-87d3-6bb0ada199b2 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:11.110744 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130c4d1-590c-4f3b-923a-546565295941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:11.110744 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130c4d1-590c-4f3b-923a-546565295941 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:11.110744 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130c4d1-590c-4f3b-923a-546565295941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:11.110744 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130c4d1-590c-4f3b-923a-546565295941 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:11.111366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130c4d1-590c-4f3b-923a-546565295941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:11.113130 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130c4d1-590c-4f3b-923a-546565295941 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:11.116141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1378/2703] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:28:11.119789 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73337c22-6341-466a-b9f0-7b41c3e15a12 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:11.130253 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73337c22-6341-466a-b9f0-7b41c3e15a12 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:11.133754 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1326/2704] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:28:11.135110 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130c4d1-590c-4f3b-923a-546565295941 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:11.137993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec57efa-6751-43d0-8978-651f1526fd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:11.139739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57efa-6751-43d0-8978-651f1526fd78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:11.139739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57efa-6751-43d0-8978-651f1526fd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:11.139739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57efa-6751-43d0-8978-651f1526fd78 admin admin] PATH_INFO: `/v3/projects/ad4351c434ad46acb7a1bad968960473/users/f5082693dd6e403a9ec2d4b5a4af1c98/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:11.146903 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130c4d1-590c-4f3b-923a-546565295941 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:11.152340 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6520a-6071-405a-8d0a-e26c16d38650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:11.153143 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6520a-6071-405a-8d0a-e26c16d38650 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:11.153431 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6520a-6071-405a-8d0a-e26c16d38650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:11.153740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6520a-6071-405a-8d0a-e26c16d38650 admin admin] PATH_INFO: `/v3/projects/80fda31737ad4e92a2f2ad350a4aa86b/users/6558f3675a604b53b5434274df4d4e44/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:11.155437 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec57efa-6751-43d0-8978-651f1526fd78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4351c434ad46acb7a1bad968960473, user_id=f5082693dd6e403a9ec2d4b5a4af1c98, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:11.158236 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec57efa-6751-43d0-8978-651f1526fd78 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:11.170405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6520a-6071-405a-8d0a-e26c16d38650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fda31737ad4e92a2f2ad350a4aa86b, user_id=6558f3675a604b53b5434274df4d4e44, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:11.173179 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6520a-6071-405a-8d0a-e26c16d38650 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:11.269340 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1327/2705] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:28:11 2022] PUT /identity/v3/projects/80fda31737ad4e92a2f2ad350a4aa86b/users/6558f3675a604b53b5434274df4d4e44/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:11.269776 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1379/2706] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:28:11 2022] PUT /identity/v3/projects/ad4351c434ad46acb7a1bad968960473/users/f5082693dd6e403a9ec2d4b5a4af1c98/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:28:11.270606 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6520a-6071-405a-8d0a-e26c16d38650 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:11.277517 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96624dd-5a20-469f-8734-172271c123ab None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:11.278527 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96624dd-5a20-469f-8734-172271c123ab None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:11.279088 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96624dd-5a20-469f-8734-172271c123ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:11.326157 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d96624dd-5a20-469f-8734-172271c123ab None None] MFA Rules not processed for user `f5082693dd6e403a9ec2d4b5a4af1c98`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:11.327439 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d96624dd-5a20-469f-8734-172271c123ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:11.365995 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6520a-6071-405a-8d0a-e26c16d38650 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:11.375075 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f5586-7a14-4a32-b05a-1c66baaccb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:11.377281 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f5586-7a14-4a32-b05a-1c66baaccb22 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:11.377894 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f5586-7a14-4a32-b05a-1c66baaccb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:11.378264 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f5586-7a14-4a32-b05a-1c66baaccb22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:11.379754 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f5586-7a14-4a32-b05a-1c66baaccb22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:11.383850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f5586-7a14-4a32-b05a-1c66baaccb22 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:11.403344 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1328/2707] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:28:11.408557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f5586-7a14-4a32-b05a-1c66baaccb22 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:11.420300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f5586-7a14-4a32-b05a-1c66baaccb22 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:11.425214 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1380/2708] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:11.431993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec043c-7a24-439c-a119-87f1df1a7db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:11.432659 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec043c-7a24-439c-a119-87f1df1a7db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:11.432978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec043c-7a24-439c-a119-87f1df1a7db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:11.433285 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec043c-7a24-439c-a119-87f1df1a7db7 admin admin] PATH_INFO: `/v3/projects/80fda31737ad4e92a2f2ad350a4aa86b/users/6558f3675a604b53b5434274df4d4e44/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:11.436062 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec043c-7a24-439c-a119-87f1df1a7db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fda31737ad4e92a2f2ad350a4aa86b, user_id=6558f3675a604b53b5434274df4d4e44, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:11.436498 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96624dd-5a20-469f-8734-172271c123ab None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:11.437923 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d96624dd-5a20-469f-8734-172271c123ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:11.438909 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec043c-7a24-439c-a119-87f1df1a7db7 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:11.451351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1329/2709] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:28:11 2022] PUT /identity/v3/projects/80fda31737ad4e92a2f2ad350a4aa86b/users/6558f3675a604b53b5434274df4d4e44/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:28:11.461268 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ff565-93a8-4bd0-92bd-bf9186f745c4 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:11.461621 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ff565-93a8-4bd0-92bd-bf9186f745c4 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:11.461992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ff565-93a8-4bd0-92bd-bf9186f745c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:11.468549 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:11.492606 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-df0ff565-93a8-4bd0-92bd-bf9186f745c4 None None] MFA Rules not processed for user `6558f3675a604b53b5434274df4d4e44`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:11.493863 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-df0ff565-93a8-4bd0-92bd-bf9186f745c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:11.506380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96624dd-5a20-469f-8734-172271c123ab None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:11.563336 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6e67-4362-4a6a-9865-b548bcccdc8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:11.564012 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6e67-4362-4a6a-9865-b548bcccdc8b service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:11.564314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6e67-4362-4a6a-9865-b548bcccdc8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:11.564595 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6e67-4362-4a6a-9865-b548bcccdc8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:11.565539 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:11.585056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1330/2710] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:28:11.599017 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ff565-93a8-4bd0-92bd-bf9186f745c4 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:11.600475 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-df0ff565-93a8-4bd0-92bd-bf9186f745c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:11.613729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ff565-93a8-4bd0-92bd-bf9186f745c4 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:11.617694 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5276f6-c1de-4102-b735-57aee9b82b88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:11.618313 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5276f6-c1de-4102-b735-57aee9b82b88 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:11.618597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5276f6-c1de-4102-b735-57aee9b82b88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:11.618871 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5276f6-c1de-4102-b735-57aee9b82b88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:11.629326 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5276f6-c1de-4102-b735-57aee9b82b88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:11.630890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5276f6-c1de-4102-b735-57aee9b82b88 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:11.647510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a6e67-4362-4a6a-9865-b548bcccdc8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:11.649429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a6e67-4362-4a6a-9865-b548bcccdc8b service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:11.657545 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1331/2711] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:11.675115 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1381/2712] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:28:12.839865 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5276f6-c1de-4102-b735-57aee9b82b88 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:12.849179 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5276f6-c1de-4102-b735-57aee9b82b88 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:12.853829 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c5cb5-9178-4f0f-a273-949a14565d1c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6558f3675a604b53b5434274df4d4e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80fda31737ad4e92a2f2ad350a4aa86b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:12.854421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c5cb5-9178-4f0f-a273-949a14565d1c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:12.854739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c5cb5-9178-4f0f-a273-949a14565d1c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:12.855014 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c5cb5-9178-4f0f-a273-949a14565d1c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:12.855678 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c5cb5-9178-4f0f-a273-949a14565d1c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:28:12.856673 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c5cb5-9178-4f0f-a273-949a14565d1c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:12.858361 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c5cb5-9178-4f0f-a273-949a14565d1c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:12.869892 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1332/2713] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:28:12.874862 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6e67-4362-4a6a-9865-b548bcccdc8b service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:12.885319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6e67-4362-4a6a-9865-b548bcccdc8b service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:12.889925 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde6adb-ba84-4d1a-8fd9-bbfdeab6a006 tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6558f3675a604b53b5434274df4d4e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80fda31737ad4e92a2f2ad350a4aa86b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:12.890520 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde6adb-ba84-4d1a-8fd9-bbfdeab6a006 tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:12.890799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde6adb-ba84-4d1a-8fd9-bbfdeab6a006 tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:12.891074 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde6adb-ba84-4d1a-8fd9-bbfdeab6a006 tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:12.891691 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde6adb-ba84-4d1a-8fd9-bbfdeab6a006 tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:12.893598 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde6adb-ba84-4d1a-8fd9-bbfdeab6a006 tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:12.992768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1382/2714] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:28:12 2022] POST /identity/v3/projects => generated 354 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:28:12.997692 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c5cb5-9178-4f0f-a273-949a14565d1c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:13.008034 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c5cb5-9178-4f0f-a273-949a14565d1c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:13.064990 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78702d-7e3b-4457-81ab-902952a795cc tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6558f3675a604b53b5434274df4d4e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80fda31737ad4e92a2f2ad350a4aa86b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:13.065632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78702d-7e3b-4457-81ab-902952a795cc tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:13.065919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78702d-7e3b-4457-81ab-902952a795cc tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:13.066197 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78702d-7e3b-4457-81ab-902952a795cc tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:13.066850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78702d-7e3b-4457-81ab-902952a795cc tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:28:13.067158 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78702d-7e3b-4457-81ab-902952a795cc tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:13.068748 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78702d-7e3b-4457-81ab-902952a795cc tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:13.081042 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1333/2715] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:28:13.117814 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde6adb-ba84-4d1a-8fd9-bbfdeab6a006 tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:13.128204 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde6adb-ba84-4d1a-8fd9-bbfdeab6a006 tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:13.132674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0751a-721b-49b8-a53f-d21c9433c34c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6558f3675a604b53b5434274df4d4e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80fda31737ad4e92a2f2ad350a4aa86b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:13.133291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0751a-721b-49b8-a53f-d21c9433c34c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:13.133603 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0751a-721b-49b8-a53f-d21c9433c34c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:13.133877 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0751a-721b-49b8-a53f-d21c9433c34c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] PATH_INFO: `/v3/projects/5ecd9f29ee754ce1878fb809b1b96337` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:13.134986 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0751a-721b-49b8-a53f-d21c9433c34c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5ecd9f29ee754ce1878fb809b1b96337)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:13.136879 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0751a-721b-49b8-a53f-d21c9433c34c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:13.254097 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-98f0751a-721b-49b8-a53f-d21c9433c34c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ecd9f29ee754ce1878fb809b1b96337', 'request_id': 'req-98f0751a-721b-49b8-a53f-d21c9433c34c'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:13.259424 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-98f0751a-721b-49b8-a53f-d21c9433c34c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ecd9f29ee754ce1878fb809b1b96337', 'request_id': 'req-98f0751a-721b-49b8-a53f-d21c9433c34c'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:13.332836 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-98f0751a-721b-49b8-a53f-d21c9433c34c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ecd9f29ee754ce1878fb809b1b96337', 'request_id': 'req-98f0751a-721b-49b8-a53f-d21c9433c34c'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:13.334087 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:13.345893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-98f0751a-721b-49b8-a53f-d21c9433c34c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] The token cache is being invalidate because project 5ecd9f29ee754ce1878fb809b1b96337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:28:13.346178 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-98f0751a-721b-49b8-a53f-d21c9433c34c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:13.346822 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-98f0751a-721b-49b8-a53f-d21c9433c34c tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:13.348299 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1383/2716] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:28:13 2022] DELETE /identity/v3/projects/5ecd9f29ee754ce1878fb809b1b96337 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:14.054121 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78702d-7e3b-4457-81ab-902952a795cc tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:14.056156 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0a78702d-7e3b-4457-81ab-902952a795cc tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:14.131107 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78702d-7e3b-4457-81ab-902952a795cc tempest-VolumeQuotaClassesTest-170616247 tempest-VolumeQuotaClassesTest-170616247-project-admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:14.191259 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec576f-c572-44f0-ad76-5e87360fbffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:14.191893 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec576f-c572-44f0-ad76-5e87360fbffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:14.192180 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec576f-c572-44f0-ad76-5e87360fbffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:14.192555 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec576f-c572-44f0-ad76-5e87360fbffe admin admin] PATH_INFO: `/v3/users/08ef4a4f6d824e50bfd7e422616a79c1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:14.193733 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec576f-c572-44f0-ad76-5e87360fbffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=08ef4a4f6d824e50bfd7e422616a79c1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:14.195699 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec576f-c572-44f0-ad76-5e87360fbffe admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:14.201385 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:14.378798 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-13ec576f-c572-44f0-ad76-5e87360fbffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08ef4a4f6d824e50bfd7e422616a79c1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:14.386479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-13ec576f-c572-44f0-ad76-5e87360fbffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08ef4a4f6d824e50bfd7e422616a79c1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:14.387429 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-13ec576f-c572-44f0-ad76-5e87360fbffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08ef4a4f6d824e50bfd7e422616a79c1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:14.388338 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-13ec576f-c572-44f0-ad76-5e87360fbffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08ef4a4f6d824e50bfd7e422616a79c1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:14.453290 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-13ec576f-c572-44f0-ad76-5e87360fbffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08ef4a4f6d824e50bfd7e422616a79c1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:14.474306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1334/2717] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:28:14 2022] DELETE /identity/v3/users/08ef4a4f6d824e50bfd7e422616a79c1 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:28:14.478881 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdaf4f2-5a51-49e9-b7aa-f7aa41be6959 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:14.479367 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdaf4f2-5a51-49e9-b7aa-f7aa41be6959 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:14.479367 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdaf4f2-5a51-49e9-b7aa-f7aa41be6959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:14.501760 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-bcdaf4f2-5a51-49e9-b7aa-f7aa41be6959 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:14.503084 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bcdaf4f2-5a51-49e9-b7aa-f7aa41be6959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:14.574219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1384/2718] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:14.584522 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec576f-c572-44f0-ad76-5e87360fbffe admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:14.586010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-13ec576f-c572-44f0-ad76-5e87360fbffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:14.646576 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec576f-c572-44f0-ad76-5e87360fbffe admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:14.650284 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedafd0-9cc6-4f43-9c5d-c7ff7fed2685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:14.650894 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedafd0-9cc6-4f43-9c5d-c7ff7fed2685 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:14.651172 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedafd0-9cc6-4f43-9c5d-c7ff7fed2685 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:14.651440 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedafd0-9cc6-4f43-9c5d-c7ff7fed2685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:14.664577 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aedafd0-9cc6-4f43-9c5d-c7ff7fed2685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:14.666160 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aedafd0-9cc6-4f43-9c5d-c7ff7fed2685 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:14.676095 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1335/2719] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:15.122772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdaf4f2-5a51-49e9-b7aa-f7aa41be6959 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:15.125001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bcdaf4f2-5a51-49e9-b7aa-f7aa41be6959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:15.139003 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdaf4f2-5a51-49e9-b7aa-f7aa41be6959 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:15.143764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18d699-ba61-403c-a05c-d597d76644df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:15.145139 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18d699-ba61-403c-a05c-d597d76644df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:15.145428 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18d699-ba61-403c-a05c-d597d76644df admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:15.145729 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18d699-ba61-403c-a05c-d597d76644df admin admin] PATH_INFO: `/v3/projects/496eb3b3afc64a90a92bce27e131c7a9` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:15.146916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18d699-ba61-403c-a05c-d597d76644df admin admin] RBAC: Authorizing `identity:delete_project(project_id=496eb3b3afc64a90a92bce27e131c7a9)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:15.148796 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18d699-ba61-403c-a05c-d597d76644df admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:15.293952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ff18d699-ba61-403c-a05c-d597d76644df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '496eb3b3afc64a90a92bce27e131c7a9', 'request_id': 'req-ff18d699-ba61-403c-a05c-d597d76644df'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:15.299709 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ff18d699-ba61-403c-a05c-d597d76644df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '496eb3b3afc64a90a92bce27e131c7a9', 'request_id': 'req-ff18d699-ba61-403c-a05c-d597d76644df'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:15.356711 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ff18d699-ba61-403c-a05c-d597d76644df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '496eb3b3afc64a90a92bce27e131c7a9', 'request_id': 'req-ff18d699-ba61-403c-a05c-d597d76644df'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:15.368955 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ff18d699-ba61-403c-a05c-d597d76644df admin admin] The token cache is being invalidate because project 496eb3b3afc64a90a92bce27e131c7a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:28:15.369186 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ff18d699-ba61-403c-a05c-d597d76644df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:15.369848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ff18d699-ba61-403c-a05c-d597d76644df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:15.371349 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1385/2720] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:28:15 2022] DELETE /identity/v3/projects/496eb3b3afc64a90a92bce27e131c7a9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:28:15.375955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedafd0-9cc6-4f43-9c5d-c7ff7fed2685 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:15.385801 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedafd0-9cc6-4f43-9c5d-c7ff7fed2685 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:15.442025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8116056-f148-4bec-af0a-8ff4433ed017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:15.442647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8116056-f148-4bec-af0a-8ff4433ed017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:15.442924 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8116056-f148-4bec-af0a-8ff4433ed017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:15.443224 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8116056-f148-4bec-af0a-8ff4433ed017 admin admin] PATH_INFO: `/v3/users/6558f3675a604b53b5434274df4d4e44` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:15.444297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8116056-f148-4bec-af0a-8ff4433ed017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6558f3675a604b53b5434274df4d4e44)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:15.446246 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8116056-f148-4bec-af0a-8ff4433ed017 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:15.660450 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:15.673984 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b8116056-f148-4bec-af0a-8ff4433ed017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6558f3675a604b53b5434274df4d4e44'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:15.680620 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b8116056-f148-4bec-af0a-8ff4433ed017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6558f3675a604b53b5434274df4d4e44'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:15.681342 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b8116056-f148-4bec-af0a-8ff4433ed017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6558f3675a604b53b5434274df4d4e44'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:15.681967 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b8116056-f148-4bec-af0a-8ff4433ed017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6558f3675a604b53b5434274df4d4e44'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:15.756442 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b8116056-f148-4bec-af0a-8ff4433ed017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6558f3675a604b53b5434274df4d4e44'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:15.774384 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1336/2721] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:28:15 2022] DELETE /identity/v3/users/6558f3675a604b53b5434274df4d4e44 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:16.254600 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18d699-ba61-403c-a05c-d597d76644df admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:16.256067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ff18d699-ba61-403c-a05c-d597d76644df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:16.272125 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18d699-ba61-403c-a05c-d597d76644df admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:16.330453 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a2003-19b5-4714-b557-b93d0d42be3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:16.331064 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a2003-19b5-4714-b557-b93d0d42be3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:16.331346 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a2003-19b5-4714-b557-b93d0d42be3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:16.331615 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a2003-19b5-4714-b557-b93d0d42be3f admin admin] PATH_INFO: `/v3/projects/80fda31737ad4e92a2f2ad350a4aa86b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:16.332727 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a2003-19b5-4714-b557-b93d0d42be3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=80fda31737ad4e92a2f2ad350a4aa86b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:16.334678 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a2003-19b5-4714-b557-b93d0d42be3f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:16.355645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:16.424179 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-979a2003-19b5-4714-b557-b93d0d42be3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80fda31737ad4e92a2f2ad350a4aa86b', 'request_id': 'req-979a2003-19b5-4714-b557-b93d0d42be3f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:16.430780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-979a2003-19b5-4714-b557-b93d0d42be3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80fda31737ad4e92a2f2ad350a4aa86b', 'request_id': 'req-979a2003-19b5-4714-b557-b93d0d42be3f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:16.511877 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-979a2003-19b5-4714-b557-b93d0d42be3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80fda31737ad4e92a2f2ad350a4aa86b', 'request_id': 'req-979a2003-19b5-4714-b557-b93d0d42be3f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:16.525091 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-979a2003-19b5-4714-b557-b93d0d42be3f admin admin] The token cache is being invalidate because project 80fda31737ad4e92a2f2ad350a4aa86b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:28:16.525521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-979a2003-19b5-4714-b557-b93d0d42be3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:16.527872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-979a2003-19b5-4714-b557-b93d0d42be3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:16.527872 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1386/2722] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:28:16 2022] DELETE /identity/v3/projects/80fda31737ad4e92a2f2ad350a4aa86b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:16.533164 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c580d-67fe-4d2a-b0d5-43f7747d889a None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:16.533673 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c580d-67fe-4d2a-b0d5-43f7747d889a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:16.533887 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c580d-67fe-4d2a-b0d5-43f7747d889a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:16.554299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-6f8c580d-67fe-4d2a-b0d5-43f7747d889a None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:16.555602 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-6f8c580d-67fe-4d2a-b0d5-43f7747d889a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:16.616537 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1337/2723] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:16.626143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ee97e-13b2-4339-835d-59fb8e02a576 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:16.626430 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ee97e-13b2-4339-835d-59fb8e02a576 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:16.626707 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ee97e-13b2-4339-835d-59fb8e02a576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:16.647259 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-0e1ee97e-13b2-4339-835d-59fb8e02a576 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:16.648500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0e1ee97e-13b2-4339-835d-59fb8e02a576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:16.656696 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1387/2724] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:16.660884 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c580d-67fe-4d2a-b0d5-43f7747d889a None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:16.671506 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c580d-67fe-4d2a-b0d5-43f7747d889a None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:16.676213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4621287-78eb-46c5-93dd-75f9fe167736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:16.676812 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4621287-78eb-46c5-93dd-75f9fe167736 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:16.677087 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4621287-78eb-46c5-93dd-75f9fe167736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:16.677351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4621287-78eb-46c5-93dd-75f9fe167736 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:16.678031 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4621287-78eb-46c5-93dd-75f9fe167736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:28:16.678348 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4621287-78eb-46c5-93dd-75f9fe167736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:16.679927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4621287-78eb-46c5-93dd-75f9fe167736 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:16.692274 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1338/2725] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:28:16.697176 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ee97e-13b2-4339-835d-59fb8e02a576 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:16.705891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ee97e-13b2-4339-835d-59fb8e02a576 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:16.710520 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ff467-0133-4fbc-9b51-e01c70b22b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:16.711107 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ff467-0133-4fbc-9b51-e01c70b22b36 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:16.711380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ff467-0133-4fbc-9b51-e01c70b22b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:16.711646 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ff467-0133-4fbc-9b51-e01c70b22b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:16.712269 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ff467-0133-4fbc-9b51-e01c70b22b36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:16.714220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ff467-0133-4fbc-9b51-e01c70b22b36 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:16.826609 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1388/2726] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:28:16 2022] POST /identity/v3/projects => generated 397 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:28:16.830923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4621287-78eb-46c5-93dd-75f9fe167736 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:16.841642 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4621287-78eb-46c5-93dd-75f9fe167736 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:16.899213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806e7aa-f331-458e-84af-47fa1f9bb53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:16.899815 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806e7aa-f331-458e-84af-47fa1f9bb53b admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:16.900092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806e7aa-f331-458e-84af-47fa1f9bb53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:16.900363 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806e7aa-f331-458e-84af-47fa1f9bb53b admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:16.900987 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806e7aa-f331-458e-84af-47fa1f9bb53b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:16.903515 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806e7aa-f331-458e-84af-47fa1f9bb53b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:16.999056 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1339/2727] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:28:16 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:28:17.002938 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ff467-0133-4fbc-9b51-e01c70b22b36 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:17.015978 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ff467-0133-4fbc-9b51-e01c70b22b36 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:17.021728 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ff61e-cd42-43db-811b-9e6d9631ca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:17.022800 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ff61e-cd42-43db-811b-9e6d9631ca01 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:17.023232 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ff61e-cd42-43db-811b-9e6d9631ca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:17.023828 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ff61e-cd42-43db-811b-9e6d9631ca01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:17.024640 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ff61e-cd42-43db-811b-9e6d9631ca01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:17.026596 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ff61e-cd42-43db-811b-9e6d9631ca01 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:17.040534 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1389/2728] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:28:17.045177 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806e7aa-f331-458e-84af-47fa1f9bb53b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:17.055546 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806e7aa-f331-458e-84af-47fa1f9bb53b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:17.060573 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d9b0d-a495-4940-a5f2-cb5162d4957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:17.061176 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d9b0d-a495-4940-a5f2-cb5162d4957b admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:17.061568 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d9b0d-a495-4940-a5f2-cb5162d4957b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:17.061840 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d9b0d-a495-4940-a5f2-cb5162d4957b admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:17.062476 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d9b0d-a495-4940-a5f2-cb5162d4957b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:17.064050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d9b0d-a495-4940-a5f2-cb5162d4957b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:17.076620 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1340/2729] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:28:17.085870 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ff61e-cd42-43db-811b-9e6d9631ca01 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:17.097574 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ff61e-cd42-43db-811b-9e6d9631ca01 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:17.104407 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88470f-9354-48b1-b69d-38b6a7809306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:17.105064 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88470f-9354-48b1-b69d-38b6a7809306 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:17.105518 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88470f-9354-48b1-b69d-38b6a7809306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:17.105797 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88470f-9354-48b1-b69d-38b6a7809306 admin admin] PATH_INFO: `/v3/projects/bf88993bee36470d9cdeee47fb8f740e/users/bf7eebccce3641cab28e729d6009b28c/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:17.125213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88470f-9354-48b1-b69d-38b6a7809306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf88993bee36470d9cdeee47fb8f740e, user_id=bf7eebccce3641cab28e729d6009b28c, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:17.125213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88470f-9354-48b1-b69d-38b6a7809306 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:17.235640 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1390/2730] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:28:17 2022] PUT /identity/v3/projects/bf88993bee36470d9cdeee47fb8f740e/users/bf7eebccce3641cab28e729d6009b28c/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:17.245815 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b2db5-a391-4f87-90aa-9ac41df8302b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:17.246131 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b2db5-a391-4f87-90aa-9ac41df8302b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:17.246591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b2db5-a391-4f87-90aa-9ac41df8302b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:17.273529 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:17.276819 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3a4b2db5-a391-4f87-90aa-9ac41df8302b None None] MFA Rules not processed for user `bf7eebccce3641cab28e729d6009b28c`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:17.278993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3a4b2db5-a391-4f87-90aa-9ac41df8302b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:17.343464 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1341/2731] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:17 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:17.348472 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88470f-9354-48b1-b69d-38b6a7809306 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:17.413140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88470f-9354-48b1-b69d-38b6a7809306 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:17.418143 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34cc6d-c6aa-414d-b8eb-24a1f0bb28e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:17.418773 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34cc6d-c6aa-414d-b8eb-24a1f0bb28e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:17.419063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34cc6d-c6aa-414d-b8eb-24a1f0bb28e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:17.419330 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34cc6d-c6aa-414d-b8eb-24a1f0bb28e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:17.419962 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34cc6d-c6aa-414d-b8eb-24a1f0bb28e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:17.421946 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34cc6d-c6aa-414d-b8eb-24a1f0bb28e0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:17.508203 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1391/2732] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:28:17 2022] POST /identity/v3/projects => generated 401 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:28:17.510940 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b2db5-a391-4f87-90aa-9ac41df8302b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:17.522411 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b2db5-a391-4f87-90aa-9ac41df8302b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:17.583273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef76706-8671-4ec2-9904-3668661fcff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:17.583895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef76706-8671-4ec2-9904-3668661fcff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:17.584211 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef76706-8671-4ec2-9904-3668661fcff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:17.584482 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef76706-8671-4ec2-9904-3668661fcff0 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:17.585111 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef76706-8671-4ec2-9904-3668661fcff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:17.587064 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef76706-8671-4ec2-9904-3668661fcff0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:17.695469 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1342/2733] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:28:17 2022] POST /identity/v3/users => generated 307 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:28:17.700740 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34cc6d-c6aa-414d-b8eb-24a1f0bb28e0 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:17.711067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34cc6d-c6aa-414d-b8eb-24a1f0bb28e0 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:17.715772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285e7b5-999b-41a4-85bc-f98b1e11b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:17.716381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285e7b5-999b-41a4-85bc-f98b1e11b27f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:17.716658 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285e7b5-999b-41a4-85bc-f98b1e11b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:17.716930 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285e7b5-999b-41a4-85bc-f98b1e11b27f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:17.717596 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285e7b5-999b-41a4-85bc-f98b1e11b27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:17.719294 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285e7b5-999b-41a4-85bc-f98b1e11b27f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:17.730341 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1392/2734] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:28:17.734594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef76706-8671-4ec2-9904-3668661fcff0 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:17.744506 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef76706-8671-4ec2-9904-3668661fcff0 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:17.749865 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce987c-3486-455a-8aaa-b5630f526f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:17.750525 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce987c-3486-455a-8aaa-b5630f526f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:17.750805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce987c-3486-455a-8aaa-b5630f526f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:17.751084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce987c-3486-455a-8aaa-b5630f526f5d admin admin] PATH_INFO: `/v3/projects/3d88a8003a7d42cc9619654ea5693b50/users/bdad1ded88f34342963e35320cc880ba/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:17.768206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce987c-3486-455a-8aaa-b5630f526f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d88a8003a7d42cc9619654ea5693b50, user_id=bdad1ded88f34342963e35320cc880ba, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:17.770919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce987c-3486-455a-8aaa-b5630f526f5d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:17.854252 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1343/2735] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:28:17 2022] PUT /identity/v3/projects/3d88a8003a7d42cc9619654ea5693b50/users/bdad1ded88f34342963e35320cc880ba/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:28:17.866317 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285e7b5-999b-41a4-85bc-f98b1e11b27f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:17.876792 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285e7b5-999b-41a4-85bc-f98b1e11b27f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:17.889935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:17.932545 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731232d-ee7a-43f3-b8ee-c8e30241a7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:17.933138 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731232d-ee7a-43f3-b8ee-c8e30241a7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:17.933416 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731232d-ee7a-43f3-b8ee-c8e30241a7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:17.933720 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731232d-ee7a-43f3-b8ee-c8e30241a7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:17.935042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731232d-ee7a-43f3-b8ee-c8e30241a7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:17.936636 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731232d-ee7a-43f3-b8ee-c8e30241a7c4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:17.946090 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1393/2736] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:28:17.950494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce987c-3486-455a-8aaa-b5630f526f5d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:17.960839 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce987c-3486-455a-8aaa-b5630f526f5d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:17.965717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a76c6-1e10-49aa-ad17-cfa4594019a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:17.966476 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a76c6-1e10-49aa-ad17-cfa4594019a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:17.966805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a76c6-1e10-49aa-ad17-cfa4594019a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:17.967087 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a76c6-1e10-49aa-ad17-cfa4594019a1 admin admin] PATH_INFO: `/v3/projects/3d88a8003a7d42cc9619654ea5693b50/users/bdad1ded88f34342963e35320cc880ba/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:17.968979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a76c6-1e10-49aa-ad17-cfa4594019a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d88a8003a7d42cc9619654ea5693b50, user_id=bdad1ded88f34342963e35320cc880ba, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:17.971742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a76c6-1e10-49aa-ad17-cfa4594019a1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:17.983091 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1344/2737] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:28:17 2022] PUT /identity/v3/projects/3d88a8003a7d42cc9619654ea5693b50/users/bdad1ded88f34342963e35320cc880ba/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:17.993326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a87d9-f9d0-48ae-b25a-fc4a7026ed87 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:17.993668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a87d9-f9d0-48ae-b25a-fc4a7026ed87 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:17.993950 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a87d9-f9d0-48ae-b25a-fc4a7026ed87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:18.022220 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-407a87d9-f9d0-48ae-b25a-fc4a7026ed87 None None] MFA Rules not processed for user `bdad1ded88f34342963e35320cc880ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:18.023419 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-407a87d9-f9d0-48ae-b25a-fc4a7026ed87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:18.094566 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1394/2738] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:17 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:18.105707 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a76c6-1e10-49aa-ad17-cfa4594019a1 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:18.108595 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ae1a76c6-1e10-49aa-ad17-cfa4594019a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:18.166045 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a76c6-1e10-49aa-ad17-cfa4594019a1 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:18.170479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412eecf-aee4-4291-b508-366709f09ad4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:18.171123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412eecf-aee4-4291-b508-366709f09ad4 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:18.171401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412eecf-aee4-4291-b508-366709f09ad4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:18.171673 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412eecf-aee4-4291-b508-366709f09ad4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:18.180556 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412eecf-aee4-4291-b508-366709f09ad4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:18.182015 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412eecf-aee4-4291-b508-366709f09ad4 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:18.186730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:18.192588 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1345/2739] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:18 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:18.388568 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a87d9-f9d0-48ae-b25a-fc4a7026ed87 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:18.398212 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a87d9-f9d0-48ae-b25a-fc4a7026ed87 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:18.401759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94a5b0-e779-480d-8205-03dd4845c878 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:18.402352 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94a5b0-e779-480d-8205-03dd4845c878 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:18.402629 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94a5b0-e779-480d-8205-03dd4845c878 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:18.403140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94a5b0-e779-480d-8205-03dd4845c878 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:18.458939 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94a5b0-e779-480d-8205-03dd4845c878 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:18.460366 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94a5b0-e779-480d-8205-03dd4845c878 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:18.469304 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1395/2740] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:18 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:23.611528 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412eecf-aee4-4291-b508-366709f09ad4 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:23.679375 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412eecf-aee4-4291-b508-366709f09ad4 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:23.684095 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ccd7fd-6d86-412d-a4fa-a0ab5f0ec0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:23.684729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccd7fd-6d86-412d-a4fa-a0ab5f0ec0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:23.685013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccd7fd-6d86-412d-a4fa-a0ab5f0ec0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:23.685307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ccd7fd-6d86-412d-a4fa-a0ab5f0ec0ea admin admin] PATH_INFO: `/v3/users/bf7eebccce3641cab28e729d6009b28c` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:23.686604 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ccd7fd-6d86-412d-a4fa-a0ab5f0ec0ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf7eebccce3641cab28e729d6009b28c)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:23.688536 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ccd7fd-6d86-412d-a4fa-a0ab5f0ec0ea admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:23.862859 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b3ccd7fd-6d86-412d-a4fa-a0ab5f0ec0ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf7eebccce3641cab28e729d6009b28c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:23.870424 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b3ccd7fd-6d86-412d-a4fa-a0ab5f0ec0ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf7eebccce3641cab28e729d6009b28c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:23.871207 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b3ccd7fd-6d86-412d-a4fa-a0ab5f0ec0ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf7eebccce3641cab28e729d6009b28c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:23.871869 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b3ccd7fd-6d86-412d-a4fa-a0ab5f0ec0ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf7eebccce3641cab28e729d6009b28c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:23.916527 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-b3ccd7fd-6d86-412d-a4fa-a0ab5f0ec0ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf7eebccce3641cab28e729d6009b28c'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:23.934624 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1346/2741] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:28:23 2022] DELETE /identity/v3/users/bf7eebccce3641cab28e729d6009b28c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:23.939106 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ef2a8-934c-44c2-96bf-3380c6a350ee None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:23.939597 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ef2a8-934c-44c2-96bf-3380c6a350ee None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:23.939729 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ef2a8-934c-44c2-96bf-3380c6a350ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:23.959192 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-6d4ef2a8-934c-44c2-96bf-3380c6a350ee None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:23.960742 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6d4ef2a8-934c-44c2-96bf-3380c6a350ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:24.002942 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=100 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:24.028649 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1396/2742] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:24.039527 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ccd7fd-6d86-412d-a4fa-a0ab5f0ec0ea admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:24.041038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-b3ccd7fd-6d86-412d-a4fa-a0ab5f0ec0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:24.099901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ccd7fd-6d86-412d-a4fa-a0ab5f0ec0ea admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:24.103858 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264290e-081e-478e-a0b7-dc42b4161e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:24.104474 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264290e-081e-478e-a0b7-dc42b4161e8b service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:24.104754 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264290e-081e-478e-a0b7-dc42b4161e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:24.105028 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264290e-081e-478e-a0b7-dc42b4161e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:24.114334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264290e-081e-478e-a0b7-dc42b4161e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:24.115849 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264290e-081e-478e-a0b7-dc42b4161e8b service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:24.125910 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1347/2743] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:24.777919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ef2a8-934c-44c2-96bf-3380c6a350ee None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:24.779661 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6d4ef2a8-934c-44c2-96bf-3380c6a350ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:24.791707 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ef2a8-934c-44c2-96bf-3380c6a350ee None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:24.797279 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad9b59-b913-473c-b9c4-47b46331e39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:24.797863 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad9b59-b913-473c-b9c4-47b46331e39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:24.798149 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad9b59-b913-473c-b9c4-47b46331e39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:24.798446 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad9b59-b913-473c-b9c4-47b46331e39a admin admin] PATH_INFO: `/v3/projects/bf88993bee36470d9cdeee47fb8f740e` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:24.799572 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad9b59-b913-473c-b9c4-47b46331e39a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf88993bee36470d9cdeee47fb8f740e)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:24.801568 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad9b59-b913-473c-b9c4-47b46331e39a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:24.932477 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0dad9b59-b913-473c-b9c4-47b46331e39a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf88993bee36470d9cdeee47fb8f740e', 'request_id': 'req-0dad9b59-b913-473c-b9c4-47b46331e39a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:24.939558 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0dad9b59-b913-473c-b9c4-47b46331e39a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf88993bee36470d9cdeee47fb8f740e', 'request_id': 'req-0dad9b59-b913-473c-b9c4-47b46331e39a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:25.048720 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0dad9b59-b913-473c-b9c4-47b46331e39a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf88993bee36470d9cdeee47fb8f740e', 'request_id': 'req-0dad9b59-b913-473c-b9c4-47b46331e39a'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:25.060913 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0dad9b59-b913-473c-b9c4-47b46331e39a admin admin] The token cache is being invalidate because project bf88993bee36470d9cdeee47fb8f740e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:28:25.061052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0dad9b59-b913-473c-b9c4-47b46331e39a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:25.061646 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-0dad9b59-b913-473c-b9c4-47b46331e39a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:25.063116 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1397/2744] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:28:24 2022] DELETE /identity/v3/projects/bf88993bee36470d9cdeee47fb8f740e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:25.067174 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264290e-081e-478e-a0b7-dc42b4161e8b service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:25.076889 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264290e-081e-478e-a0b7-dc42b4161e8b service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:25.094046 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:25.135378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813683c9-608c-4a71-8b81-070dbd69f9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:25.136004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813683c9-608c-4a71-8b81-070dbd69f9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:25.136282 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813683c9-608c-4a71-8b81-070dbd69f9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:25.136550 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813683c9-608c-4a71-8b81-070dbd69f9c0 admin admin] PATH_INFO: `/v3/users/bdad1ded88f34342963e35320cc880ba` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:25.137876 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813683c9-608c-4a71-8b81-070dbd69f9c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdad1ded88f34342963e35320cc880ba)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:25.140021 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813683c9-608c-4a71-8b81-070dbd69f9c0 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:25.359460 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-813683c9-608c-4a71-8b81-070dbd69f9c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdad1ded88f34342963e35320cc880ba'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:25.368190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-813683c9-608c-4a71-8b81-070dbd69f9c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdad1ded88f34342963e35320cc880ba'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:25.368886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-813683c9-608c-4a71-8b81-070dbd69f9c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdad1ded88f34342963e35320cc880ba'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:25.369574 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-813683c9-608c-4a71-8b81-070dbd69f9c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdad1ded88f34342963e35320cc880ba'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:25.413906 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-813683c9-608c-4a71-8b81-070dbd69f9c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdad1ded88f34342963e35320cc880ba'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:25.436345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1348/2745] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:28:25 2022] DELETE /identity/v3/users/bdad1ded88f34342963e35320cc880ba => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:25.781167 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025b30e-efdc-4db5-95c9-46205220d7ca None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:25.781475 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025b30e-efdc-4db5-95c9-46205220d7ca None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:25.781768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025b30e-efdc-4db5-95c9-46205220d7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:25.802344 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-2025b30e-efdc-4db5-95c9-46205220d7ca None None] MFA Rules not processed for user `d125613b28fa4191b96d927aedf51b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:25.803662 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2025b30e-efdc-4db5-95c9-46205220d7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:25.804983 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813683c9-608c-4a71-8b81-070dbd69f9c0 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:25.806673 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-813683c9-608c-4a71-8b81-070dbd69f9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:25.873620 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1398/2746] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:25.878819 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813683c9-608c-4a71-8b81-070dbd69f9c0 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:25.882811 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d814c9d-50a7-498f-aa6f-4313e0d5cb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:25.883823 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d814c9d-50a7-498f-aa6f-4313e0d5cb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:25.884276 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d814c9d-50a7-498f-aa6f-4313e0d5cb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:25.885210 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d814c9d-50a7-498f-aa6f-4313e0d5cb7b admin admin] PATH_INFO: `/v3/users/f5082693dd6e403a9ec2d4b5a4af1c98` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:25.885757 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025b30e-efdc-4db5-95c9-46205220d7ca None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:25.886463 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d814c9d-50a7-498f-aa6f-4313e0d5cb7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5082693dd6e403a9ec2d4b5a4af1c98)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:25.887673 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-2025b30e-efdc-4db5-95c9-46205220d7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:25.888577 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d814c9d-50a7-498f-aa6f-4313e0d5cb7b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:25.902900 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025b30e-efdc-4db5-95c9-46205220d7ca None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:25.908467 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec31f6-91f6-40ef-97a1-94cbf0a8a345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:25.908693 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec31f6-91f6-40ef-97a1-94cbf0a8a345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:25.908911 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec31f6-91f6-40ef-97a1-94cbf0a8a345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:25.909106 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec31f6-91f6-40ef-97a1-94cbf0a8a345 admin admin] PATH_INFO: `/v3/projects/3d88a8003a7d42cc9619654ea5693b50` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:25.910930 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec31f6-91f6-40ef-97a1-94cbf0a8a345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d88a8003a7d42cc9619654ea5693b50)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:25.912869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec31f6-91f6-40ef-97a1-94cbf0a8a345 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:26.083000 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:26.088985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7d814c9d-50a7-498f-aa6f-4313e0d5cb7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5082693dd6e403a9ec2d4b5a4af1c98'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:26.099520 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7d814c9d-50a7-498f-aa6f-4313e0d5cb7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5082693dd6e403a9ec2d4b5a4af1c98'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:26.100377 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7d814c9d-50a7-498f-aa6f-4313e0d5cb7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5082693dd6e403a9ec2d4b5a4af1c98'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:26.100997 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7d814c9d-50a7-498f-aa6f-4313e0d5cb7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5082693dd6e403a9ec2d4b5a4af1c98'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:26.120276 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-7fec31f6-91f6-40ef-97a1-94cbf0a8a345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d88a8003a7d42cc9619654ea5693b50', 'request_id': 'req-7fec31f6-91f6-40ef-97a1-94cbf0a8a345'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:26.128423 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-7fec31f6-91f6-40ef-97a1-94cbf0a8a345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d88a8003a7d42cc9619654ea5693b50', 'request_id': 'req-7fec31f6-91f6-40ef-97a1-94cbf0a8a345'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:26.131545 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:26.184397 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7d814c9d-50a7-498f-aa6f-4313e0d5cb7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5082693dd6e403a9ec2d4b5a4af1c98'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:26.204060 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1349/2747] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:28:25 2022] DELETE /identity/v3/users/f5082693dd6e403a9ec2d4b5a4af1c98 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:26.204971 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d814c9d-50a7-498f-aa6f-4313e0d5cb7b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:26.206351 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7d814c9d-50a7-498f-aa6f-4313e0d5cb7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:26.241327 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-7fec31f6-91f6-40ef-97a1-94cbf0a8a345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d88a8003a7d42cc9619654ea5693b50', 'request_id': 'req-7fec31f6-91f6-40ef-97a1-94cbf0a8a345'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:26.253675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-7fec31f6-91f6-40ef-97a1-94cbf0a8a345 admin admin] The token cache is being invalidate because project 3d88a8003a7d42cc9619654ea5693b50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:28:26.253994 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-7fec31f6-91f6-40ef-97a1-94cbf0a8a345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:26.254678 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-7fec31f6-91f6-40ef-97a1-94cbf0a8a345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:26.256177 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1399/2748] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:28:25 2022] DELETE /identity/v3/projects/3d88a8003a7d42cc9619654ea5693b50 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:26.257370 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885ea2e-0e70-45cd-9fb5-d343882d5761 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:26.257707 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885ea2e-0e70-45cd-9fb5-d343882d5761 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:26.257976 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885ea2e-0e70-45cd-9fb5-d343882d5761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:26.270308 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d814c9d-50a7-498f-aa6f-4313e0d5cb7b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:26.274471 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8f6ed-5844-4315-a4a7-51946dffc09d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:26.275081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8f6ed-5844-4315-a4a7-51946dffc09d service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:26.276912 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8f6ed-5844-4315-a4a7-51946dffc09d service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:26.276912 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8f6ed-5844-4315-a4a7-51946dffc09d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:26.277127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-4885ea2e-0e70-45cd-9fb5-d343882d5761 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:26.277405 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-aac8f6ed-5844-4315-a4a7-51946dffc09d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:26.277934 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4885ea2e-0e70-45cd-9fb5-d343882d5761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:26.287806 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8f6ed-5844-4315-a4a7-51946dffc09d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:26.289585 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8f6ed-5844-4315-a4a7-51946dffc09d service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:26.299306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1350/2749] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:26.300605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876e8b2-e571-4be1-96fc-7e0bb0858422 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:26.300987 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876e8b2-e571-4be1-96fc-7e0bb0858422 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:26.301261 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876e8b2-e571-4be1-96fc-7e0bb0858422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:26.322842 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-a876e8b2-e571-4be1-96fc-7e0bb0858422 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:26.325169 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-a876e8b2-e571-4be1-96fc-7e0bb0858422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:26.342116 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1400/2750] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:26.354194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885ea2e-0e70-45cd-9fb5-d343882d5761 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:26.355675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4885ea2e-0e70-45cd-9fb5-d343882d5761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:26.368571 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885ea2e-0e70-45cd-9fb5-d343882d5761 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:26.373796 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62bc39-7bc8-4d3a-84db-9153dfef0947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:26.374348 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62bc39-7bc8-4d3a-84db-9153dfef0947 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:26.374695 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62bc39-7bc8-4d3a-84db-9153dfef0947 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:26.375031 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62bc39-7bc8-4d3a-84db-9153dfef0947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:26.384392 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62bc39-7bc8-4d3a-84db-9153dfef0947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:26.385860 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62bc39-7bc8-4d3a-84db-9153dfef0947 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:26.393399 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1351/2751] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:26.396122 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1401/2752] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:28:26.402152 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab688bd-c797-4367-8fce-d94b5487335a None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:26.402320 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab688bd-c797-4367-8fce-d94b5487335a None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:26.402565 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab688bd-c797-4367-8fce-d94b5487335a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:26.424494 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-3ab688bd-c797-4367-8fce-d94b5487335a None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:26.425807 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3ab688bd-c797-4367-8fce-d94b5487335a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:26.434230 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1352/2753] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:26.438582 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62bc39-7bc8-4d3a-84db-9153dfef0947 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:26.449196 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62bc39-7bc8-4d3a-84db-9153dfef0947 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:26.455748 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1d052-9e30-4fac-9df6-d9b6bf44f527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:26.456476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1d052-9e30-4fac-9df6-d9b6bf44f527 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:26.457029 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1d052-9e30-4fac-9df6-d9b6bf44f527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:26.457394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1d052-9e30-4fac-9df6-d9b6bf44f527 admin admin] PATH_INFO: `/v3/domains` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:26.458226 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1d052-9e30-4fac-9df6-d9b6bf44f527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:28:26.458619 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1d052-9e30-4fac-9df6-d9b6bf44f527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:26.460436 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1d052-9e30-4fac-9df6-d9b6bf44f527 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:26.477933 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1402/2754] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:28:26.482275 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab688bd-c797-4367-8fce-d94b5487335a None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:26.491572 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab688bd-c797-4367-8fce-d94b5487335a None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:26.496433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49d167-980a-4713-b9c7-77fcb9ff1d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:26.497042 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49d167-980a-4713-b9c7-77fcb9ff1d10 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:26.497319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49d167-980a-4713-b9c7-77fcb9ff1d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:26.497640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49d167-980a-4713-b9c7-77fcb9ff1d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:26.498880 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49d167-980a-4713-b9c7-77fcb9ff1d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:26.500777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49d167-980a-4713-b9c7-77fcb9ff1d10 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:26.603953 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1353/2755] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:28:26 2022] POST /identity/v3/projects => generated 389 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:28:26.609116 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1d052-9e30-4fac-9df6-d9b6bf44f527 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:26.619364 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1d052-9e30-4fac-9df6-d9b6bf44f527 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:26.681807 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc67af-f497-417e-ac6e-0bcdb3c2939e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:26.682493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc67af-f497-417e-ac6e-0bcdb3c2939e admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:26.682779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc67af-f497-417e-ac6e-0bcdb3c2939e admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:26.683054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc67af-f497-417e-ac6e-0bcdb3c2939e admin admin] PATH_INFO: `/v3/users` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:26.683680 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc67af-f497-417e-ac6e-0bcdb3c2939e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:26.685674 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc67af-f497-417e-ac6e-0bcdb3c2939e admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:26.781100 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49d167-980a-4713-b9c7-77fcb9ff1d10 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:26.783006 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3c49d167-980a-4713-b9c7-77fcb9ff1d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:26.800879 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1403/2756] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:28:26 2022] POST /identity/v3/users => generated 295 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:28:26.802322 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc67af-f497-417e-ac6e-0bcdb3c2939e admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:26.813223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc67af-f497-417e-ac6e-0bcdb3c2939e admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:26.818685 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b0ec9-370f-4415-a731-7dc0bdae14d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:26.819434 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b0ec9-370f-4415-a731-7dc0bdae14d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:26.819781 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b0ec9-370f-4415-a731-7dc0bdae14d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:26.820152 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b0ec9-370f-4415-a731-7dc0bdae14d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:26.820917 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b0ec9-370f-4415-a731-7dc0bdae14d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:26.823546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b0ec9-370f-4415-a731-7dc0bdae14d7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:26.827929 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:26.840518 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1404/2757] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:28:26.841625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b0ec9-370f-4415-a731-7dc0bdae14d7 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:26.852346 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b0ec9-370f-4415-a731-7dc0bdae14d7 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:26.858546 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7d716-9499-4bcd-91cd-7c685c1b769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:26.862270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7d716-9499-4bcd-91cd-7c685c1b769f admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:26.862270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7d716-9499-4bcd-91cd-7c685c1b769f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:26.862270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7d716-9499-4bcd-91cd-7c685c1b769f admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:26.862270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7d716-9499-4bcd-91cd-7c685c1b769f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:26.862270 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7d716-9499-4bcd-91cd-7c685c1b769f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:26.868985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49d167-980a-4713-b9c7-77fcb9ff1d10 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:26.872762 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1405/2758] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:28:26.875588 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937b77a-6f7d-4e44-bb9b-a4d782db1610 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6172f0733384291992624ef6a527ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:26.876204 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937b77a-6f7d-4e44-bb9b-a4d782db1610 service placement] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:26.876580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937b77a-6f7d-4e44-bb9b-a4d782db1610 service placement] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:26.876862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937b77a-6f7d-4e44-bb9b-a4d782db1610 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:26.877627 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7d716-9499-4bcd-91cd-7c685c1b769f admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:26.878732 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7937b77a-6f7d-4e44-bb9b-a4d782db1610 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:26.893382 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7d716-9499-4bcd-91cd-7c685c1b769f admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:26.893516 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937b77a-6f7d-4e44-bb9b-a4d782db1610 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:26.893516 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937b77a-6f7d-4e44-bb9b-a4d782db1610 service placement] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:26.895901 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e15010-5ead-47c8-b04b-793831ecffbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:26.896722 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e15010-5ead-47c8-b04b-793831ecffbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:26.897210 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e15010-5ead-47c8-b04b-793831ecffbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:26.897447 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e15010-5ead-47c8-b04b-793831ecffbf admin admin] PATH_INFO: `/v3/projects/0fa1e4b9305f44a890746d268b2d5609/users/a79bff9cec7144a098717441a368123d/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:26.903768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1354/2759] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:28:26.906493 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937b77a-6f7d-4e44-bb9b-a4d782db1610 service placement] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:26.908096 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7937b77a-6f7d-4e44-bb9b-a4d782db1610 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:26.916864 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e15010-5ead-47c8-b04b-793831ecffbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa1e4b9305f44a890746d268b2d5609, user_id=a79bff9cec7144a098717441a368123d, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:26.919565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e15010-5ead-47c8-b04b-793831ecffbf admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:26.923069 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937b77a-6f7d-4e44-bb9b-a4d782db1610 service placement] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:26.932443 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b094eb-523b-4502-a9b5-2b3b3330da4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:26.933140 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b094eb-523b-4502-a9b5-2b3b3330da4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:26.933500 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b094eb-523b-4502-a9b5-2b3b3330da4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:26.933790 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b094eb-523b-4502-a9b5-2b3b3330da4e admin admin] PATH_INFO: `/v3/projects/ad4351c434ad46acb7a1bad968960473` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:26.935373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b094eb-523b-4502-a9b5-2b3b3330da4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4351c434ad46acb7a1bad968960473)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:26.938629 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b094eb-523b-4502-a9b5-2b3b3330da4e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:27.007828 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1406/2760] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:28:26 2022] PUT /identity/v3/projects/0fa1e4b9305f44a890746d268b2d5609/users/a79bff9cec7144a098717441a368123d/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:28:27.018801 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b22b5-86de-4914-9008-6f0d0c8fafb5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:27.019203 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b22b5-86de-4914-9008-6f0d0c8fafb5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:27.019495 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b22b5-86de-4914-9008-6f0d0c8fafb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:27.034645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:27.056440 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-ec2b22b5-86de-4914-9008-6f0d0c8fafb5 None None] MFA Rules not processed for user `a79bff9cec7144a098717441a368123d`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:27.056440 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ec2b22b5-86de-4914-9008-6f0d0c8fafb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:27.069092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-57b094eb-523b-4502-a9b5-2b3b3330da4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4351c434ad46acb7a1bad968960473', 'request_id': 'req-57b094eb-523b-4502-a9b5-2b3b3330da4e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:27.077010 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-57b094eb-523b-4502-a9b5-2b3b3330da4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4351c434ad46acb7a1bad968960473', 'request_id': 'req-57b094eb-523b-4502-a9b5-2b3b3330da4e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:27.120500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1407/2761] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:27.125523 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b22b5-86de-4914-9008-6f0d0c8fafb5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:27.167289 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-57b094eb-523b-4502-a9b5-2b3b3330da4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4351c434ad46acb7a1bad968960473', 'request_id': 'req-57b094eb-523b-4502-a9b5-2b3b3330da4e'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:27.179952 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-57b094eb-523b-4502-a9b5-2b3b3330da4e admin admin] The token cache is being invalidate because project ad4351c434ad46acb7a1bad968960473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80523) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:28:27.180247 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-57b094eb-523b-4502-a9b5-2b3b3330da4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:27.181075 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-57b094eb-523b-4502-a9b5-2b3b3330da4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:27.182718 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1355/2762] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:28:26 2022] DELETE /identity/v3/projects/ad4351c434ad46acb7a1bad968960473 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:27.194191 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b22b5-86de-4914-9008-6f0d0c8fafb5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:27.199593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366eb66-e781-4c91-8295-51613a3eca96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:27.200241 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366eb66-e781-4c91-8295-51613a3eca96 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:27.200658 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366eb66-e781-4c91-8295-51613a3eca96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:27.200988 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366eb66-e781-4c91-8295-51613a3eca96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:27.201644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366eb66-e781-4c91-8295-51613a3eca96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:27.203857 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366eb66-e781-4c91-8295-51613a3eca96 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:27.316053 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1408/2763] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:28:27 2022] POST /identity/v3/projects => generated 389 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:28:27.322067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b094eb-523b-4502-a9b5-2b3b3330da4e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:27.323842 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-57b094eb-523b-4502-a9b5-2b3b3330da4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:27.339451 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b094eb-523b-4502-a9b5-2b3b3330da4e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:27.416599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5775e-3537-49ca-b37c-130271580218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:27.417613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5775e-3537-49ca-b37c-130271580218 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:27.417901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5775e-3537-49ca-b37c-130271580218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:27.418245 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5775e-3537-49ca-b37c-130271580218 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:27.419026 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5775e-3537-49ca-b37c-130271580218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:27.422090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5775e-3537-49ca-b37c-130271580218 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:27.535454 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1356/2764] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:28:27 2022] POST /identity/v3/users => generated 301 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:28:27.539868 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366eb66-e781-4c91-8295-51613a3eca96 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:27.551358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366eb66-e781-4c91-8295-51613a3eca96 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:27.555926 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109f103-123d-4e9c-9e4d-9f97eb8efe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:27.556529 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109f103-123d-4e9c-9e4d-9f97eb8efe66 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:27.556808 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109f103-123d-4e9c-9e4d-9f97eb8efe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:27.557078 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109f103-123d-4e9c-9e4d-9f97eb8efe66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:27.557753 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109f103-123d-4e9c-9e4d-9f97eb8efe66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:27.559359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109f103-123d-4e9c-9e4d-9f97eb8efe66 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:27.569482 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1409/2765] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:28:27.573798 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5775e-3537-49ca-b37c-130271580218 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:27.584346 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5775e-3537-49ca-b37c-130271580218 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:27.588904 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586b418-5332-46b8-a974-a5fd309436c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:27.589580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586b418-5332-46b8-a974-a5fd309436c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:27.595007 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586b418-5332-46b8-a974-a5fd309436c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:27.595007 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586b418-5332-46b8-a974-a5fd309436c8 admin admin] PATH_INFO: `/v3/projects/1337404eafcd48debae554144919c9ed/users/f4905c9d885e47de9eff1e9e18686b82/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:27.606012 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586b418-5332-46b8-a974-a5fd309436c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1337404eafcd48debae554144919c9ed, user_id=f4905c9d885e47de9eff1e9e18686b82, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:27.608720 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586b418-5332-46b8-a974-a5fd309436c8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:27.694700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1357/2766] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:28:27 2022] PUT /identity/v3/projects/1337404eafcd48debae554144919c9ed/users/f4905c9d885e47de9eff1e9e18686b82/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:27.698588 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109f103-123d-4e9c-9e4d-9f97eb8efe66 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:27.709008 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109f103-123d-4e9c-9e4d-9f97eb8efe66 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:27.765223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053a30d-ea7b-4879-bc34-7a06f78bd5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:27.765825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053a30d-ea7b-4879-bc34-7a06f78bd5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:27.766101 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053a30d-ea7b-4879-bc34-7a06f78bd5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:27.766369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053a30d-ea7b-4879-bc34-7a06f78bd5e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:27.766998 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053a30d-ea7b-4879-bc34-7a06f78bd5e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:27.768580 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053a30d-ea7b-4879-bc34-7a06f78bd5e0 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:27.778245 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1410/2767] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:28:27.783372 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586b418-5332-46b8-a974-a5fd309436c8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:27.793912 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586b418-5332-46b8-a974-a5fd309436c8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:27.798679 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9cf30-a8d9-4c42-9e4b-b9ceaa5956e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:27.799323 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9cf30-a8d9-4c42-9e4b-b9ceaa5956e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:27.799603 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9cf30-a8d9-4c42-9e4b-b9ceaa5956e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:27.799875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9cf30-a8d9-4c42-9e4b-b9ceaa5956e1 admin admin] PATH_INFO: `/v3/projects/1337404eafcd48debae554144919c9ed/users/f4905c9d885e47de9eff1e9e18686b82/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:27.801951 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9cf30-a8d9-4c42-9e4b-b9ceaa5956e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1337404eafcd48debae554144919c9ed, user_id=f4905c9d885e47de9eff1e9e18686b82, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:27.804582 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9cf30-a8d9-4c42-9e4b-b9ceaa5956e1 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:27.810030 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:27.815354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1358/2768] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:28:27 2022] PUT /identity/v3/projects/1337404eafcd48debae554144919c9ed/users/f4905c9d885e47de9eff1e9e18686b82/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:27.825687 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c573c-ea9d-4c2a-98bf-4904d723840b None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:27.825973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c573c-ea9d-4c2a-98bf-4904d723840b None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:27.826804 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c573c-ea9d-4c2a-98bf-4904d723840b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:27.840472 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:27.855040 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-a29c573c-ea9d-4c2a-98bf-4904d723840b None None] MFA Rules not processed for user `f4905c9d885e47de9eff1e9e18686b82`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:27.856256 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a29c573c-ea9d-4c2a-98bf-4904d723840b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:27.932181 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1411/2769] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:27 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:27.943387 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9cf30-a8d9-4c42-9e4b-b9ceaa5956e1 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:27.950165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-13b9cf30-a8d9-4c42-9e4b-b9ceaa5956e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:28.002991 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9cf30-a8d9-4c42-9e4b-b9ceaa5956e1 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:28.006875 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec2e7f-907f-4f6c-a23b-42b1c16834e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:28.007485 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec2e7f-907f-4f6c-a23b-42b1c16834e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:28.007765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec2e7f-907f-4f6c-a23b-42b1c16834e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:28.008036 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec2e7f-907f-4f6c-a23b-42b1c16834e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:28.018233 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec2e7f-907f-4f6c-a23b-42b1c16834e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:28.019754 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec2e7f-907f-4f6c-a23b-42b1c16834e3 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:28.030137 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1359/2770] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:27 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:28.186673 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c573c-ea9d-4c2a-98bf-4904d723840b None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:28.250458 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c573c-ea9d-4c2a-98bf-4904d723840b None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:28.254979 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe28fe6-80b8-471f-bcb1-f8d8bde151c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:28.255607 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe28fe6-80b8-471f-bcb1-f8d8bde151c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:28.255889 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe28fe6-80b8-471f-bcb1-f8d8bde151c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:28.256154 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe28fe6-80b8-471f-bcb1-f8d8bde151c8 admin admin] PATH_INFO: `/v3/users/a79bff9cec7144a098717441a368123d` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:28.257341 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe28fe6-80b8-471f-bcb1-f8d8bde151c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a79bff9cec7144a098717441a368123d)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:28.259335 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe28fe6-80b8-471f-bcb1-f8d8bde151c8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:28.485557 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6fe28fe6-80b8-471f-bcb1-f8d8bde151c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a79bff9cec7144a098717441a368123d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:28.568160 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6fe28fe6-80b8-471f-bcb1-f8d8bde151c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a79bff9cec7144a098717441a368123d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:28.568854 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6fe28fe6-80b8-471f-bcb1-f8d8bde151c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a79bff9cec7144a098717441a368123d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:28.569537 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6fe28fe6-80b8-471f-bcb1-f8d8bde151c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a79bff9cec7144a098717441a368123d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:28.577183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6fe28fe6-80b8-471f-bcb1-f8d8bde151c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a79bff9cec7144a098717441a368123d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:28.597498 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1412/2771] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:28:28 2022] DELETE /identity/v3/users/a79bff9cec7144a098717441a368123d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:28.602185 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821e495-cf00-45ed-9d05-0f6a5cefc8e8 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:28.602686 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821e495-cf00-45ed-9d05-0f6a5cefc8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:28.602874 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821e495-cf00-45ed-9d05-0f6a5cefc8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:28.622481 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-5821e495-cf00-45ed-9d05-0f6a5cefc8e8 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:28.624275 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5821e495-cf00-45ed-9d05-0f6a5cefc8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:28.681362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1360/2772] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:28:28.691891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe28fe6-80b8-471f-bcb1-f8d8bde151c8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:28.693357 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6fe28fe6-80b8-471f-bcb1-f8d8bde151c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:28.706650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:28.752344 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe28fe6-80b8-471f-bcb1-f8d8bde151c8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:28.755964 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb9674-a8c8-4b70-9467-7e2ce61dc10c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:28.756569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb9674-a8c8-4b70-9467-7e2ce61dc10c service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:28.756848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb9674-a8c8-4b70-9467-7e2ce61dc10c service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:28.757119 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb9674-a8c8-4b70-9467-7e2ce61dc10c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:28.767067 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb9674-a8c8-4b70-9467-7e2ce61dc10c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:28.768522 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb9674-a8c8-4b70-9467-7e2ce61dc10c service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:28.778054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1413/2773] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:29.396229 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821e495-cf00-45ed-9d05-0f6a5cefc8e8 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:29.397744 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5821e495-cf00-45ed-9d05-0f6a5cefc8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:29.409856 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821e495-cf00-45ed-9d05-0f6a5cefc8e8 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:29.413544 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9db35-8ee8-4717-968e-32bedad930f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:29.414146 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9db35-8ee8-4717-968e-32bedad930f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:29.414687 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9db35-8ee8-4717-968e-32bedad930f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:29.414957 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9db35-8ee8-4717-968e-32bedad930f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:29.417007 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ceb9db35-8ee8-4717-968e-32bedad930f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:29.427080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9db35-8ee8-4717-968e-32bedad930f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:29.428525 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb9db35-8ee8-4717-968e-32bedad930f3 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:29.438237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1361/2774] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:28:29.686597 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb9674-a8c8-4b70-9467-7e2ce61dc10c service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:29.688064 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-6cdb9674-a8c8-4b70-9467-7e2ce61dc10c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:29.700749 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb9674-a8c8-4b70-9467-7e2ce61dc10c service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:29.705716 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb6a7a-a5bd-465c-93ff-527053307f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:29.706517 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb6a7a-a5bd-465c-93ff-527053307f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:29.706803 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb6a7a-a5bd-465c-93ff-527053307f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:29.707078 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb6a7a-a5bd-465c-93ff-527053307f1d admin admin] PATH_INFO: `/v3/projects/0fa1e4b9305f44a890746d268b2d5609` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:29.708199 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb6a7a-a5bd-465c-93ff-527053307f1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa1e4b9305f44a890746d268b2d5609)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:29.710140 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb6a7a-a5bd-465c-93ff-527053307f1d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:29.832749 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8deb6a7a-a5bd-465c-93ff-527053307f1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa1e4b9305f44a890746d268b2d5609', 'request_id': 'req-8deb6a7a-a5bd-465c-93ff-527053307f1d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:29.838521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8deb6a7a-a5bd-465c-93ff-527053307f1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa1e4b9305f44a890746d268b2d5609', 'request_id': 'req-8deb6a7a-a5bd-465c-93ff-527053307f1d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:29.922891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8deb6a7a-a5bd-465c-93ff-527053307f1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa1e4b9305f44a890746d268b2d5609', 'request_id': 'req-8deb6a7a-a5bd-465c-93ff-527053307f1d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:29.934756 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8deb6a7a-a5bd-465c-93ff-527053307f1d admin admin] The token cache is being invalidate because project 0fa1e4b9305f44a890746d268b2d5609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:28:29.936042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8deb6a7a-a5bd-465c-93ff-527053307f1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:29.936042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-8deb6a7a-a5bd-465c-93ff-527053307f1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:29.937389 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1414/2775] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:28:29 2022] DELETE /identity/v3/projects/0fa1e4b9305f44a890746d268b2d5609 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:29.941586 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9db35-8ee8-4717-968e-32bedad930f3 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:29.954198 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9db35-8ee8-4717-968e-32bedad930f3 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:30.015717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed064f1-a5f0-40aa-99b1-5eba09ec3737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:30.016357 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed064f1-a5f0-40aa-99b1-5eba09ec3737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:30.016641 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed064f1-a5f0-40aa-99b1-5eba09ec3737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:30.016915 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed064f1-a5f0-40aa-99b1-5eba09ec3737 admin admin] PATH_INFO: `/v3/users/f4905c9d885e47de9eff1e9e18686b82` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:30.018074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed064f1-a5f0-40aa-99b1-5eba09ec3737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4905c9d885e47de9eff1e9e18686b82)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:30.020005 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed064f1-a5f0-40aa-99b1-5eba09ec3737 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:30.220742 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:30.234553 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1ed064f1-a5f0-40aa-99b1-5eba09ec3737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4905c9d885e47de9eff1e9e18686b82'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:30.241965 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1ed064f1-a5f0-40aa-99b1-5eba09ec3737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4905c9d885e47de9eff1e9e18686b82'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:30.242674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1ed064f1-a5f0-40aa-99b1-5eba09ec3737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4905c9d885e47de9eff1e9e18686b82'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:30.243414 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1ed064f1-a5f0-40aa-99b1-5eba09ec3737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4905c9d885e47de9eff1e9e18686b82'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:30.328589 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-1ed064f1-a5f0-40aa-99b1-5eba09ec3737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4905c9d885e47de9eff1e9e18686b82'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:30.347759 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1362/2776] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:28:29 2022] DELETE /identity/v3/users/f4905c9d885e47de9eff1e9e18686b82 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:30.843502 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb6a7a-a5bd-465c-93ff-527053307f1d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:30.845644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-8deb6a7a-a5bd-465c-93ff-527053307f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:30.882737 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb6a7a-a5bd-465c-93ff-527053307f1d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:30.927883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c86c47-94ec-4e40-9fab-9cb9b048561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:30.928514 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c86c47-94ec-4e40-9fab-9cb9b048561f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:30.928790 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c86c47-94ec-4e40-9fab-9cb9b048561f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:30.929061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c86c47-94ec-4e40-9fab-9cb9b048561f admin admin] PATH_INFO: `/v3/projects/1337404eafcd48debae554144919c9ed` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:30.930189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c86c47-94ec-4e40-9fab-9cb9b048561f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1337404eafcd48debae554144919c9ed)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:30.932088 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c86c47-94ec-4e40-9fab-9cb9b048561f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:31.036358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:31.046339 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-84c86c47-94ec-4e40-9fab-9cb9b048561f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1337404eafcd48debae554144919c9ed', 'request_id': 'req-84c86c47-94ec-4e40-9fab-9cb9b048561f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:31.051963 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-84c86c47-94ec-4e40-9fab-9cb9b048561f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1337404eafcd48debae554144919c9ed', 'request_id': 'req-84c86c47-94ec-4e40-9fab-9cb9b048561f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:31.132889 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-84c86c47-94ec-4e40-9fab-9cb9b048561f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1337404eafcd48debae554144919c9ed', 'request_id': 'req-84c86c47-94ec-4e40-9fab-9cb9b048561f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:31.145257 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-84c86c47-94ec-4e40-9fab-9cb9b048561f admin admin] The token cache is being invalidate because project 1337404eafcd48debae554144919c9ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:28:31.145585 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-84c86c47-94ec-4e40-9fab-9cb9b048561f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:31.146235 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-84c86c47-94ec-4e40-9fab-9cb9b048561f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:31.147722 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1415/2777] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:28:30 2022] DELETE /identity/v3/projects/1337404eafcd48debae554144919c9ed => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:31.152558 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc038ae-5564-4edd-802e-c1bf333027ba None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:31.153043 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc038ae-5564-4edd-802e-c1bf333027ba None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:31.153157 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc038ae-5564-4edd-802e-c1bf333027ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:31.173290 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-1dc038ae-5564-4edd-802e-c1bf333027ba None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:31.174506 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-1dc038ae-5564-4edd-802e-c1bf333027ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:31.237356 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1363/2778] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:31.304540 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672dbf8-3493-4ec3-94de-76c2c36c1292 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:31.304828 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672dbf8-3493-4ec3-94de-76c2c36c1292 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:31.305104 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672dbf8-3493-4ec3-94de-76c2c36c1292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:31.324398 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-3672dbf8-3493-4ec3-94de-76c2c36c1292 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:31.325632 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-3672dbf8-3493-4ec3-94de-76c2c36c1292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:31.335137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1416/2779] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:31.338811 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc038ae-5564-4edd-802e-c1bf333027ba None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:31.348985 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc038ae-5564-4edd-802e-c1bf333027ba None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:31.353561 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c5166-f4eb-4b30-971c-d876a7d79344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:31.354157 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c5166-f4eb-4b30-971c-d876a7d79344 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:31.354435 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c5166-f4eb-4b30-971c-d876a7d79344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:31.354704 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c5166-f4eb-4b30-971c-d876a7d79344 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:31.355338 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c5166-f4eb-4b30-971c-d876a7d79344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:28:31.355667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c5166-f4eb-4b30-971c-d876a7d79344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:31.357389 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c5166-f4eb-4b30-971c-d876a7d79344 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:31.368847 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1364/2780] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 19:28:31.373078 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672dbf8-3493-4ec3-94de-76c2c36c1292 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:31.382610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672dbf8-3493-4ec3-94de-76c2c36c1292 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:31.387182 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e0009-6155-4051-80e5-36149f51d6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:31.387768 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e0009-6155-4051-80e5-36149f51d6f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:31.388043 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e0009-6155-4051-80e5-36149f51d6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:31.388311 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e0009-6155-4051-80e5-36149f51d6f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:31.389482 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e0009-6155-4051-80e5-36149f51d6f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:31.391384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e0009-6155-4051-80e5-36149f51d6f4 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:31.467358 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1417/2781] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:28:31 2022] POST /identity/v3/projects => generated 409 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:28:31.470372 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c5166-f4eb-4b30-971c-d876a7d79344 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:31.480202 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c5166-f4eb-4b30-971c-d876a7d79344 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:31.537350 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1961c3-e756-4701-8efa-a3fbcad905f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:31.538004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1961c3-e756-4701-8efa-a3fbcad905f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:31.538293 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1961c3-e756-4701-8efa-a3fbcad905f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:31.538572 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1961c3-e756-4701-8efa-a3fbcad905f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:31.539207 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1961c3-e756-4701-8efa-a3fbcad905f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:31.541410 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1961c3-e756-4701-8efa-a3fbcad905f5 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:31.641710 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1365/2782] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:28:31 2022] POST /identity/v3/users => generated 305 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:28:31.645799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e0009-6155-4051-80e5-36149f51d6f4 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:31.657186 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e0009-6155-4051-80e5-36149f51d6f4 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:31.661914 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab2729-2fd2-4c7d-9f32-c3b8d566ce8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:31.662503 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab2729-2fd2-4c7d-9f32-c3b8d566ce8c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:31.662780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab2729-2fd2-4c7d-9f32-c3b8d566ce8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:31.663052 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab2729-2fd2-4c7d-9f32-c3b8d566ce8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:31.663848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab2729-2fd2-4c7d-9f32-c3b8d566ce8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:31.665877 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab2729-2fd2-4c7d-9f32-c3b8d566ce8c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:31.679164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1418/2783] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:28:31.680410 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1961c3-e756-4701-8efa-a3fbcad905f5 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:31.693138 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1961c3-e756-4701-8efa-a3fbcad905f5 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:31.698278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea6636-a61d-4445-bb25-d6ccef3792f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:31.698978 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea6636-a61d-4445-bb25-d6ccef3792f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:31.699266 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea6636-a61d-4445-bb25-d6ccef3792f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:31.699937 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea6636-a61d-4445-bb25-d6ccef3792f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:31.700299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea6636-a61d-4445-bb25-d6ccef3792f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:31.702602 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea6636-a61d-4445-bb25-d6ccef3792f2 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:31.713419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1366/2784] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:28:31.718364 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab2729-2fd2-4c7d-9f32-c3b8d566ce8c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:31.728507 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab2729-2fd2-4c7d-9f32-c3b8d566ce8c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:31.733387 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba4a0e-bbe9-4eba-8bd8-e7117174c341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:31.734089 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba4a0e-bbe9-4eba-8bd8-e7117174c341 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:31.734372 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba4a0e-bbe9-4eba-8bd8-e7117174c341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:31.734648 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba4a0e-bbe9-4eba-8bd8-e7117174c341 admin admin] PATH_INFO: `/v3/projects/44f0cac099ba41b3a64543f44167d3d0/users/470f4d3b5ab14222aa814511dff635b0/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:31.749834 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba4a0e-bbe9-4eba-8bd8-e7117174c341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f0cac099ba41b3a64543f44167d3d0, user_id=470f4d3b5ab14222aa814511dff635b0, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:31.752500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba4a0e-bbe9-4eba-8bd8-e7117174c341 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:31.815378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1419/2785] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:28:31 2022] PUT /identity/v3/projects/44f0cac099ba41b3a64543f44167d3d0/users/470f4d3b5ab14222aa814511dff635b0/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:31.825694 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a1111-9cfe-42e9-90d9-1d81ef2d5862 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:31.825983 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a1111-9cfe-42e9-90d9-1d81ef2d5862 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:31.826925 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a1111-9cfe-42e9-90d9-1d81ef2d5862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:31.851827 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:31.855551 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-779a1111-9cfe-42e9-90d9-1d81ef2d5862 None None] MFA Rules not processed for user `470f4d3b5ab14222aa814511dff635b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:31.856774 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-779a1111-9cfe-42e9-90d9-1d81ef2d5862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:31.922750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1367/2786] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:31 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:31.926878 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba4a0e-bbe9-4eba-8bd8-e7117174c341 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:31.992705 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba4a0e-bbe9-4eba-8bd8-e7117174c341 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:31.997300 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dff6b-8de9-44af-b4bb-2bccaefb0e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:31.997928 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dff6b-8de9-44af-b4bb-2bccaefb0e25 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:31.998779 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dff6b-8de9-44af-b4bb-2bccaefb0e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:31.999134 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4dff6b-8de9-44af-b4bb-2bccaefb0e25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:31.999673 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4dff6b-8de9-44af-b4bb-2bccaefb0e25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:32.001604 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4dff6b-8de9-44af-b4bb-2bccaefb0e25 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:32.101191 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1420/2787] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:28:31 2022] POST /identity/v3/projects => generated 409 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:28:32.105243 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a1111-9cfe-42e9-90d9-1d81ef2d5862 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:32.116734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a1111-9cfe-42e9-90d9-1d81ef2d5862 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:32.178750 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8b3be-ba9a-43c2-9741-abf367089023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:32.179556 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8b3be-ba9a-43c2-9741-abf367089023 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:32.179907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8b3be-ba9a-43c2-9741-abf367089023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:32.180250 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8b3be-ba9a-43c2-9741-abf367089023 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:32.181079 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8b3be-ba9a-43c2-9741-abf367089023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:32.183210 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8b3be-ba9a-43c2-9741-abf367089023 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:32.271512 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1368/2788] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:28:32 2022] POST /identity/v3/users => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:28:32.275177 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dff6b-8de9-44af-b4bb-2bccaefb0e25 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:32.286163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4dff6b-8de9-44af-b4bb-2bccaefb0e25 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:32.291825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5b3f7-3d77-4581-b33a-fe7e52b88e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:32.292936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5b3f7-3d77-4581-b33a-fe7e52b88e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:32.293239 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5b3f7-3d77-4581-b33a-fe7e52b88e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:32.293446 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5b3f7-3d77-4581-b33a-fe7e52b88e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:32.294130 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5b3f7-3d77-4581-b33a-fe7e52b88e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:32.296343 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5b3f7-3d77-4581-b33a-fe7e52b88e22 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:32.308848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1421/2789] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:28:32.313049 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8b3be-ba9a-43c2-9741-abf367089023 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:32.324443 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8b3be-ba9a-43c2-9741-abf367089023 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:32.330703 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cb5b8-f0d9-40b7-be78-cc89bbc5c529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:32.331598 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cb5b8-f0d9-40b7-be78-cc89bbc5c529 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:32.331948 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cb5b8-f0d9-40b7-be78-cc89bbc5c529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:32.332296 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cb5b8-f0d9-40b7-be78-cc89bbc5c529 admin admin] PATH_INFO: `/v3/projects/8e1abad63905480d860f9d72408f3d71/users/4fda3e2ef82c4c5fa52216beec9636a1/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:32.349636 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cb5b8-f0d9-40b7-be78-cc89bbc5c529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1abad63905480d860f9d72408f3d71, user_id=4fda3e2ef82c4c5fa52216beec9636a1, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:32.352575 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cb5b8-f0d9-40b7-be78-cc89bbc5c529 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:32.467423 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1369/2790] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:28:32 2022] PUT /identity/v3/projects/8e1abad63905480d860f9d72408f3d71/users/4fda3e2ef82c4c5fa52216beec9636a1/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:32.471124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5b3f7-3d77-4581-b33a-fe7e52b88e22 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:32.481380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5b3f7-3d77-4581-b33a-fe7e52b88e22 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:32.553591 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:32.553992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cb5b8-f0d9-40b7-be78-cc89bbc5c529 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:32.555797 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-af2cb5b8-f0d9-40b7-be78-cc89bbc5c529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:32.585273 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e653365-4f77-4c93-919d-856e1557c94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:32.585920 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e653365-4f77-4c93-919d-856e1557c94c admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:32.586207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e653365-4f77-4c93-919d-856e1557c94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:32.586480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e653365-4f77-4c93-919d-856e1557c94c admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:32.587229 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e653365-4f77-4c93-919d-856e1557c94c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:32.588849 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e653365-4f77-4c93-919d-856e1557c94c admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:32.599612 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1422/2791] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:28:32.604664 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e653365-4f77-4c93-919d-856e1557c94c admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:32.618190 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e653365-4f77-4c93-919d-856e1557c94c admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:32.622961 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519fd0f-8aad-4660-9f41-cf16af70f525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:32.623812 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519fd0f-8aad-4660-9f41-cf16af70f525 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:32.624031 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519fd0f-8aad-4660-9f41-cf16af70f525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:32.629169 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519fd0f-8aad-4660-9f41-cf16af70f525 admin admin] PATH_INFO: `/v3/projects/8e1abad63905480d860f9d72408f3d71/users/4fda3e2ef82c4c5fa52216beec9636a1/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:32.629169 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519fd0f-8aad-4660-9f41-cf16af70f525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1abad63905480d860f9d72408f3d71, user_id=4fda3e2ef82c4c5fa52216beec9636a1, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:32.629884 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519fd0f-8aad-4660-9f41-cf16af70f525 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:32.638723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cb5b8-f0d9-40b7-be78-cc89bbc5c529 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:32.643112 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1423/2792] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:28:32 2022] PUT /identity/v3/projects/8e1abad63905480d860f9d72408f3d71/users/4fda3e2ef82c4c5fa52216beec9636a1/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:28:32.643655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:32.655651 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95a788-a264-4732-953b-05324a9d9237 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:32.656099 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95a788-a264-4732-953b-05324a9d9237 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:32.656385 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95a788-a264-4732-953b-05324a9d9237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:32.687394 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-cd95a788-a264-4732-953b-05324a9d9237 None None] MFA Rules not processed for user `4fda3e2ef82c4c5fa52216beec9636a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:32.688734 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-cd95a788-a264-4732-953b-05324a9d9237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:32.715862 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a1873-6848-4d72-9994-b3b0f999f14f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:32.716454 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a1873-6848-4d72-9994-b3b0f999f14f service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:32.717283 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a1873-6848-4d72-9994-b3b0f999f14f service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:32.717765 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a1873-6848-4d72-9994-b3b0f999f14f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:32.719662 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-515a1873-6848-4d72-9994-b3b0f999f14f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:32.735853 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a1873-6848-4d72-9994-b3b0f999f14f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:32.737518 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a1873-6848-4d72-9994-b3b0f999f14f service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:32.748815 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1370/2793] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:32.767294 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1424/2794] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:32 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:32.783907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a1873-6848-4d72-9994-b3b0f999f14f service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:32.783907 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-515a1873-6848-4d72-9994-b3b0f999f14f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:32.840546 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a1873-6848-4d72-9994-b3b0f999f14f service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:32.844509 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de695e-0de9-4957-b0ef-571368b5b4ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:32.845135 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de695e-0de9-4957-b0ef-571368b5b4ff service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:32.845419 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de695e-0de9-4957-b0ef-571368b5b4ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:32.845752 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de695e-0de9-4957-b0ef-571368b5b4ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:32.856690 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de695e-0de9-4957-b0ef-571368b5b4ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:32.858774 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de695e-0de9-4957-b0ef-571368b5b4ff service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:32.869187 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1371/2795] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:32 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:33.222585 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95a788-a264-4732-953b-05324a9d9237 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:33.233124 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95a788-a264-4732-953b-05324a9d9237 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:33.236904 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7ff13-0508-419a-bbb4-a9a481b87880 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:33.237531 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7ff13-0508-419a-bbb4-a9a481b87880 service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:33.238365 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7ff13-0508-419a-bbb4-a9a481b87880 service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:33.238365 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7ff13-0508-419a-bbb4-a9a481b87880 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:33.297289 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7ff13-0508-419a-bbb4-a9a481b87880 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:33.298760 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7ff13-0508-419a-bbb4-a9a481b87880 service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:33.307465 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1425/2796] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:33 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:34.121987 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de695e-0de9-4957-b0ef-571368b5b4ff service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:34.124024 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-45de695e-0de9-4957-b0ef-571368b5b4ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:34.182487 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de695e-0de9-4957-b0ef-571368b5b4ff service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:34.186784 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a758ef7-cdd5-41b6-babc-ea53560d8230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:34.187387 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a758ef7-cdd5-41b6-babc-ea53560d8230 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:34.187665 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a758ef7-cdd5-41b6-babc-ea53560d8230 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:34.187936 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a758ef7-cdd5-41b6-babc-ea53560d8230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:34.189706 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9a758ef7-cdd5-41b6-babc-ea53560d8230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:34.199202 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a758ef7-cdd5-41b6-babc-ea53560d8230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:34.200621 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a758ef7-cdd5-41b6-babc-ea53560d8230 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:34.210755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1372/2797] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:34.286932 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7ff13-0508-419a-bbb4-a9a481b87880 service cinder] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:34.296609 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7ff13-0508-419a-bbb4-a9a481b87880 service cinder] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:34.300149 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e2a81-6341-4c25-b674-5923ed407c73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:34.300736 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e2a81-6341-4c25-b674-5923ed407c73 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:34.301011 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e2a81-6341-4c25-b674-5923ed407c73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:34.301283 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e2a81-6341-4c25-b674-5923ed407c73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:34.303060 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-a32e2a81-6341-4c25-b674-5923ed407c73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:34.317772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e2a81-6341-4c25-b674-5923ed407c73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:34.320364 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e2a81-6341-4c25-b674-5923ed407c73 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:34.330919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1426/2798] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:40.309721 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a758ef7-cdd5-41b6-babc-ea53560d8230 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:40.353444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=100 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:40.375479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a758ef7-cdd5-41b6-babc-ea53560d8230 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:40.379979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b1b5e-a194-484c-a9b7-381bfcb62692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:40.380599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b1b5e-a194-484c-a9b7-381bfcb62692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:40.380876 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b1b5e-a194-484c-a9b7-381bfcb62692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:40.381145 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b1b5e-a194-484c-a9b7-381bfcb62692 admin admin] PATH_INFO: `/v3/users/470f4d3b5ab14222aa814511dff635b0` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:40.382322 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b1b5e-a194-484c-a9b7-381bfcb62692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=470f4d3b5ab14222aa814511dff635b0)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:40.384222 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b1b5e-a194-484c-a9b7-381bfcb62692 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:40.599935 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-8b5b1b5e-a194-484c-a9b7-381bfcb62692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '470f4d3b5ab14222aa814511dff635b0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:40.609003 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-8b5b1b5e-a194-484c-a9b7-381bfcb62692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '470f4d3b5ab14222aa814511dff635b0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:40.610007 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-8b5b1b5e-a194-484c-a9b7-381bfcb62692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '470f4d3b5ab14222aa814511dff635b0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:40.612061 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-8b5b1b5e-a194-484c-a9b7-381bfcb62692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '470f4d3b5ab14222aa814511dff635b0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:40.671775 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-8b5b1b5e-a194-484c-a9b7-381bfcb62692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '470f4d3b5ab14222aa814511dff635b0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:40.695970 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1373/2799] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:28:40 2022] DELETE /identity/v3/users/470f4d3b5ab14222aa814511dff635b0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:40.700437 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc057e5f-ec4a-449a-826e-7d95055a9251 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:40.700998 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc057e5f-ec4a-449a-826e-7d95055a9251 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:40.701184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc057e5f-ec4a-449a-826e-7d95055a9251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:40.721897 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-dc057e5f-ec4a-449a-826e-7d95055a9251 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:40.723281 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-dc057e5f-ec4a-449a-826e-7d95055a9251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:40.753378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:40.787290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1427/2800] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:40.797299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b1b5e-a194-484c-a9b7-381bfcb62692 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:40.798719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8b5b1b5e-a194-484c-a9b7-381bfcb62692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:40.855707 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b1b5e-a194-484c-a9b7-381bfcb62692 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:40.859608 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a82de-16a0-4080-b661-fed7ee627b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:40.860224 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a82de-16a0-4080-b661-fed7ee627b2d service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:40.860510 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a82de-16a0-4080-b661-fed7ee627b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:40.860788 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a82de-16a0-4080-b661-fed7ee627b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:40.869979 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a82de-16a0-4080-b661-fed7ee627b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:40.871411 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a82de-16a0-4080-b661-fed7ee627b2d service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:40.881337 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1374/2801] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:41.284160 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc057e5f-ec4a-449a-826e-7d95055a9251 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:41.285741 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-dc057e5f-ec4a-449a-826e-7d95055a9251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:41.298444 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc057e5f-ec4a-449a-826e-7d95055a9251 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:41.303543 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a302f-4c3d-414e-8f54-9d6c6291c284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:41.304172 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a302f-4c3d-414e-8f54-9d6c6291c284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:41.304501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a302f-4c3d-414e-8f54-9d6c6291c284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:41.304771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a302f-4c3d-414e-8f54-9d6c6291c284 admin admin] PATH_INFO: `/v3/projects/44f0cac099ba41b3a64543f44167d3d0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:41.305917 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a302f-4c3d-414e-8f54-9d6c6291c284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44f0cac099ba41b3a64543f44167d3d0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:41.307870 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a302f-4c3d-414e-8f54-9d6c6291c284 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:41.414972 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-318a302f-4c3d-414e-8f54-9d6c6291c284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44f0cac099ba41b3a64543f44167d3d0', 'request_id': 'req-318a302f-4c3d-414e-8f54-9d6c6291c284'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:41.420418 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-318a302f-4c3d-414e-8f54-9d6c6291c284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44f0cac099ba41b3a64543f44167d3d0', 'request_id': 'req-318a302f-4c3d-414e-8f54-9d6c6291c284'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:41.493484 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-318a302f-4c3d-414e-8f54-9d6c6291c284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44f0cac099ba41b3a64543f44167d3d0', 'request_id': 'req-318a302f-4c3d-414e-8f54-9d6c6291c284'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:41.505051 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-318a302f-4c3d-414e-8f54-9d6c6291c284 admin admin] The token cache is being invalidate because project 44f0cac099ba41b3a64543f44167d3d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:28:41.505339 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-318a302f-4c3d-414e-8f54-9d6c6291c284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:41.506007 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-318a302f-4c3d-414e-8f54-9d6c6291c284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:41.507506 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1428/2802] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:28:41 2022] DELETE /identity/v3/projects/44f0cac099ba41b3a64543f44167d3d0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:41.511480 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a82de-16a0-4080-b661-fed7ee627b2d service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:41.521499 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a82de-16a0-4080-b661-fed7ee627b2d service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:41.578099 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7256a7c-01ac-4cb7-ad8e-c5ac88e91e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:41.578752 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7256a7c-01ac-4cb7-ad8e-c5ac88e91e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:41.579029 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7256a7c-01ac-4cb7-ad8e-c5ac88e91e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:41.579307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7256a7c-01ac-4cb7-ad8e-c5ac88e91e22 admin admin] PATH_INFO: `/v3/users/4fda3e2ef82c4c5fa52216beec9636a1` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:41.580424 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7256a7c-01ac-4cb7-ad8e-c5ac88e91e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fda3e2ef82c4c5fa52216beec9636a1)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:41.582370 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7256a7c-01ac-4cb7-ad8e-c5ac88e91e22 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:41.583823 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:41.716932 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c7256a7c-01ac-4cb7-ad8e-c5ac88e91e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fda3e2ef82c4c5fa52216beec9636a1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:41.724578 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c7256a7c-01ac-4cb7-ad8e-c5ac88e91e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fda3e2ef82c4c5fa52216beec9636a1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:41.725246 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c7256a7c-01ac-4cb7-ad8e-c5ac88e91e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fda3e2ef82c4c5fa52216beec9636a1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:41.725878 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c7256a7c-01ac-4cb7-ad8e-c5ac88e91e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fda3e2ef82c4c5fa52216beec9636a1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:41.790175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c7256a7c-01ac-4cb7-ad8e-c5ac88e91e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fda3e2ef82c4c5fa52216beec9636a1'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:41.809133 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1375/2803] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:28:41 2022] DELETE /identity/v3/users/4fda3e2ef82c4c5fa52216beec9636a1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:42.328533 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a302f-4c3d-414e-8f54-9d6c6291c284 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:42.330134 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-318a302f-4c3d-414e-8f54-9d6c6291c284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:42.343071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a302f-4c3d-414e-8f54-9d6c6291c284 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:42.418393 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c893e4-7a4c-4e3f-b54b-456a3762b101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:42.419016 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c893e4-7a4c-4e3f-b54b-456a3762b101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:42.419724 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c893e4-7a4c-4e3f-b54b-456a3762b101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:42.419724 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c893e4-7a4c-4e3f-b54b-456a3762b101 admin admin] PATH_INFO: `/v3/projects/8e1abad63905480d860f9d72408f3d71` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:42.421223 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c893e4-7a4c-4e3f-b54b-456a3762b101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1abad63905480d860f9d72408f3d71)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:42.424763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c893e4-7a4c-4e3f-b54b-456a3762b101 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:42.552086 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47c893e4-7a4c-4e3f-b54b-456a3762b101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1abad63905480d860f9d72408f3d71', 'request_id': 'req-47c893e4-7a4c-4e3f-b54b-456a3762b101'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:42.556650 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:42.557848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47c893e4-7a4c-4e3f-b54b-456a3762b101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1abad63905480d860f9d72408f3d71', 'request_id': 'req-47c893e4-7a4c-4e3f-b54b-456a3762b101'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:42.659463 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47c893e4-7a4c-4e3f-b54b-456a3762b101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1abad63905480d860f9d72408f3d71', 'request_id': 'req-47c893e4-7a4c-4e3f-b54b-456a3762b101'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:42.671369 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47c893e4-7a4c-4e3f-b54b-456a3762b101 admin admin] The token cache is being invalidate because project 8e1abad63905480d860f9d72408f3d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:28:42.671665 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47c893e4-7a4c-4e3f-b54b-456a3762b101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:42.672316 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-47c893e4-7a4c-4e3f-b54b-456a3762b101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:42.673986 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1429/2804] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:28:42 2022] DELETE /identity/v3/projects/8e1abad63905480d860f9d72408f3d71 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:42.680314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cc8dc-081e-4a38-984c-87a54e9f9689 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:42.680830 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cc8dc-081e-4a38-984c-87a54e9f9689 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:42.680948 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cc8dc-081e-4a38-984c-87a54e9f9689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:42.701928 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-7a7cc8dc-081e-4a38-984c-87a54e9f9689 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:42.711251 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7a7cc8dc-081e-4a38-984c-87a54e9f9689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:42.762288 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1376/2805] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:42.770061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d627193-bb73-465f-9e1e-ec289337bca8 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:42.770380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d627193-bb73-465f-9e1e-ec289337bca8 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:42.770657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d627193-bb73-465f-9e1e-ec289337bca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:42.791153 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7d627193-bb73-465f-9e1e-ec289337bca8 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:42.792361 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7d627193-bb73-465f-9e1e-ec289337bca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:42.802321 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1430/2806] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:42.806533 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cc8dc-081e-4a38-984c-87a54e9f9689 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:42.816689 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cc8dc-081e-4a38-984c-87a54e9f9689 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:42.821305 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50edbe-b012-46a5-bfe2-b35eea586624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:42.821932 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50edbe-b012-46a5-bfe2-b35eea586624 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:42.822213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50edbe-b012-46a5-bfe2-b35eea586624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:42.822542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50edbe-b012-46a5-bfe2-b35eea586624 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:42.823213 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50edbe-b012-46a5-bfe2-b35eea586624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:28:42.823524 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50edbe-b012-46a5-bfe2-b35eea586624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:42.825114 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50edbe-b012-46a5-bfe2-b35eea586624 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:42.836792 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1377/2807] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:28:42.841076 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d627193-bb73-465f-9e1e-ec289337bca8 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:42.850512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d627193-bb73-465f-9e1e-ec289337bca8 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:42.855236 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4128c8-a6d2-4993-bc25-9da2747756c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:42.855844 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4128c8-a6d2-4993-bc25-9da2747756c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:42.856116 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4128c8-a6d2-4993-bc25-9da2747756c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:42.856386 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4128c8-a6d2-4993-bc25-9da2747756c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:42.857009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4128c8-a6d2-4993-bc25-9da2747756c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:42.859560 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4128c8-a6d2-4993-bc25-9da2747756c8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:42.947060 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1431/2808] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:28:42 2022] POST /identity/v3/projects => generated 391 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:28:42.952166 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50edbe-b012-46a5-bfe2-b35eea586624 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:42.962280 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50edbe-b012-46a5-bfe2-b35eea586624 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:43.024580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f22ba-666b-4975-ba4a-479118430e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:43.025208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f22ba-666b-4975-ba4a-479118430e28 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:43.025410 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f22ba-666b-4975-ba4a-479118430e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:43.025682 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f22ba-666b-4975-ba4a-479118430e28 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:43.026459 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f22ba-666b-4975-ba4a-479118430e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:43.028505 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f22ba-666b-4975-ba4a-479118430e28 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:43.041655 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:43.165485 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1378/2809] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:28:42 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:28:43.167712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4128c8-a6d2-4993-bc25-9da2747756c8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:43.178418 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4128c8-a6d2-4993-bc25-9da2747756c8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:43.183065 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87eef48-4e8f-49c3-a15c-9812c1b16ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:43.183720 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87eef48-4e8f-49c3-a15c-9812c1b16ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:43.184004 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87eef48-4e8f-49c3-a15c-9812c1b16ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:43.184275 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87eef48-4e8f-49c3-a15c-9812c1b16ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:43.184952 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87eef48-4e8f-49c3-a15c-9812c1b16ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:43.186579 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87eef48-4e8f-49c3-a15c-9812c1b16ed9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:43.198937 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1432/2810] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:28:43.203286 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f22ba-666b-4975-ba4a-479118430e28 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:43.214025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f22ba-666b-4975-ba4a-479118430e28 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:43.218942 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c20cd-37af-457d-a86f-a3aef7f14d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:43.219647 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c20cd-37af-457d-a86f-a3aef7f14d68 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:43.219927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c20cd-37af-457d-a86f-a3aef7f14d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:43.220204 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c20cd-37af-457d-a86f-a3aef7f14d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:43.220851 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c20cd-37af-457d-a86f-a3aef7f14d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:43.222495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c20cd-37af-457d-a86f-a3aef7f14d68 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:43.233485 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1379/2811] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:28:43.237945 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87eef48-4e8f-49c3-a15c-9812c1b16ed9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:43.248028 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87eef48-4e8f-49c3-a15c-9812c1b16ed9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:43.253437 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb03f8-85c0-47c7-91d0-96f44ebb6b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:43.254298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb03f8-85c0-47c7-91d0-96f44ebb6b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:43.254644 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb03f8-85c0-47c7-91d0-96f44ebb6b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:43.255000 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb03f8-85c0-47c7-91d0-96f44ebb6b2b admin admin] PATH_INFO: `/v3/projects/38616320f7a142c4bb6c75d94ec3f931/users/0badfbe24e904260a331c7a27a2ea6d9/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:43.272279 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb03f8-85c0-47c7-91d0-96f44ebb6b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=38616320f7a142c4bb6c75d94ec3f931, user_id=0badfbe24e904260a331c7a27a2ea6d9, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:43.275068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb03f8-85c0-47c7-91d0-96f44ebb6b2b admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:43.356263 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1433/2812] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:28:43 2022] PUT /identity/v3/projects/38616320f7a142c4bb6c75d94ec3f931/users/0badfbe24e904260a331c7a27a2ea6d9/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:43.366798 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112a767-1021-49fa-a843-43588fc028d5 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:43.367166 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112a767-1021-49fa-a843-43588fc028d5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:43.367510 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112a767-1021-49fa-a843-43588fc028d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:43.396191 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f112a767-1021-49fa-a843-43588fc028d5 None None] MFA Rules not processed for user `0badfbe24e904260a331c7a27a2ea6d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:43.397425 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f112a767-1021-49fa-a843-43588fc028d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:43.470002 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1380/2813] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:43.480908 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb03f8-85c0-47c7-91d0-96f44ebb6b2b admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:43.485194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c0eb03f8-85c0-47c7-91d0-96f44ebb6b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:43.559037 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb03f8-85c0-47c7-91d0-96f44ebb6b2b admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:43.563502 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa5a61-188b-4bde-a470-8a3b9fe3ed8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:43.564127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa5a61-188b-4bde-a470-8a3b9fe3ed8a service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:43.564405 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa5a61-188b-4bde-a470-8a3b9fe3ed8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:43.564816 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa5a61-188b-4bde-a470-8a3b9fe3ed8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:43.574567 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa5a61-188b-4bde-a470-8a3b9fe3ed8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:43.576248 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa5a61-188b-4bde-a470-8a3b9fe3ed8a service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:43.588201 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1434/2814] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:53.459479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=39 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:53.583919 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=58,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:28:55.020923 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112a767-1021-49fa-a843-43588fc028d5 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:55.084157 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112a767-1021-49fa-a843-43588fc028d5 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:55.088852 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7932b8-8d4e-489f-98f9-4bf906f59803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:55.089514 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7932b8-8d4e-489f-98f9-4bf906f59803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:55.089798 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7932b8-8d4e-489f-98f9-4bf906f59803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:55.090071 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7932b8-8d4e-489f-98f9-4bf906f59803 admin admin] PATH_INFO: `/v3/users/0badfbe24e904260a331c7a27a2ea6d9` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:55.091318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7932b8-8d4e-489f-98f9-4bf906f59803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0badfbe24e904260a331c7a27a2ea6d9)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:55.093949 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7932b8-8d4e-489f-98f9-4bf906f59803 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:55.311558 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2e7932b8-8d4e-489f-98f9-4bf906f59803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0badfbe24e904260a331c7a27a2ea6d9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:55.318432 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2e7932b8-8d4e-489f-98f9-4bf906f59803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0badfbe24e904260a331c7a27a2ea6d9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:55.319090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2e7932b8-8d4e-489f-98f9-4bf906f59803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0badfbe24e904260a331c7a27a2ea6d9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:55.319686 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2e7932b8-8d4e-489f-98f9-4bf906f59803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0badfbe24e904260a331c7a27a2ea6d9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:55.379270 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-2e7932b8-8d4e-489f-98f9-4bf906f59803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0badfbe24e904260a331c7a27a2ea6d9'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:55.397279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1381/2815] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:28:55 2022] DELETE /identity/v3/users/0badfbe24e904260a331c7a27a2ea6d9 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:28:55.401742 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165a7b2-7bf2-4662-8fa4-1991dc2339d0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:55.402245 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165a7b2-7bf2-4662-8fa4-1991dc2339d0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:55.402346 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165a7b2-7bf2-4662-8fa4-1991dc2339d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:55.421577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-7165a7b2-7bf2-4662-8fa4-1991dc2339d0 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:28:55.422838 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7165a7b2-7bf2-4662-8fa4-1991dc2339d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:55.479500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1435/2816] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:28:55.489315 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7932b8-8d4e-489f-98f9-4bf906f59803 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:55.490755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-2e7932b8-8d4e-489f-98f9-4bf906f59803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:55.547856 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7932b8-8d4e-489f-98f9-4bf906f59803 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:55.551439 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c4357-f9bb-4233-898f-65b9b24e4d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:55.552040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c4357-f9bb-4233-898f-65b9b24e4d6c service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:55.552319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c4357-f9bb-4233-898f-65b9b24e4d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:55.552586 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c4357-f9bb-4233-898f-65b9b24e4d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:55.561343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c4357-f9bb-4233-898f-65b9b24e4d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:55.562867 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c4357-f9bb-4233-898f-65b9b24e4d6c service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:55.572050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1382/2817] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:28:55.964419 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165a7b2-7bf2-4662-8fa4-1991dc2339d0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:28:55.965921 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7165a7b2-7bf2-4662-8fa4-1991dc2339d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:28:55.980264 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165a7b2-7bf2-4662-8fa4-1991dc2339d0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:28:55.984973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc766600-a4a9-42cd-857a-3ff7b06cf9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:28:55.986314 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc766600-a4a9-42cd-857a-3ff7b06cf9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:28:55.986771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc766600-a4a9-42cd-857a-3ff7b06cf9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:28:55.987054 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc766600-a4a9-42cd-857a-3ff7b06cf9d8 admin admin] PATH_INFO: `/v3/projects/38616320f7a142c4bb6c75d94ec3f931` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:28:55.988181 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc766600-a4a9-42cd-857a-3ff7b06cf9d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38616320f7a142c4bb6c75d94ec3f931)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:28:55.990246 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc766600-a4a9-42cd-857a-3ff7b06cf9d8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:28:56.117069 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bc766600-a4a9-42cd-857a-3ff7b06cf9d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38616320f7a142c4bb6c75d94ec3f931', 'request_id': 'req-bc766600-a4a9-42cd-857a-3ff7b06cf9d8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:56.122476 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bc766600-a4a9-42cd-857a-3ff7b06cf9d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38616320f7a142c4bb6c75d94ec3f931', 'request_id': 'req-bc766600-a4a9-42cd-857a-3ff7b06cf9d8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:56.225512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bc766600-a4a9-42cd-857a-3ff7b06cf9d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38616320f7a142c4bb6c75d94ec3f931', 'request_id': 'req-bc766600-a4a9-42cd-857a-3ff7b06cf9d8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:56.237565 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bc766600-a4a9-42cd-857a-3ff7b06cf9d8 admin admin] The token cache is being invalidate because project 38616320f7a142c4bb6c75d94ec3f931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:28:56.242488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bc766600-a4a9-42cd-857a-3ff7b06cf9d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:56.242488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-bc766600-a4a9-42cd-857a-3ff7b06cf9d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:28:56.242725 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1436/2818] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:28:55 2022] DELETE /identity/v3/projects/38616320f7a142c4bb6c75d94ec3f931 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:29:05.567954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:29:06.233725 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:29:59.615404 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c4357-f9bb-4233-898f-65b9b24e4d6c service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:29:59.616793 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3d5c4357-f9bb-4233-898f-65b9b24e4d6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:29:59.688290 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c4357-f9bb-4233-898f-65b9b24e4d6c service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:29:59.750414 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a0a57-bd32-4919-b6b0-d3c5c6a2d7d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:29:59.751015 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a0a57-bd32-4919-b6b0-d3c5c6a2d7d5 service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:29:59.751290 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a0a57-bd32-4919-b6b0-d3c5c6a2d7d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:29:59.751557 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a0a57-bd32-4919-b6b0-d3c5c6a2d7d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:29:59.753254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0f1a0a57-bd32-4919-b6b0-d3c5c6a2d7d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:29:59.810679 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a0a57-bd32-4919-b6b0-d3c5c6a2d7d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:29:59.812263 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a0a57-bd32-4919-b6b0-d3c5c6a2d7d5 service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:29:59.821696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1383/2819] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:29:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:30:09.818965 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=84 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:30:14.941993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ebcc1-5bd7-46ef-9ddd-1dd9b750fb25 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:30:14.942536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ebcc1-5bd7-46ef-9ddd-1dd9b750fb25 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:30:14.942536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ebcc1-5bd7-46ef-9ddd-1dd9b750fb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:30:14.962170 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-026ebcc1-5bd7-46ef-9ddd-1dd9b750fb25 None None] MFA Rules not processed for user `d125613b28fa4191b96d927aedf51b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:30:14.963381 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-026ebcc1-5bd7-46ef-9ddd-1dd9b750fb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:30:14.970298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1437/2820] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:30:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:30:15.274674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a0a57-bd32-4919-b6b0-d3c5c6a2d7d5 service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:30:15.276190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-0f1a0a57-bd32-4919-b6b0-d3c5c6a2d7d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:30:15.332080 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a0a57-bd32-4919-b6b0-d3c5c6a2d7d5 service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:30:15.335671 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c2057-be35-42e7-9798-9c8c61b535a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:30:15.336262 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c2057-be35-42e7-9798-9c8c61b535a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:30:15.336537 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c2057-be35-42e7-9798-9c8c61b535a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:30:15.336802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c2057-be35-42e7-9798-9c8c61b535a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:30:15.338503 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e05c2057-be35-42e7-9798-9c8c61b535a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:30:15.347675 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c2057-be35-42e7-9798-9c8c61b535a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:30:15.349084 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c2057-be35-42e7-9798-9c8c61b535a6 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:30:15.356992 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1384/2821] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:30:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:30:24.693415 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ebcc1-5bd7-46ef-9ddd-1dd9b750fb25 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:30:24.694976 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-026ebcc1-5bd7-46ef-9ddd-1dd9b750fb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:30:24.707798 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ebcc1-5bd7-46ef-9ddd-1dd9b750fb25 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:30:24.711402 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022c917-70ae-4386-99db-41af0a408794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:30:24.712001 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022c917-70ae-4386-99db-41af0a408794 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:30:24.712277 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022c917-70ae-4386-99db-41af0a408794 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:30:24.712543 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022c917-70ae-4386-99db-41af0a408794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:30:24.714252 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c022c917-70ae-4386-99db-41af0a408794 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:30:24.774532 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022c917-70ae-4386-99db-41af0a408794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:30:24.775959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022c917-70ae-4386-99db-41af0a408794 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:30:24.787129 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1438/2822] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:30:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:30:24.790607 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c2057-be35-42e7-9798-9c8c61b535a6 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:30:24.792961 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-e05c2057-be35-42e7-9798-9c8c61b535a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:30:24.809219 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c2057-be35-42e7-9798-9c8c61b535a6 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:30:24.815349 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ef353-5d93-416e-8e2b-6bdfae1c3a6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:30:24.816169 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ef353-5d93-416e-8e2b-6bdfae1c3a6d service nova] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:30:24.816560 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ef353-5d93-416e-8e2b-6bdfae1c3a6d service nova] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:30:24.816834 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ef353-5d93-416e-8e2b-6bdfae1c3a6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:30:24.818729 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-3b8ef353-5d93-416e-8e2b-6bdfae1c3a6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:30:24.833078 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ef353-5d93-416e-8e2b-6bdfae1c3a6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:30:24.834716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ef353-5d93-416e-8e2b-6bdfae1c3a6d service nova] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:30:24.845874 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1385/2823] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:30:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:30:30.460165 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022c917-70ae-4386-99db-41af0a408794 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:30:30.461831 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-c022c917-70ae-4386-99db-41af0a408794 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:30:30.478613 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022c917-70ae-4386-99db-41af0a408794 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:30:30.484343 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62025e-f464-4c58-997b-b1026ee34c08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2cfda1bec35145f3bbcc13fae0b7af2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:30:30.485027 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62025e-f464-4c58-997b-b1026ee34c08 service nova] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:30:30.485552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62025e-f464-4c58-997b-b1026ee34c08 service nova] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:30:30.485893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62025e-f464-4c58-997b-b1026ee34c08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:30:30.488081 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0a62025e-f464-4c58-997b-b1026ee34c08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:30:30.504558 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62025e-f464-4c58-997b-b1026ee34c08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:30:30.504558 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62025e-f464-4c58-997b-b1026ee34c08 service nova] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:30:30.516291 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1439/2824] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:30:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:30:31.506165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ef353-5d93-416e-8e2b-6bdfae1c3a6d service nova] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:30:31.522069 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ef353-5d93-416e-8e2b-6bdfae1c3a6d service nova] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:30:31.525786 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cf83e-b073-45c9-95ec-6a7158d1963d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:30:31.526406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cf83e-b073-45c9-95ec-6a7158d1963d service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:30:31.526713 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cf83e-b073-45c9-95ec-6a7158d1963d service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:30:31.526986 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cf83e-b073-45c9-95ec-6a7158d1963d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:30:31.529155 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-616cf83e-b073-45c9-95ec-6a7158d1963d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:30:31.600698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616cf83e-b073-45c9-95ec-6a7158d1963d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:30:31.602373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616cf83e-b073-45c9-95ec-6a7158d1963d service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:30:31.614987 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1386/2825] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:30:35.054892 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62025e-f464-4c58-997b-b1026ee34c08 service nova] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:30:35.056111 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0a62025e-f464-4c58-997b-b1026ee34c08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:30:35.130114 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62025e-f464-4c58-997b-b1026ee34c08 service nova] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:30:35.135345 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabba3c-fb73-4871-9ca7-8fa26241a3ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6172f0733384291992624ef6a527ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:30:35.135956 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabba3c-fb73-4871-9ca7-8fa26241a3ef service placement] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:30:35.139465 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabba3c-fb73-4871-9ca7-8fa26241a3ef service placement] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:30:35.139465 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabba3c-fb73-4871-9ca7-8fa26241a3ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:30:35.139465 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-beabba3c-fb73-4871-9ca7-8fa26241a3ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:30:35.151305 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabba3c-fb73-4871-9ca7-8fa26241a3ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:30:35.153573 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabba3c-fb73-4871-9ca7-8fa26241a3ef service placement] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:30:35.170605 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1440/2826] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:30:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:30:38.866410 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cf83e-b073-45c9-95ec-6a7158d1963d service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:30:38.867891 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-616cf83e-b073-45c9-95ec-6a7158d1963d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:30:38.881400 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cf83e-b073-45c9-95ec-6a7158d1963d service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:30:38.886392 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb019c80-01dc-4039-a515-c611a6360951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:30:38.887024 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb019c80-01dc-4039-a515-c611a6360951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:30:38.887306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb019c80-01dc-4039-a515-c611a6360951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:30:38.887573 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb019c80-01dc-4039-a515-c611a6360951 admin admin] PATH_INFO: `/v3/users/dc00c0a80f7b4ea5acd190b44fe46429` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:30:38.888698 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb019c80-01dc-4039-a515-c611a6360951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc00c0a80f7b4ea5acd190b44fe46429)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:30:38.890643 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb019c80-01dc-4039-a515-c611a6360951 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:30:39.137231 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fb019c80-01dc-4039-a515-c611a6360951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc00c0a80f7b4ea5acd190b44fe46429'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:39.145299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fb019c80-01dc-4039-a515-c611a6360951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc00c0a80f7b4ea5acd190b44fe46429'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:39.146038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fb019c80-01dc-4039-a515-c611a6360951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc00c0a80f7b4ea5acd190b44fe46429'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:39.146650 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fb019c80-01dc-4039-a515-c611a6360951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc00c0a80f7b4ea5acd190b44fe46429'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:39.242432 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fb019c80-01dc-4039-a515-c611a6360951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc00c0a80f7b4ea5acd190b44fe46429'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:39.255291 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:30:39.262651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1387/2827] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:30:38 2022] DELETE /identity/v3/users/dc00c0a80f7b4ea5acd190b44fe46429 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:30:39.542522 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabba3c-fb73-4871-9ca7-8fa26241a3ef service placement] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:30:39.548189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=70 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:30:39.554338 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabba3c-fb73-4871-9ca7-8fa26241a3ef service placement] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:30:39.615512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3facce-4372-4715-a834-389515221ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:30:39.616455 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3facce-4372-4715-a834-389515221ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:30:39.616735 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3facce-4372-4715-a834-389515221ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:30:39.617010 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3facce-4372-4715-a834-389515221ea1 admin admin] PATH_INFO: `/v3/projects/9f976d3c0ec647caa6e003edcb024b28` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:30:39.618241 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3facce-4372-4715-a834-389515221ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f976d3c0ec647caa6e003edcb024b28)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:30:39.620164 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3facce-4372-4715-a834-389515221ea1 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:30:39.743784 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ff3facce-4372-4715-a834-389515221ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f976d3c0ec647caa6e003edcb024b28', 'request_id': 'req-ff3facce-4372-4715-a834-389515221ea1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:39.749361 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ff3facce-4372-4715-a834-389515221ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f976d3c0ec647caa6e003edcb024b28', 'request_id': 'req-ff3facce-4372-4715-a834-389515221ea1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:39.819802 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ff3facce-4372-4715-a834-389515221ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f976d3c0ec647caa6e003edcb024b28', 'request_id': 'req-ff3facce-4372-4715-a834-389515221ea1'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:39.832221 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ff3facce-4372-4715-a834-389515221ea1 admin admin] The token cache is being invalidate because project 9f976d3c0ec647caa6e003edcb024b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:30:39.832513 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ff3facce-4372-4715-a834-389515221ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:39.833213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ff3facce-4372-4715-a834-389515221ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:39.834887 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1441/2828] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:30:39 2022] DELETE /identity/v3/projects/9f976d3c0ec647caa6e003edcb024b28 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:30:39.839058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb019c80-01dc-4039-a515-c611a6360951 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:30:39.842170 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fb019c80-01dc-4039-a515-c611a6360951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:30:39.855641 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb019c80-01dc-4039-a515-c611a6360951 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:30:39.915798 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95ec99-2da2-4378-a46d-8771214fa70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:30:39.919321 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95ec99-2da2-4378-a46d-8771214fa70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:30:39.919321 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95ec99-2da2-4378-a46d-8771214fa70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:30:39.919321 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95ec99-2da2-4378-a46d-8771214fa70b admin admin] PATH_INFO: `/v3/users/d10d0dcb949b4f4d8736edf0410e2371` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:30:39.919321 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95ec99-2da2-4378-a46d-8771214fa70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d10d0dcb949b4f4d8736edf0410e2371)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:30:39.920308 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95ec99-2da2-4378-a46d-8771214fa70b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:30:40.122007 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fe95ec99-2da2-4378-a46d-8771214fa70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd10d0dcb949b4f4d8736edf0410e2371'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:40.128681 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fe95ec99-2da2-4378-a46d-8771214fa70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd10d0dcb949b4f4d8736edf0410e2371'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:40.129523 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fe95ec99-2da2-4378-a46d-8771214fa70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd10d0dcb949b4f4d8736edf0410e2371'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:40.130139 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fe95ec99-2da2-4378-a46d-8771214fa70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd10d0dcb949b4f4d8736edf0410e2371'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:40.179719 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-fe95ec99-2da2-4378-a46d-8771214fa70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd10d0dcb949b4f4d8736edf0410e2371'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:40.199690 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1388/2829] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:30:39 2022] DELETE /identity/v3/users/d10d0dcb949b4f4d8736edf0410e2371 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:30:40.455548 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3facce-4372-4715-a834-389515221ea1 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:30:40.457134 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ff3facce-4372-4715-a834-389515221ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:30:40.472068 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3facce-4372-4715-a834-389515221ea1 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:30:40.549404 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0254f-ee2c-4e14-beab-c3d9d6c8abd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:30:40.550196 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0254f-ee2c-4e14-beab-c3d9d6c8abd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:30:40.550488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0254f-ee2c-4e14-beab-c3d9d6c8abd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:30:40.550766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0254f-ee2c-4e14-beab-c3d9d6c8abd8 admin admin] PATH_INFO: `/v3/projects/29649b91a75c4cd1bbeed4b1caf93057` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:30:40.551946 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0254f-ee2c-4e14-beab-c3d9d6c8abd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29649b91a75c4cd1bbeed4b1caf93057)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:30:40.553918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0254f-ee2c-4e14-beab-c3d9d6c8abd8 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:30:40.657201 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:30:40.667537 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-11b0254f-ee2c-4e14-beab-c3d9d6c8abd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29649b91a75c4cd1bbeed4b1caf93057', 'request_id': 'req-11b0254f-ee2c-4e14-beab-c3d9d6c8abd8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:40.673545 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-11b0254f-ee2c-4e14-beab-c3d9d6c8abd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29649b91a75c4cd1bbeed4b1caf93057', 'request_id': 'req-11b0254f-ee2c-4e14-beab-c3d9d6c8abd8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:40.768668 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-11b0254f-ee2c-4e14-beab-c3d9d6c8abd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29649b91a75c4cd1bbeed4b1caf93057', 'request_id': 'req-11b0254f-ee2c-4e14-beab-c3d9d6c8abd8'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:40.780694 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-11b0254f-ee2c-4e14-beab-c3d9d6c8abd8 admin admin] The token cache is being invalidate because project 29649b91a75c4cd1bbeed4b1caf93057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:30:40.780990 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-11b0254f-ee2c-4e14-beab-c3d9d6c8abd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:40.781686 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-11b0254f-ee2c-4e14-beab-c3d9d6c8abd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:30:40.784117 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1442/2830] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:30:40 2022] DELETE /identity/v3/projects/29649b91a75c4cd1bbeed4b1caf93057 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:30:50.194965 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:30:50.860148 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=5,keystone:SELECT=11,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:31:56.589401 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95ec99-2da2-4378-a46d-8771214fa70b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:31:56.591428 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-fe95ec99-2da2-4378-a46d-8771214fa70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:31:56.667879 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95ec99-2da2-4378-a46d-8771214fa70b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:31:56.737793 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebfe25-5d63-40d7-9d8e-6b6a700e3a1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6172f0733384291992624ef6a527ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:31:56.738449 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebfe25-5d63-40d7-9d8e-6b6a700e3a1d service placement] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:31:56.738726 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebfe25-5d63-40d7-9d8e-6b6a700e3a1d service placement] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:31:56.738995 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebfe25-5d63-40d7-9d8e-6b6a700e3a1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:31:56.740777 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-74ebfe25-5d63-40d7-9d8e-6b6a700e3a1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:31:56.753317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebfe25-5d63-40d7-9d8e-6b6a700e3a1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:31:56.755048 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebfe25-5d63-40d7-9d8e-6b6a700e3a1d service placement] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:31:56.765345 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1389/2831] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:31:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:32:02.918066 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0254f-ee2c-4e14-beab-c3d9d6c8abd8 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:02.919708 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-11b0254f-ee2c-4e14-beab-c3d9d6c8abd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:02.975384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0254f-ee2c-4e14-beab-c3d9d6c8abd8 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:02.978993 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0281e7-d946-42c6-acf3-296ba707b440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:02.979594 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0281e7-d946-42c6-acf3-296ba707b440 service neutron] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:02.979869 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0281e7-d946-42c6-acf3-296ba707b440 service neutron] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:02.980141 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0281e7-d946-42c6-acf3-296ba707b440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:02.981847 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9c0281e7-d946-42c6-acf3-296ba707b440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:03.042260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0281e7-d946-42c6-acf3-296ba707b440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:03.043714 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0281e7-d946-42c6-acf3-296ba707b440 service neutron] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:03.053539 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1443/2832] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:32:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:32:06.299895 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebfe25-5d63-40d7-9d8e-6b6a700e3a1d service placement] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:06.301685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-74ebfe25-5d63-40d7-9d8e-6b6a700e3a1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:06.316398 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebfe25-5d63-40d7-9d8e-6b6a700e3a1d service placement] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:06.321112 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbb8ad-f35e-4b16-bfff-37b7cfc7e894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:06.321768 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbb8ad-f35e-4b16-bfff-37b7cfc7e894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:06.322047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbb8ad-f35e-4b16-bfff-37b7cfc7e894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:06.322318 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbb8ad-f35e-4b16-bfff-37b7cfc7e894 admin admin] PATH_INFO: `/v3/users/d125613b28fa4191b96d927aedf51b09` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:06.323410 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbb8ad-f35e-4b16-bfff-37b7cfc7e894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d125613b28fa4191b96d927aedf51b09)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:06.325605 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbb8ad-f35e-4b16-bfff-37b7cfc7e894 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:06.552226 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7cfbb8ad-f35e-4b16-bfff-37b7cfc7e894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd125613b28fa4191b96d927aedf51b09'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:06.559240 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7cfbb8ad-f35e-4b16-bfff-37b7cfc7e894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd125613b28fa4191b96d927aedf51b09'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:06.559919 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7cfbb8ad-f35e-4b16-bfff-37b7cfc7e894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd125613b28fa4191b96d927aedf51b09'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:06.560526 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7cfbb8ad-f35e-4b16-bfff-37b7cfc7e894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd125613b28fa4191b96d927aedf51b09'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:06.618394 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7cfbb8ad-f35e-4b16-bfff-37b7cfc7e894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd125613b28fa4191b96d927aedf51b09'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:06.637780 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1390/2833] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:32:06 2022] DELETE /identity/v3/users/d125613b28fa4191b96d927aedf51b09 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:32:06.895761 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0281e7-d946-42c6-acf3-296ba707b440 service neutron] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:06.907192 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0281e7-d946-42c6-acf3-296ba707b440 service neutron] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:06.966884 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547d8d0-bc76-4a43-88cb-cddfa242beb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:06.967510 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547d8d0-bc76-4a43-88cb-cddfa242beb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:06.967789 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547d8d0-bc76-4a43-88cb-cddfa242beb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:06.968061 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547d8d0-bc76-4a43-88cb-cddfa242beb7 admin admin] PATH_INFO: `/v3/projects/3b9ac8393e6142cea3c0a8cf26da5b64` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:06.969150 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547d8d0-bc76-4a43-88cb-cddfa242beb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9ac8393e6142cea3c0a8cf26da5b64)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:06.971080 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547d8d0-bc76-4a43-88cb-cddfa242beb7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:07.075552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d547d8d0-bc76-4a43-88cb-cddfa242beb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9ac8393e6142cea3c0a8cf26da5b64', 'request_id': 'req-d547d8d0-bc76-4a43-88cb-cddfa242beb7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:07.077376 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:07.081170 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d547d8d0-bc76-4a43-88cb-cddfa242beb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9ac8393e6142cea3c0a8cf26da5b64', 'request_id': 'req-d547d8d0-bc76-4a43-88cb-cddfa242beb7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:07.155331 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d547d8d0-bc76-4a43-88cb-cddfa242beb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9ac8393e6142cea3c0a8cf26da5b64', 'request_id': 'req-d547d8d0-bc76-4a43-88cb-cddfa242beb7'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:07.167103 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d547d8d0-bc76-4a43-88cb-cddfa242beb7 admin admin] The token cache is being invalidate because project 3b9ac8393e6142cea3c0a8cf26da5b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:32:07.167383 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d547d8d0-bc76-4a43-88cb-cddfa242beb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:07.168015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d547d8d0-bc76-4a43-88cb-cddfa242beb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:07.169756 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1444/2834] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:32:06 2022] DELETE /identity/v3/projects/3b9ac8393e6142cea3c0a8cf26da5b64 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:32:07.174780 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2b893-c766-41c2-82c8-fd19d0537c40 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:07.175070 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2b893-c766-41c2-82c8-fd19d0537c40 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:07.175366 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2b893-c766-41c2-82c8-fd19d0537c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:07.183913 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:07.195220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-c6f2b893-c766-41c2-82c8-fd19d0537c40 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:07.196429 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-c6f2b893-c766-41c2-82c8-fd19d0537c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:07.255595 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1391/2835] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:32:07.263403 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f71fa-504d-4a3b-99d2-d8f36ebc3b1c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:07.263693 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f71fa-504d-4a3b-99d2-d8f36ebc3b1c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:07.263970 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f71fa-504d-4a3b-99d2-d8f36ebc3b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:07.283400 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-9d4f71fa-504d-4a3b-99d2-d8f36ebc3b1c None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:07.285118 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-9d4f71fa-504d-4a3b-99d2-d8f36ebc3b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:07.293045 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1445/2836] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:32:07.297432 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2b893-c766-41c2-82c8-fd19d0537c40 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:07.308150 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2b893-c766-41c2-82c8-fd19d0537c40 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:07.314123 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd329918-1fe7-44d0-b3f8-5bfa347e197e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:07.314740 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd329918-1fe7-44d0-b3f8-5bfa347e197e admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:07.315163 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd329918-1fe7-44d0-b3f8-5bfa347e197e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:07.315699 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd329918-1fe7-44d0-b3f8-5bfa347e197e admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:07.316604 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd329918-1fe7-44d0-b3f8-5bfa347e197e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:32:07.317057 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd329918-1fe7-44d0-b3f8-5bfa347e197e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:07.319296 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd329918-1fe7-44d0-b3f8-5bfa347e197e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:07.333563 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1392/2837] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:32:07.337547 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f71fa-504d-4a3b-99d2-d8f36ebc3b1c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:07.348512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f71fa-504d-4a3b-99d2-d8f36ebc3b1c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:07.353336 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa2b6b-3233-4f8e-8227-fc782d8e3bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:07.354041 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa2b6b-3233-4f8e-8227-fc782d8e3bac admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:07.354386 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa2b6b-3233-4f8e-8227-fc782d8e3bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:07.354763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa2b6b-3233-4f8e-8227-fc782d8e3bac admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:07.355545 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa2b6b-3233-4f8e-8227-fc782d8e3bac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:07.357396 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa2b6b-3233-4f8e-8227-fc782d8e3bac admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:07.465891 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1446/2838] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:32:07 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:32:07.470045 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd329918-1fe7-44d0-b3f8-5bfa347e197e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:07.481191 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd329918-1fe7-44d0-b3f8-5bfa347e197e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:07.538373 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b235e-6672-4e27-84a4-2154ec8b1e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:07.538974 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b235e-6672-4e27-84a4-2154ec8b1e73 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:07.539258 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b235e-6672-4e27-84a4-2154ec8b1e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:07.539526 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b235e-6672-4e27-84a4-2154ec8b1e73 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:07.540193 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b235e-6672-4e27-84a4-2154ec8b1e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:07.542287 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b235e-6672-4e27-84a4-2154ec8b1e73 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:07.635427 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1393/2839] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:32:07 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:32:07.639578 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa2b6b-3233-4f8e-8227-fc782d8e3bac admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:07.650382 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa2b6b-3233-4f8e-8227-fc782d8e3bac admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:07.655160 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558ab8c-33a8-4a89-b0be-5b2aad9d35fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:07.655754 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558ab8c-33a8-4a89-b0be-5b2aad9d35fa admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:07.656035 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558ab8c-33a8-4a89-b0be-5b2aad9d35fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:07.656421 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558ab8c-33a8-4a89-b0be-5b2aad9d35fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:07.657071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558ab8c-33a8-4a89-b0be-5b2aad9d35fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:07.658688 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558ab8c-33a8-4a89-b0be-5b2aad9d35fa admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:07.669111 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1447/2840] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:32:07.673304 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b235e-6672-4e27-84a4-2154ec8b1e73 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:07.683700 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b235e-6672-4e27-84a4-2154ec8b1e73 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:07.688495 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac6ac8-dfab-4d27-97b3-5c83ebfe969f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:07.689095 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac6ac8-dfab-4d27-97b3-5c83ebfe969f admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:07.689379 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac6ac8-dfab-4d27-97b3-5c83ebfe969f admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:07.689691 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac6ac8-dfab-4d27-97b3-5c83ebfe969f admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:07.690422 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac6ac8-dfab-4d27-97b3-5c83ebfe969f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:07.692223 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac6ac8-dfab-4d27-97b3-5c83ebfe969f admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:07.702766 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1394/2841] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:32:07.707435 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558ab8c-33a8-4a89-b0be-5b2aad9d35fa admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:07.717334 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558ab8c-33a8-4a89-b0be-5b2aad9d35fa admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:07.721928 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591bd0f-2d6c-4a2b-bbaa-b10f591b3679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:07.723191 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591bd0f-2d6c-4a2b-bbaa-b10f591b3679 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:07.723472 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591bd0f-2d6c-4a2b-bbaa-b10f591b3679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:07.723747 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591bd0f-2d6c-4a2b-bbaa-b10f591b3679 admin admin] PATH_INFO: `/v3/projects/08cb2030626b4b179cf02856255360ff/users/be0e1e995ebe4e1bb9306fc5f1aa7128/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:07.737799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591bd0f-2d6c-4a2b-bbaa-b10f591b3679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08cb2030626b4b179cf02856255360ff, user_id=be0e1e995ebe4e1bb9306fc5f1aa7128, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:07.740397 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7591bd0f-2d6c-4a2b-bbaa-b10f591b3679 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:07.806829 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1448/2842] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:32:07 2022] PUT /identity/v3/projects/08cb2030626b4b179cf02856255360ff/users/be0e1e995ebe4e1bb9306fc5f1aa7128/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:32:07.822201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a325e22-362d-4d4c-8ca9-7322929ee8c6 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:07.822479 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a325e22-362d-4d4c-8ca9-7322929ee8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:07.822745 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a325e22-362d-4d4c-8ca9-7322929ee8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:07.852187 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-4a325e22-362d-4d4c-8ca9-7322929ee8c6 None None] MFA Rules not processed for user `be0e1e995ebe4e1bb9306fc5f1aa7128`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:07.853399 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-4a325e22-362d-4d4c-8ca9-7322929ee8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:07.912817 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:07.916424 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1395/2843] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:32:07.928739 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591bd0f-2d6c-4a2b-bbaa-b10f591b3679 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:07.930247 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-7591bd0f-2d6c-4a2b-bbaa-b10f591b3679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:07.987740 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591bd0f-2d6c-4a2b-bbaa-b10f591b3679 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:07.991293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3efff-5ed7-4046-9f93-2fa87bdb574f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:07.991895 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3efff-5ed7-4046-9f93-2fa87bdb574f service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:07.992174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3efff-5ed7-4046-9f93-2fa87bdb574f service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:07.992449 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3efff-5ed7-4046-9f93-2fa87bdb574f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:08.000493 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3efff-5ed7-4046-9f93-2fa87bdb574f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:08.001962 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3efff-5ed7-4046-9f93-2fa87bdb574f service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:08.011489 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1449/2844] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:32:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:32:17.565444 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a325e22-362d-4d4c-8ca9-7322929ee8c6 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:17.627558 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a325e22-362d-4d4c-8ca9-7322929ee8c6 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:17.632168 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa592cf-38d5-4dd0-949f-3de6260d1a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:17.632772 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa592cf-38d5-4dd0-949f-3de6260d1a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:17.633053 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa592cf-38d5-4dd0-949f-3de6260d1a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:17.633329 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa592cf-38d5-4dd0-949f-3de6260d1a20 admin admin] PATH_INFO: `/v3/users/be0e1e995ebe4e1bb9306fc5f1aa7128` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:17.634548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa592cf-38d5-4dd0-949f-3de6260d1a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be0e1e995ebe4e1bb9306fc5f1aa7128)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:17.636454 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa592cf-38d5-4dd0-949f-3de6260d1a20 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:17.803417 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ffa592cf-38d5-4dd0-949f-3de6260d1a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be0e1e995ebe4e1bb9306fc5f1aa7128'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:17.810830 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ffa592cf-38d5-4dd0-949f-3de6260d1a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be0e1e995ebe4e1bb9306fc5f1aa7128'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:17.811489 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ffa592cf-38d5-4dd0-949f-3de6260d1a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be0e1e995ebe4e1bb9306fc5f1aa7128'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:17.812143 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ffa592cf-38d5-4dd0-949f-3de6260d1a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be0e1e995ebe4e1bb9306fc5f1aa7128'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:17.875208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ffa592cf-38d5-4dd0-949f-3de6260d1a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be0e1e995ebe4e1bb9306fc5f1aa7128'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:17.892835 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1396/2845] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:32:17 2022] DELETE /identity/v3/users/be0e1e995ebe4e1bb9306fc5f1aa7128 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:32:17.897567 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cec93d-5d61-440f-9f5e-aa82cc77cd6d None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:17.898077 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cec93d-5d61-440f-9f5e-aa82cc77cd6d None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:17.898198 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cec93d-5d61-440f-9f5e-aa82cc77cd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:17.916878 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-36cec93d-5d61-440f-9f5e-aa82cc77cd6d None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:17.918106 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-36cec93d-5d61-440f-9f5e-aa82cc77cd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:17.976170 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1450/2846] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:32:17.986088 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa592cf-38d5-4dd0-949f-3de6260d1a20 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:17.987554 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ffa592cf-38d5-4dd0-949f-3de6260d1a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:18.043634 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa592cf-38d5-4dd0-949f-3de6260d1a20 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:18.047542 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb372d-0cee-4727-9d81-550d58bee782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:18.048136 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb372d-0cee-4727-9d81-550d58bee782 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:18.048414 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb372d-0cee-4727-9d81-550d58bee782 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:18.048686 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb372d-0cee-4727-9d81-550d58bee782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:18.057642 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb372d-0cee-4727-9d81-550d58bee782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:18.059102 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb372d-0cee-4727-9d81-550d58bee782 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:18.068696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1397/2847] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:32:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:32:18.437156 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cec93d-5d61-440f-9f5e-aa82cc77cd6d None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:18.438687 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-36cec93d-5d61-440f-9f5e-aa82cc77cd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:18.451366 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cec93d-5d61-440f-9f5e-aa82cc77cd6d None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:18.456544 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acd0fea-49d5-47e2-958d-981bbcff284d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:18.456781 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd0fea-49d5-47e2-958d-981bbcff284d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:18.456982 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd0fea-49d5-47e2-958d-981bbcff284d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:18.457258 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acd0fea-49d5-47e2-958d-981bbcff284d admin admin] PATH_INFO: `/v3/projects/08cb2030626b4b179cf02856255360ff` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:18.458459 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd0fea-49d5-47e2-958d-981bbcff284d admin admin] RBAC: Authorizing `identity:delete_project(project_id=08cb2030626b4b179cf02856255360ff)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:18.461413 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acd0fea-49d5-47e2-958d-981bbcff284d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:18.478169 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:18.557313 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3acd0fea-49d5-47e2-958d-981bbcff284d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08cb2030626b4b179cf02856255360ff', 'request_id': 'req-3acd0fea-49d5-47e2-958d-981bbcff284d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:18.562718 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3acd0fea-49d5-47e2-958d-981bbcff284d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08cb2030626b4b179cf02856255360ff', 'request_id': 'req-3acd0fea-49d5-47e2-958d-981bbcff284d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:18.618386 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3acd0fea-49d5-47e2-958d-981bbcff284d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08cb2030626b4b179cf02856255360ff', 'request_id': 'req-3acd0fea-49d5-47e2-958d-981bbcff284d'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:18.629694 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3acd0fea-49d5-47e2-958d-981bbcff284d admin admin] The token cache is being invalidate because project 08cb2030626b4b179cf02856255360ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:32:18.629985 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3acd0fea-49d5-47e2-958d-981bbcff284d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:18.630625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-3acd0fea-49d5-47e2-958d-981bbcff284d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:18.632631 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1451/2848] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:32:18 2022] DELETE /identity/v3/projects/08cb2030626b4b179cf02856255360ff => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:32:18.637585 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd395130-249c-4478-86c7-ae97e2d0872f None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:18.644216 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd395130-249c-4478-86c7-ae97e2d0872f None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:18.644216 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd395130-249c-4478-86c7-ae97e2d0872f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:18.657651 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-dd395130-249c-4478-86c7-ae97e2d0872f None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:18.658853 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-dd395130-249c-4478-86c7-ae97e2d0872f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:18.676626 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:18.719204 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1398/2849] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:32:18.727127 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c319a-2206-48c7-acc0-b7741c348496 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:18.727410 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c319a-2206-48c7-acc0-b7741c348496 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:18.727687 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c319a-2206-48c7-acc0-b7741c348496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:18.747471 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-726c319a-2206-48c7-acc0-b7741c348496 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:18.748664 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-726c319a-2206-48c7-acc0-b7741c348496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:18.756384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1452/2850] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:32:18.761062 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd395130-249c-4478-86c7-ae97e2d0872f None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:18.770758 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd395130-249c-4478-86c7-ae97e2d0872f None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:18.775667 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcae98-e769-4b5d-97b0-8345689fedc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:18.776263 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcae98-e769-4b5d-97b0-8345689fedc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:18.776545 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcae98-e769-4b5d-97b0-8345689fedc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:18.776819 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcae98-e769-4b5d-97b0-8345689fedc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:18.777513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcae98-e769-4b5d-97b0-8345689fedc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:32:18.777828 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcae98-e769-4b5d-97b0-8345689fedc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:18.779420 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcae98-e769-4b5d-97b0-8345689fedc5 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:18.791175 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1399/2851] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:32:18.795545 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c319a-2206-48c7-acc0-b7741c348496 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:18.805234 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c319a-2206-48c7-acc0-b7741c348496 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:18.809800 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c20124-5536-4118-8a2e-f51f1036e330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:18.810384 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c20124-5536-4118-8a2e-f51f1036e330 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:18.810660 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c20124-5536-4118-8a2e-f51f1036e330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:18.810929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c20124-5536-4118-8a2e-f51f1036e330 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:18.811552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c20124-5536-4118-8a2e-f51f1036e330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:18.813424 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c20124-5536-4118-8a2e-f51f1036e330 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:18.899906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1453/2852] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:32:18 2022] POST /identity/v3/projects => generated 355 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:32:18.904037 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcae98-e769-4b5d-97b0-8345689fedc5 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:18.914193 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcae98-e769-4b5d-97b0-8345689fedc5 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:18.969496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01480f-4137-4819-99e2-0d1c6308888b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:18.970092 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01480f-4137-4819-99e2-0d1c6308888b admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:18.970369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01480f-4137-4819-99e2-0d1c6308888b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:18.970636 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01480f-4137-4819-99e2-0d1c6308888b admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:18.971254 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01480f-4137-4819-99e2-0d1c6308888b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:18.973151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01480f-4137-4819-99e2-0d1c6308888b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:19.052866 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1400/2853] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:32:18 2022] POST /identity/v3/users => generated 278 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:32:19.057359 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c20124-5536-4118-8a2e-f51f1036e330 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:19.067612 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c20124-5536-4118-8a2e-f51f1036e330 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:19.072883 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e7380-c5aa-4ddc-b150-cc59c6cd83e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:19.079478 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e7380-c5aa-4ddc-b150-cc59c6cd83e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:19.079478 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e7380-c5aa-4ddc-b150-cc59c6cd83e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:19.079478 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e7380-c5aa-4ddc-b150-cc59c6cd83e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:19.079478 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e7380-c5aa-4ddc-b150-cc59c6cd83e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:19.079478 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e7380-c5aa-4ddc-b150-cc59c6cd83e9 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:19.085893 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1454/2854] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:32:19.089734 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01480f-4137-4819-99e2-0d1c6308888b admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:19.099669 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01480f-4137-4819-99e2-0d1c6308888b admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:19.104836 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825636b2-8d32-43cb-b1bb-3bb68dcfd324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:19.105427 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825636b2-8d32-43cb-b1bb-3bb68dcfd324 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:19.105743 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825636b2-8d32-43cb-b1bb-3bb68dcfd324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:19.106020 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825636b2-8d32-43cb-b1bb-3bb68dcfd324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:19.106656 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825636b2-8d32-43cb-b1bb-3bb68dcfd324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:19.108246 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825636b2-8d32-43cb-b1bb-3bb68dcfd324 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:19.119362 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1401/2855] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:32:19.123474 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e7380-c5aa-4ddc-b150-cc59c6cd83e9 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:19.133194 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e7380-c5aa-4ddc-b150-cc59c6cd83e9 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:19.137704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7005501-ad22-4f48-ad29-87952ef483cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:19.138336 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7005501-ad22-4f48-ad29-87952ef483cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:19.138611 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7005501-ad22-4f48-ad29-87952ef483cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:19.138880 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7005501-ad22-4f48-ad29-87952ef483cc admin admin] PATH_INFO: `/v3/projects/cb8babb1af0f42daabb45c5ecea3aac4/users/1c6536b81a9c40cdadf0cf5892f07db4/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:19.152904 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7005501-ad22-4f48-ad29-87952ef483cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb8babb1af0f42daabb45c5ecea3aac4, user_id=1c6536b81a9c40cdadf0cf5892f07db4, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:19.155500 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7005501-ad22-4f48-ad29-87952ef483cc admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:19.217953 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1455/2856] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:32:19 2022] PUT /identity/v3/projects/cb8babb1af0f42daabb45c5ecea3aac4/users/1c6536b81a9c40cdadf0cf5892f07db4/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:32:19.228972 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802684b-450c-448c-b9ef-4f9f41338852 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:19.229260 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802684b-450c-448c-b9ef-4f9f41338852 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:19.229576 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802684b-450c-448c-b9ef-4f9f41338852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:19.257253 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-f802684b-450c-448c-b9ef-4f9f41338852 None None] MFA Rules not processed for user `1c6536b81a9c40cdadf0cf5892f07db4`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:19.258528 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-f802684b-450c-448c-b9ef-4f9f41338852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:19.321889 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1402/2857] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:32:19.326260 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7005501-ad22-4f48-ad29-87952ef483cc admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:19.387080 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7005501-ad22-4f48-ad29-87952ef483cc admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:19.391701 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4632c-cfc9-4aaa-b4d8-30f2ca7080ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:19.392293 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4632c-cfc9-4aaa-b4d8-30f2ca7080ec admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:19.392573 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4632c-cfc9-4aaa-b4d8-30f2ca7080ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:19.392845 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4632c-cfc9-4aaa-b4d8-30f2ca7080ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:19.393482 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4632c-cfc9-4aaa-b4d8-30f2ca7080ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:19.395378 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4632c-cfc9-4aaa-b4d8-30f2ca7080ec admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:19.500723 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1456/2858] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:32:19 2022] POST /identity/v3/projects => generated 353 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:32:19.504617 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802684b-450c-448c-b9ef-4f9f41338852 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:19.516278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802684b-450c-448c-b9ef-4f9f41338852 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:19.528386 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:19.573155 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632cadc-fe06-4c4f-9bc2-e3b857739060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:19.573775 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632cadc-fe06-4c4f-9bc2-e3b857739060 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:19.574055 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632cadc-fe06-4c4f-9bc2-e3b857739060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:19.574354 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632cadc-fe06-4c4f-9bc2-e3b857739060 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:19.574982 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632cadc-fe06-4c4f-9bc2-e3b857739060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:19.577016 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632cadc-fe06-4c4f-9bc2-e3b857739060 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:19.709755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1403/2859] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:32:19 2022] POST /identity/v3/users => generated 283 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:32:19.713830 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4632c-cfc9-4aaa-b4d8-30f2ca7080ec admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:19.724093 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4632c-cfc9-4aaa-b4d8-30f2ca7080ec admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:19.729009 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cf9d0-b7bb-4954-965d-24b6444d0615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:19.729638 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cf9d0-b7bb-4954-965d-24b6444d0615 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:19.729918 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cf9d0-b7bb-4954-965d-24b6444d0615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:19.730189 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cf9d0-b7bb-4954-965d-24b6444d0615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:19.730825 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cf9d0-b7bb-4954-965d-24b6444d0615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:19.732497 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cf9d0-b7bb-4954-965d-24b6444d0615 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:19.743448 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1457/2860] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:32:19.747418 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632cadc-fe06-4c4f-9bc2-e3b857739060 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:19.758229 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632cadc-fe06-4c4f-9bc2-e3b857739060 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:19.762736 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617906d-61ae-40df-9f6c-9625464e22e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:19.763378 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617906d-61ae-40df-9f6c-9625464e22e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:19.763661 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617906d-61ae-40df-9f6c-9625464e22e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:19.763930 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617906d-61ae-40df-9f6c-9625464e22e8 admin admin] PATH_INFO: `/v3/projects/49e1183c29904011ba171ce32220e114/users/28f0fdebe5524ee8aedc88d07dfdbe19/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:19.779712 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617906d-61ae-40df-9f6c-9625464e22e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e1183c29904011ba171ce32220e114, user_id=28f0fdebe5524ee8aedc88d07dfdbe19, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:19.782445 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617906d-61ae-40df-9f6c-9625464e22e8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:19.846790 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1404/2861] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:32:19 2022] PUT /identity/v3/projects/49e1183c29904011ba171ce32220e114/users/28f0fdebe5524ee8aedc88d07dfdbe19/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:32:19.851511 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cf9d0-b7bb-4954-965d-24b6444d0615 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:19.861233 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cf9d0-b7bb-4954-965d-24b6444d0615 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:19.870631 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:19.915688 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87b6a0-4cd6-407a-bc78-3fee01743561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:19.916336 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87b6a0-4cd6-407a-bc78-3fee01743561 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:19.916579 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87b6a0-4cd6-407a-bc78-3fee01743561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:19.916852 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87b6a0-4cd6-407a-bc78-3fee01743561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:19.917533 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87b6a0-4cd6-407a-bc78-3fee01743561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:19.919128 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87b6a0-4cd6-407a-bc78-3fee01743561 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:19.929319 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1458/2862] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:32:19.933739 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617906d-61ae-40df-9f6c-9625464e22e8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:19.943951 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617906d-61ae-40df-9f6c-9625464e22e8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:19.949291 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6b8d3-dfd3-4e6e-b754-f81680c0316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:19.949960 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6b8d3-dfd3-4e6e-b754-f81680c0316a admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:19.950239 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6b8d3-dfd3-4e6e-b754-f81680c0316a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:19.950516 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6b8d3-dfd3-4e6e-b754-f81680c0316a admin admin] PATH_INFO: `/v3/projects/49e1183c29904011ba171ce32220e114/users/28f0fdebe5524ee8aedc88d07dfdbe19/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:19.952413 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6b8d3-dfd3-4e6e-b754-f81680c0316a admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e1183c29904011ba171ce32220e114, user_id=28f0fdebe5524ee8aedc88d07dfdbe19, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:19.955071 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6b8d3-dfd3-4e6e-b754-f81680c0316a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:19.966027 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1405/2863] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:32:19 2022] PUT /identity/v3/projects/49e1183c29904011ba171ce32220e114/users/28f0fdebe5524ee8aedc88d07dfdbe19/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:32:19.977567 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e43256-7571-4916-a9cf-388769340e48 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:19.977884 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e43256-7571-4916-a9cf-388769340e48 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:19.978157 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e43256-7571-4916-a9cf-388769340e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:20.005267 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-39e43256-7571-4916-a9cf-388769340e48 None None] MFA Rules not processed for user `28f0fdebe5524ee8aedc88d07dfdbe19`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:20.006980 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-39e43256-7571-4916-a9cf-388769340e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:20.074491 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1459/2864] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:19 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:32:20.086096 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6b8d3-dfd3-4e6e-b754-f81680c0316a admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:20.087796 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-aae6b8d3-dfd3-4e6e-b754-f81680c0316a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:20.143693 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6b8d3-dfd3-4e6e-b754-f81680c0316a admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:20.147864 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26801a53-5e1c-4e95-8ed5-4b4622a32814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:20.148453 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26801a53-5e1c-4e95-8ed5-4b4622a32814 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:20.148726 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26801a53-5e1c-4e95-8ed5-4b4622a32814 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:20.148993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26801a53-5e1c-4e95-8ed5-4b4622a32814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:20.157727 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26801a53-5e1c-4e95-8ed5-4b4622a32814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:20.159141 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26801a53-5e1c-4e95-8ed5-4b4622a32814 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:20.168212 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1406/2865] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:32:20 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:32:20.350998 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e43256-7571-4916-a9cf-388769340e48 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:20.360612 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e43256-7571-4916-a9cf-388769340e48 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:20.364208 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226404ca-83b4-4786-81fe-604349ddc8fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:20.364799 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226404ca-83b4-4786-81fe-604349ddc8fa service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:20.365076 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226404ca-83b4-4786-81fe-604349ddc8fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:20.365362 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226404ca-83b4-4786-81fe-604349ddc8fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:20.421536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226404ca-83b4-4786-81fe-604349ddc8fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:20.422913 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226404ca-83b4-4786-81fe-604349ddc8fa service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:20.432409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1460/2866] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:32:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 19:32:30.164193 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=62,keystone:INSERT=5 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:30.427772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=85 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:37.530272 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26801a53-5e1c-4e95-8ed5-4b4622a32814 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:37.591955 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26801a53-5e1c-4e95-8ed5-4b4622a32814 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:37.596454 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010d27e-0868-462f-b5e6-7253b9418a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:37.597077 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010d27e-0868-462f-b5e6-7253b9418a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:37.597357 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010d27e-0868-462f-b5e6-7253b9418a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:37.597659 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010d27e-0868-462f-b5e6-7253b9418a18 admin admin] PATH_INFO: `/v3/users/1c6536b81a9c40cdadf0cf5892f07db4` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:37.598790 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010d27e-0868-462f-b5e6-7253b9418a18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c6536b81a9c40cdadf0cf5892f07db4)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:37.600709 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010d27e-0868-462f-b5e6-7253b9418a18 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:37.837594 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7010d27e-0868-462f-b5e6-7253b9418a18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c6536b81a9c40cdadf0cf5892f07db4'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:37.848746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7010d27e-0868-462f-b5e6-7253b9418a18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c6536b81a9c40cdadf0cf5892f07db4'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:37.848746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7010d27e-0868-462f-b5e6-7253b9418a18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c6536b81a9c40cdadf0cf5892f07db4'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:37.848746 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7010d27e-0868-462f-b5e6-7253b9418a18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c6536b81a9c40cdadf0cf5892f07db4'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:37.904194 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-7010d27e-0868-462f-b5e6-7253b9418a18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c6536b81a9c40cdadf0cf5892f07db4'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:37.922414 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1407/2867] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:32:37 2022] DELETE /identity/v3/users/1c6536b81a9c40cdadf0cf5892f07db4 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:32:37.926906 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd6dd0-b8ad-49e5-8ca5-6dbc5a884974 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:37.927402 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd6dd0-b8ad-49e5-8ca5-6dbc5a884974 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:37.927506 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd6dd0-b8ad-49e5-8ca5-6dbc5a884974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:37.946911 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-65dd6dd0-b8ad-49e5-8ca5-6dbc5a884974 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:37.948117 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-65dd6dd0-b8ad-49e5-8ca5-6dbc5a884974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:38.005444 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1461/2868] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:32:38.015379 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010d27e-0868-462f-b5e6-7253b9418a18 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:38.016763 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-7010d27e-0868-462f-b5e6-7253b9418a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:38.073951 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010d27e-0868-462f-b5e6-7253b9418a18 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:38.077880 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57a78e-fd19-44f1-9a88-f0b4fd11e35c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:38.078484 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57a78e-fd19-44f1-9a88-f0b4fd11e35c service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:38.078786 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57a78e-fd19-44f1-9a88-f0b4fd11e35c service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:38.079058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57a78e-fd19-44f1-9a88-f0b4fd11e35c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:38.088078 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57a78e-fd19-44f1-9a88-f0b4fd11e35c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:38.089728 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57a78e-fd19-44f1-9a88-f0b4fd11e35c service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:38.099388 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1408/2869] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:32:38.506842 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd6dd0-b8ad-49e5-8ca5-6dbc5a884974 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:38.508582 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-65dd6dd0-b8ad-49e5-8ca5-6dbc5a884974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:38.524852 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd6dd0-b8ad-49e5-8ca5-6dbc5a884974 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:38.530298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02d53d-ff2f-4709-8cb4-4a225c8d4835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:38.530809 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02d53d-ff2f-4709-8cb4-4a225c8d4835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:38.531088 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02d53d-ff2f-4709-8cb4-4a225c8d4835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:38.531360 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02d53d-ff2f-4709-8cb4-4a225c8d4835 admin admin] PATH_INFO: `/v3/projects/cb8babb1af0f42daabb45c5ecea3aac4` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:38.532641 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02d53d-ff2f-4709-8cb4-4a225c8d4835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb8babb1af0f42daabb45c5ecea3aac4)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:38.534441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02d53d-ff2f-4709-8cb4-4a225c8d4835 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:38.635249 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ac02d53d-ff2f-4709-8cb4-4a225c8d4835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb8babb1af0f42daabb45c5ecea3aac4', 'request_id': 'req-ac02d53d-ff2f-4709-8cb4-4a225c8d4835'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:38.640789 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ac02d53d-ff2f-4709-8cb4-4a225c8d4835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb8babb1af0f42daabb45c5ecea3aac4', 'request_id': 'req-ac02d53d-ff2f-4709-8cb4-4a225c8d4835'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:38.715036 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ac02d53d-ff2f-4709-8cb4-4a225c8d4835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb8babb1af0f42daabb45c5ecea3aac4', 'request_id': 'req-ac02d53d-ff2f-4709-8cb4-4a225c8d4835'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:38.726025 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ac02d53d-ff2f-4709-8cb4-4a225c8d4835 admin admin] The token cache is being invalidate because project cb8babb1af0f42daabb45c5ecea3aac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:32:38.726308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ac02d53d-ff2f-4709-8cb4-4a225c8d4835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:38.726998 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-ac02d53d-ff2f-4709-8cb4-4a225c8d4835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:38.728501 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1462/2870] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:32:38 2022] DELETE /identity/v3/projects/cb8babb1af0f42daabb45c5ecea3aac4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:32:38.732597 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57a78e-fd19-44f1-9a88-f0b4fd11e35c service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:38.742090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57a78e-fd19-44f1-9a88-f0b4fd11e35c service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:38.760369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:38.798559 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491efa2-63a6-45fc-9c19-0a4543608d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:38.799223 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491efa2-63a6-45fc-9c19-0a4543608d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:38.799499 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491efa2-63a6-45fc-9c19-0a4543608d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:38.799770 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491efa2-63a6-45fc-9c19-0a4543608d30 admin admin] PATH_INFO: `/v3/users/28f0fdebe5524ee8aedc88d07dfdbe19` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:38.800912 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491efa2-63a6-45fc-9c19-0a4543608d30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28f0fdebe5524ee8aedc88d07dfdbe19)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:38.802876 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491efa2-63a6-45fc-9c19-0a4543608d30 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:39.014438 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a491efa2-63a6-45fc-9c19-0a4543608d30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28f0fdebe5524ee8aedc88d07dfdbe19'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:39.021203 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a491efa2-63a6-45fc-9c19-0a4543608d30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28f0fdebe5524ee8aedc88d07dfdbe19'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:39.021886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a491efa2-63a6-45fc-9c19-0a4543608d30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28f0fdebe5524ee8aedc88d07dfdbe19'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:39.022611 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a491efa2-63a6-45fc-9c19-0a4543608d30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28f0fdebe5524ee8aedc88d07dfdbe19'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:39.081050 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-a491efa2-63a6-45fc-9c19-0a4543608d30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28f0fdebe5524ee8aedc88d07dfdbe19'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:39.098668 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1409/2871] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:32:38 2022] DELETE /identity/v3/users/28f0fdebe5524ee8aedc88d07dfdbe19 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:32:39.488647 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02d53d-ff2f-4709-8cb4-4a225c8d4835 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:39.490269 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-ac02d53d-ff2f-4709-8cb4-4a225c8d4835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:39.510557 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02d53d-ff2f-4709-8cb4-4a225c8d4835 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:39.568495 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5502cb2-2722-453a-bea9-b3d3defd7b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:39.569050 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5502cb2-2722-453a-bea9-b3d3defd7b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:39.569330 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5502cb2-2722-453a-bea9-b3d3defd7b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:39.569639 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5502cb2-2722-453a-bea9-b3d3defd7b73 admin admin] PATH_INFO: `/v3/projects/49e1183c29904011ba171ce32220e114` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:39.571429 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5502cb2-2722-453a-bea9-b3d3defd7b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e1183c29904011ba171ce32220e114)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:39.573343 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5502cb2-2722-453a-bea9-b3d3defd7b73 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:39.677675 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:39.697584 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d5502cb2-2722-453a-bea9-b3d3defd7b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e1183c29904011ba171ce32220e114', 'request_id': 'req-d5502cb2-2722-453a-bea9-b3d3defd7b73'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:39.701297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d5502cb2-2722-453a-bea9-b3d3defd7b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e1183c29904011ba171ce32220e114', 'request_id': 'req-d5502cb2-2722-453a-bea9-b3d3defd7b73'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:39.755870 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d5502cb2-2722-453a-bea9-b3d3defd7b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e1183c29904011ba171ce32220e114', 'request_id': 'req-d5502cb2-2722-453a-bea9-b3d3defd7b73'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:39.768767 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d5502cb2-2722-453a-bea9-b3d3defd7b73 admin admin] The token cache is being invalidate because project 49e1183c29904011ba171ce32220e114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:32:39.769070 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d5502cb2-2722-453a-bea9-b3d3defd7b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:39.769847 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-d5502cb2-2722-453a-bea9-b3d3defd7b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:39.771329 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1463/2872] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:32:39 2022] DELETE /identity/v3/projects/49e1183c29904011ba171ce32220e114 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:32:39.776574 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edf2b3-6b62-4a2b-a1f2-43b9d3203fe5 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:39.777121 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edf2b3-6b62-4a2b-a1f2-43b9d3203fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:39.777406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edf2b3-6b62-4a2b-a1f2-43b9d3203fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:39.797991 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-83edf2b3-6b62-4a2b-a1f2-43b9d3203fe5 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:39.799202 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-83edf2b3-6b62-4a2b-a1f2-43b9d3203fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:39.857074 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1410/2873] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:32:39.864901 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bea5a4-2c4b-4597-90b3-723f0b608ced None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:39.865184 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bea5a4-2c4b-4597-90b3-723f0b608ced None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:39.865479 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bea5a4-2c4b-4597-90b3-723f0b608ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:39.885572 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-77bea5a4-2c4b-4597-90b3-723f0b608ced None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:39.886763 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-77bea5a4-2c4b-4597-90b3-723f0b608ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:39.894512 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1464/2874] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:32:39.898815 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edf2b3-6b62-4a2b-a1f2-43b9d3203fe5 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:39.908561 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edf2b3-6b62-4a2b-a1f2-43b9d3203fe5 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:39.913099 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f6596-eb97-4489-b10c-d3fe3fc8a917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:39.913730 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f6596-eb97-4489-b10c-d3fe3fc8a917 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:39.914005 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f6596-eb97-4489-b10c-d3fe3fc8a917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:39.914293 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f6596-eb97-4489-b10c-d3fe3fc8a917 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:39.914947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f6596-eb97-4489-b10c-d3fe3fc8a917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:32:39.915237 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f6596-eb97-4489-b10c-d3fe3fc8a917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:39.916821 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f6596-eb97-4489-b10c-d3fe3fc8a917 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:39.928241 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1411/2875] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:32:39.933086 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bea5a4-2c4b-4597-90b3-723f0b608ced None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:39.942370 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bea5a4-2c4b-4597-90b3-723f0b608ced None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:39.947637 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e676d9-6b34-4186-9a55-7ef4a772ecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:39.948219 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e676d9-6b34-4186-9a55-7ef4a772ecdb admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:39.948495 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e676d9-6b34-4186-9a55-7ef4a772ecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:39.948764 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e676d9-6b34-4186-9a55-7ef4a772ecdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:39.949434 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e676d9-6b34-4186-9a55-7ef4a772ecdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:39.951364 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e676d9-6b34-4186-9a55-7ef4a772ecdb admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:40.030803 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1465/2876] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:32:39 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:32:40.035040 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f6596-eb97-4489-b10c-d3fe3fc8a917 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:40.045826 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f6596-eb97-4489-b10c-d3fe3fc8a917 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:40.071755 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:40.101415 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0ad64-d782-4140-a1d9-78dd78412b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:40.102637 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0ad64-d782-4140-a1d9-78dd78412b4d admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:40.103151 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0ad64-d782-4140-a1d9-78dd78412b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:40.103481 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0ad64-d782-4140-a1d9-78dd78412b4d admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:40.104663 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0ad64-d782-4140-a1d9-78dd78412b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:40.106674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0ad64-d782-4140-a1d9-78dd78412b4d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:40.189723 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1412/2877] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:32:40 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:32:40.193599 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e676d9-6b34-4186-9a55-7ef4a772ecdb admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:40.203810 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e676d9-6b34-4186-9a55-7ef4a772ecdb admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:40.208290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6910b-9010-47b3-8cf3-00abeffed031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:40.208877 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6910b-9010-47b3-8cf3-00abeffed031 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:40.209154 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6910b-9010-47b3-8cf3-00abeffed031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:40.209423 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6910b-9010-47b3-8cf3-00abeffed031 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:40.210082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6910b-9010-47b3-8cf3-00abeffed031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:40.211704 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6910b-9010-47b3-8cf3-00abeffed031 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:40.221350 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1466/2878] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:32:40.225301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0ad64-d782-4140-a1d9-78dd78412b4d admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:40.235831 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0ad64-d782-4140-a1d9-78dd78412b4d admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:40.240431 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1f674-4592-42d9-a13f-b9c715abdf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:40.241020 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1f674-4592-42d9-a13f-b9c715abdf9d admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:40.241300 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1f674-4592-42d9-a13f-b9c715abdf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:40.241610 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1f674-4592-42d9-a13f-b9c715abdf9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:40.243007 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1f674-4592-42d9-a13f-b9c715abdf9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:40.244640 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1f674-4592-42d9-a13f-b9c715abdf9d admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:40.254993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1413/2879] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:32:40.258966 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6910b-9010-47b3-8cf3-00abeffed031 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:40.268901 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6910b-9010-47b3-8cf3-00abeffed031 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:40.273606 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889da446-0dca-4c6e-9d1b-e2c7498ba593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:40.274330 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889da446-0dca-4c6e-9d1b-e2c7498ba593 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:40.274610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889da446-0dca-4c6e-9d1b-e2c7498ba593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:40.274885 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889da446-0dca-4c6e-9d1b-e2c7498ba593 admin admin] PATH_INFO: `/v3/projects/4d7a2c9cfc7d4e6b86f7a52ffec668e0/users/d69b789c967644999d35ed565c3cb7a0/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:40.289745 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889da446-0dca-4c6e-9d1b-e2c7498ba593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7a2c9cfc7d4e6b86f7a52ffec668e0, user_id=d69b789c967644999d35ed565c3cb7a0, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:40.292409 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889da446-0dca-4c6e-9d1b-e2c7498ba593 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:40.349785 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1467/2880] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:32:40 2022] PUT /identity/v3/projects/4d7a2c9cfc7d4e6b86f7a52ffec668e0/users/d69b789c967644999d35ed565c3cb7a0/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:32:40.413404 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184da892-a47e-4f13-9973-87e34b487e0d None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:40.413716 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184da892-a47e-4f13-9973-87e34b487e0d None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:40.413993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184da892-a47e-4f13-9973-87e34b487e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:40.444096 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-184da892-a47e-4f13-9973-87e34b487e0d None None] MFA Rules not processed for user `d69b789c967644999d35ed565c3cb7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:40.445307 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-184da892-a47e-4f13-9973-87e34b487e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:40.509845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1414/2881] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:32:40.514569 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889da446-0dca-4c6e-9d1b-e2c7498ba593 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:40.577365 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889da446-0dca-4c6e-9d1b-e2c7498ba593 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:40.582012 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae4ff2-5957-413f-924e-5acfb005e59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:40.582608 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae4ff2-5957-413f-924e-5acfb005e59d admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:40.582890 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae4ff2-5957-413f-924e-5acfb005e59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:40.583166 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae4ff2-5957-413f-924e-5acfb005e59d admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:40.583795 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae4ff2-5957-413f-924e-5acfb005e59d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:40.585732 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae4ff2-5957-413f-924e-5acfb005e59d admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:40.671047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1468/2882] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:32:40 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:32:40.675278 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184da892-a47e-4f13-9973-87e34b487e0d None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:40.686916 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184da892-a47e-4f13-9973-87e34b487e0d None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:40.744805 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ead740-14f4-453f-bb1a-a51101057e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:40.745418 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ead740-14f4-453f-bb1a-a51101057e7a admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:40.745868 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ead740-14f4-453f-bb1a-a51101057e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:40.746153 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ead740-14f4-453f-bb1a-a51101057e7a admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:40.746786 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ead740-14f4-453f-bb1a-a51101057e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:40.748770 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ead740-14f4-453f-bb1a-a51101057e7a admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:40.818208 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1415/2883] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:32:40 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:32:40.822332 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae4ff2-5957-413f-924e-5acfb005e59d admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:40.832778 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae4ff2-5957-413f-924e-5acfb005e59d admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:40.839780 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1a474-9ede-47cd-b21a-44bb2f33d981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:40.840387 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1a474-9ede-47cd-b21a-44bb2f33d981 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:40.840666 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1a474-9ede-47cd-b21a-44bb2f33d981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:40.840939 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1a474-9ede-47cd-b21a-44bb2f33d981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:40.841645 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1a474-9ede-47cd-b21a-44bb2f33d981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:40.843252 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1a474-9ede-47cd-b21a-44bb2f33d981 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:40.854504 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1469/2884] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:32:40.858717 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ead740-14f4-453f-bb1a-a51101057e7a admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:40.869578 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ead740-14f4-453f-bb1a-a51101057e7a admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:40.874310 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814e70f-2882-4074-80b2-40c4d77fb418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:40.874947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814e70f-2882-4074-80b2-40c4d77fb418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:40.875335 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814e70f-2882-4074-80b2-40c4d77fb418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:40.875616 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814e70f-2882-4074-80b2-40c4d77fb418 admin admin] PATH_INFO: `/v3/projects/459bd486ac0d4132a44a1bc5096742d1/users/e188fb772a3e4c308d37f694add09aa3/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:40.890013 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814e70f-2882-4074-80b2-40c4d77fb418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=459bd486ac0d4132a44a1bc5096742d1, user_id=e188fb772a3e4c308d37f694add09aa3, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:40.892648 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814e70f-2882-4074-80b2-40c4d77fb418 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:40.955011 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1416/2885] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:32:40 2022] PUT /identity/v3/projects/459bd486ac0d4132a44a1bc5096742d1/users/e188fb772a3e4c308d37f694add09aa3/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:32:40.958972 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1a474-9ede-47cd-b21a-44bb2f33d981 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:40.969208 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1a474-9ede-47cd-b21a-44bb2f33d981 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:40.989207 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:41.025063 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d80a5-9cff-49be-ac47-c5af2421a045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:41.025691 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d80a5-9cff-49be-ac47-c5af2421a045 admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:41.025975 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d80a5-9cff-49be-ac47-c5af2421a045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:41.026248 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d80a5-9cff-49be-ac47-c5af2421a045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:41.026886 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d80a5-9cff-49be-ac47-c5af2421a045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:41.028480 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d80a5-9cff-49be-ac47-c5af2421a045 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:41.037868 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1470/2886] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 19:32:41.042886 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814e70f-2882-4074-80b2-40c4d77fb418 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:41.048613 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:41.053911 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814e70f-2882-4074-80b2-40c4d77fb418 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:41.059025 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcfb5c-49bb-44a4-ba29-a897a50a0539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:41.063513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcfb5c-49bb-44a4-ba29-a897a50a0539 admin admin] REQUEST_METHOD: `PUT` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:41.063513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcfb5c-49bb-44a4-ba29-a897a50a0539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:41.063513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcfb5c-49bb-44a4-ba29-a897a50a0539 admin admin] PATH_INFO: `/v3/projects/459bd486ac0d4132a44a1bc5096742d1/users/e188fb772a3e4c308d37f694add09aa3/roles/cc3fa8da8fea4b5893865a4f721f22cb` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:41.063513 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcfb5c-49bb-44a4-ba29-a897a50a0539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=459bd486ac0d4132a44a1bc5096742d1, user_id=e188fb772a3e4c308d37f694add09aa3, role_id=cc3fa8da8fea4b5893865a4f721f22cb)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:41.064840 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcfb5c-49bb-44a4-ba29-a897a50a0539 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:41.074929 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1417/2887] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:32:41 2022] PUT /identity/v3/projects/459bd486ac0d4132a44a1bc5096742d1/users/e188fb772a3e4c308d37f694add09aa3/roles/cc3fa8da8fea4b5893865a4f721f22cb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:32:41.084610 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590f071-0efa-4eec-bee0-aa9d83cfb45c None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:41.084903 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590f071-0efa-4eec-bee0-aa9d83cfb45c None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:41.085181 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590f071-0efa-4eec-bee0-aa9d83cfb45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:41.112797 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-0590f071-0efa-4eec-bee0-aa9d83cfb45c None None] MFA Rules not processed for user `e188fb772a3e4c308d37f694add09aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:41.114046 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0590f071-0efa-4eec-bee0-aa9d83cfb45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:41.181109 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1471/2888] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 19:32:41.191749 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcfb5c-49bb-44a4-ba29-a897a50a0539 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:41.193418 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-27fcfb5c-49bb-44a4-ba29-a897a50a0539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:41.249796 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcfb5c-49bb-44a4-ba29-a897a50a0539 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:41.253299 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5affc4-0015-402c-a59e-6275d97095a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:41.253927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5affc4-0015-402c-a59e-6275d97095a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:41.254202 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5affc4-0015-402c-a59e-6275d97095a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:41.254470 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5affc4-0015-402c-a59e-6275d97095a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:41.308877 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5affc4-0015-402c-a59e-6275d97095a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:41.310344 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5affc4-0015-402c-a59e-6275d97095a9 service cinder] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:41.318993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1418/2889] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:32:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:32:46.455159 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590f071-0efa-4eec-bee0-aa9d83cfb45c None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:46.458074 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-0590f071-0efa-4eec-bee0-aa9d83cfb45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:46.469337 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590f071-0efa-4eec-bee0-aa9d83cfb45c None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:46.472934 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5c2b0-5071-4d49-928a-449e392ff66a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:46.473564 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5c2b0-5071-4d49-928a-449e392ff66a service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:46.473838 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5c2b0-5071-4d49-928a-449e392ff66a service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:46.474106 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5c2b0-5071-4d49-928a-449e392ff66a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:46.483968 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5c2b0-5071-4d49-928a-449e392ff66a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:46.485552 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5c2b0-5071-4d49-928a-449e392ff66a service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:46.496122 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1472/2890] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:32:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:32:51.315165 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:52.295017 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5affc4-0015-402c-a59e-6275d97095a9 service cinder] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:52.357029 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5affc4-0015-402c-a59e-6275d97095a9 service cinder] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:52.361610 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1be723-270f-4495-980e-bd22f8d0fc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:52.362220 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1be723-270f-4495-980e-bd22f8d0fc70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:52.362498 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1be723-270f-4495-980e-bd22f8d0fc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:52.362767 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1be723-270f-4495-980e-bd22f8d0fc70 admin admin] PATH_INFO: `/v3/users/d69b789c967644999d35ed565c3cb7a0` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:52.363888 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1be723-270f-4495-980e-bd22f8d0fc70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69b789c967644999d35ed565c3cb7a0)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:52.365836 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1be723-270f-4495-980e-bd22f8d0fc70 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:52.541242 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5f1be723-270f-4495-980e-bd22f8d0fc70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69b789c967644999d35ed565c3cb7a0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:52.548421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5f1be723-270f-4495-980e-bd22f8d0fc70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69b789c967644999d35ed565c3cb7a0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:52.549095 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5f1be723-270f-4495-980e-bd22f8d0fc70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69b789c967644999d35ed565c3cb7a0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:52.549769 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5f1be723-270f-4495-980e-bd22f8d0fc70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69b789c967644999d35ed565c3cb7a0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:52.640726 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5f1be723-270f-4495-980e-bd22f8d0fc70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69b789c967644999d35ed565c3cb7a0'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:52.659009 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1419/2891] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:32:52 2022] DELETE /identity/v3/users/d69b789c967644999d35ed565c3cb7a0 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:32:52.663506 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a53e93-ec18-4581-ba5a-0ef87afd2174 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:52.664020 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a53e93-ec18-4581-ba5a-0ef87afd2174 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:52.664137 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a53e93-ec18-4581-ba5a-0ef87afd2174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:52.683318 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-32a53e93-ec18-4581-ba5a-0ef87afd2174 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:52.687926 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-32a53e93-ec18-4581-ba5a-0ef87afd2174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:52.742308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1473/2892] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:32:52.752467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1be723-270f-4495-980e-bd22f8d0fc70 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:52.753896 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5f1be723-270f-4495-980e-bd22f8d0fc70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:52.811191 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1be723-270f-4495-980e-bd22f8d0fc70 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:52.814793 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b082b-61fa-4f6b-b842-ebd68f4d6e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:52.815393 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b082b-61fa-4f6b-b842-ebd68f4d6e05 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:52.815674 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b082b-61fa-4f6b-b842-ebd68f4d6e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:52.815950 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b082b-61fa-4f6b-b842-ebd68f4d6e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:52.825115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b082b-61fa-4f6b-b842-ebd68f4d6e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:52.826599 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b082b-61fa-4f6b-b842-ebd68f4d6e05 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:52.835964 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1420/2893] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:32:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:32:53.208892 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a53e93-ec18-4581-ba5a-0ef87afd2174 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:53.213084 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-32a53e93-ec18-4581-ba5a-0ef87afd2174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:53.227986 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a53e93-ec18-4581-ba5a-0ef87afd2174 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:53.232771 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b6579-92a5-43b2-ac07-5679b355d740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:53.233432 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b6579-92a5-43b2-ac07-5679b355d740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:53.233761 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b6579-92a5-43b2-ac07-5679b355d740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:53.234015 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b6579-92a5-43b2-ac07-5679b355d740 admin admin] PATH_INFO: `/v3/projects/4d7a2c9cfc7d4e6b86f7a52ffec668e0` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:53.235174 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b6579-92a5-43b2-ac07-5679b355d740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d7a2c9cfc7d4e6b86f7a52ffec668e0)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:53.237096 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b6579-92a5-43b2-ac07-5679b355d740 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:53.335183 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:53.350290 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4b0b6579-92a5-43b2-ac07-5679b355d740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d7a2c9cfc7d4e6b86f7a52ffec668e0', 'request_id': 'req-4b0b6579-92a5-43b2-ac07-5679b355d740'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:53.356339 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4b0b6579-92a5-43b2-ac07-5679b355d740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d7a2c9cfc7d4e6b86f7a52ffec668e0', 'request_id': 'req-4b0b6579-92a5-43b2-ac07-5679b355d740'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:53.418525 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4b0b6579-92a5-43b2-ac07-5679b355d740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d7a2c9cfc7d4e6b86f7a52ffec668e0', 'request_id': 'req-4b0b6579-92a5-43b2-ac07-5679b355d740'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:53.430376 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4b0b6579-92a5-43b2-ac07-5679b355d740 admin admin] The token cache is being invalidate because project 4d7a2c9cfc7d4e6b86f7a52ffec668e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:32:53.430696 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4b0b6579-92a5-43b2-ac07-5679b355d740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:53.431759 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-4b0b6579-92a5-43b2-ac07-5679b355d740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:53.433236 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1474/2894] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:32:53 2022] DELETE /identity/v3/projects/4d7a2c9cfc7d4e6b86f7a52ffec668e0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:32:53.437397 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b082b-61fa-4f6b-b842-ebd68f4d6e05 service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:53.447090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b082b-61fa-4f6b-b842-ebd68f4d6e05 service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:53.465306 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:53.504075 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c117fa06-fa1b-4dd9-803f-8f13e923da7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:53.505070 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117fa06-fa1b-4dd9-803f-8f13e923da7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:53.505408 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117fa06-fa1b-4dd9-803f-8f13e923da7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:53.505707 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c117fa06-fa1b-4dd9-803f-8f13e923da7b admin admin] PATH_INFO: `/v3/users/e188fb772a3e4c308d37f694add09aa3` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:53.506845 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117fa06-fa1b-4dd9-803f-8f13e923da7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e188fb772a3e4c308d37f694add09aa3)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:53.509407 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c117fa06-fa1b-4dd9-803f-8f13e923da7b admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:53.648471 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c117fa06-fa1b-4dd9-803f-8f13e923da7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e188fb772a3e4c308d37f694add09aa3'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:53.656026 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c117fa06-fa1b-4dd9-803f-8f13e923da7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e188fb772a3e4c308d37f694add09aa3'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:53.656736 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c117fa06-fa1b-4dd9-803f-8f13e923da7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e188fb772a3e4c308d37f694add09aa3'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:53.657417 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c117fa06-fa1b-4dd9-803f-8f13e923da7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e188fb772a3e4c308d37f694add09aa3'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:53.738057 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-c117fa06-fa1b-4dd9-803f-8f13e923da7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e188fb772a3e4c308d37f694add09aa3'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:53.755950 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1421/2895] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:32:53 2022] DELETE /identity/v3/users/e188fb772a3e4c308d37f694add09aa3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:32:54.128461 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b6579-92a5-43b2-ac07-5679b355d740 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:54.133019 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-4b0b6579-92a5-43b2-ac07-5679b355d740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:54.144798 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b6579-92a5-43b2-ac07-5679b355d740 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:54.202244 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c873e18-7237-4ff5-93f1-6ae2f067a079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:54.202801 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c873e18-7237-4ff5-93f1-6ae2f067a079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:54.203082 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c873e18-7237-4ff5-93f1-6ae2f067a079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:54.203357 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c873e18-7237-4ff5-93f1-6ae2f067a079 admin admin] PATH_INFO: `/v3/projects/459bd486ac0d4132a44a1bc5096742d1` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:54.204481 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c873e18-7237-4ff5-93f1-6ae2f067a079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=459bd486ac0d4132a44a1bc5096742d1)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:54.206487 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c873e18-7237-4ff5-93f1-6ae2f067a079 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:54.304299 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6c873e18-7237-4ff5-93f1-6ae2f067a079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '459bd486ac0d4132a44a1bc5096742d1', 'request_id': 'req-6c873e18-7237-4ff5-93f1-6ae2f067a079'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:54.310263 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6c873e18-7237-4ff5-93f1-6ae2f067a079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '459bd486ac0d4132a44a1bc5096742d1', 'request_id': 'req-6c873e18-7237-4ff5-93f1-6ae2f067a079'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:54.377916 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6c873e18-7237-4ff5-93f1-6ae2f067a079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '459bd486ac0d4132a44a1bc5096742d1', 'request_id': 'req-6c873e18-7237-4ff5-93f1-6ae2f067a079'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:54.389225 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6c873e18-7237-4ff5-93f1-6ae2f067a079 admin admin] The token cache is being invalidate because project 459bd486ac0d4132a44a1bc5096742d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:32:54.389536 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6c873e18-7237-4ff5-93f1-6ae2f067a079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:54.390166 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-6c873e18-7237-4ff5-93f1-6ae2f067a079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:54.391657 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1475/2896] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:32:54 2022] DELETE /identity/v3/projects/459bd486ac0d4132a44a1bc5096742d1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:32:54.397548 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9178167-4a71-4771-8c06-b0e4178e836b None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:54.397840 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9178167-4a71-4771-8c06-b0e4178e836b None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:54.398143 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9178167-4a71-4771-8c06-b0e4178e836b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:54.419164 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-d9178167-4a71-4771-8c06-b0e4178e836b None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:54.420636 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-d9178167-4a71-4771-8c06-b0e4178e836b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:54.479012 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1422/2897] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:32:54.487042 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69af41-0161-406e-abcc-1bef3f85dbc9 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:54.487326 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69af41-0161-406e-abcc-1bef3f85dbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:54.487625 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69af41-0161-406e-abcc-1bef3f85dbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:54.509712 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-be69af41-0161-406e-abcc-1bef3f85dbc9 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:54.510966 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-be69af41-0161-406e-abcc-1bef3f85dbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:54.518830 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1476/2898] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:32:54.523048 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9178167-4a71-4771-8c06-b0e4178e836b None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:54.532580 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9178167-4a71-4771-8c06-b0e4178e836b None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:54.537202 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1db40-a4da-446f-86ff-52211f6976c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:54.537823 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1db40-a4da-446f-86ff-52211f6976c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:54.538108 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1db40-a4da-446f-86ff-52211f6976c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:54.538372 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1db40-a4da-446f-86ff-52211f6976c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:54.539004 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1db40-a4da-446f-86ff-52211f6976c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:32:54.539301 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1db40-a4da-446f-86ff-52211f6976c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:54.542398 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1db40-a4da-446f-86ff-52211f6976c9 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:54.554224 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1423/2899] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:32:54.559298 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69af41-0161-406e-abcc-1bef3f85dbc9 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:54.568441 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69af41-0161-406e-abcc-1bef3f85dbc9 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:54.573161 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc849b-158b-4195-9aae-00813a868d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:54.573782 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc849b-158b-4195-9aae-00813a868d39 admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:54.574060 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc849b-158b-4195-9aae-00813a868d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:54.574330 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc849b-158b-4195-9aae-00813a868d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:54.574959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc849b-158b-4195-9aae-00813a868d39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:54.576848 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc849b-158b-4195-9aae-00813a868d39 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:54.677047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1477/2900] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:32:54 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:32:54.681296 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1db40-a4da-446f-86ff-52211f6976c9 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:54.691467 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1db40-a4da-446f-86ff-52211f6976c9 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:54.717236 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:54.747544 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41946dd-47b5-44cd-8b78-67139fb27094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:54.748077 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41946dd-47b5-44cd-8b78-67139fb27094 admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:54.748359 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41946dd-47b5-44cd-8b78-67139fb27094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:54.748631 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41946dd-47b5-44cd-8b78-67139fb27094 admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:54.749246 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41946dd-47b5-44cd-8b78-67139fb27094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:54.751201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41946dd-47b5-44cd-8b78-67139fb27094 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:54.859030 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1424/2901] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:32:54 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 19:32:54.863368 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc849b-158b-4195-9aae-00813a868d39 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:54.873720 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc849b-158b-4195-9aae-00813a868d39 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:54.878345 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec21a0-3f10-4cd9-a928-ee049dec76bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:54.878935 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec21a0-3f10-4cd9-a928-ee049dec76bf admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:54.879214 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec21a0-3f10-4cd9-a928-ee049dec76bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:54.879482 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec21a0-3f10-4cd9-a928-ee049dec76bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:54.880163 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec21a0-3f10-4cd9-a928-ee049dec76bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:54.881786 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec21a0-3f10-4cd9-a928-ee049dec76bf admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:54.891505 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1478/2902] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:32:54.895343 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41946dd-47b5-44cd-8b78-67139fb27094 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:54.905648 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41946dd-47b5-44cd-8b78-67139fb27094 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:54.910201 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b857af1-3d23-439a-bc97-7edf6f1f0a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:54.910786 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b857af1-3d23-439a-bc97-7edf6f1f0a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:54.911062 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b857af1-3d23-439a-bc97-7edf6f1f0a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:54.911328 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b857af1-3d23-439a-bc97-7edf6f1f0a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:54.911986 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b857af1-3d23-439a-bc97-7edf6f1f0a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:54.913591 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b857af1-3d23-439a-bc97-7edf6f1f0a12 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:54.924732 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1425/2903] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:32:54.930310 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec21a0-3f10-4cd9-a928-ee049dec76bf admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:54.940488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec21a0-3f10-4cd9-a928-ee049dec76bf admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:54.945151 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dc807-e122-488d-b351-1c459ede86e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:54.945957 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc807-e122-488d-b351-1c459ede86e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:54.946244 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc807-e122-488d-b351-1c459ede86e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:54.946517 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc807-e122-488d-b351-1c459ede86e5 admin admin] PATH_INFO: `/v3/projects/209d8dc88bb143c594fb58d317beb359/users/e6b2942796264be69981636f39107a48/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:54.948747 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:54.963094 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948dc807-e122-488d-b351-1c459ede86e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=209d8dc88bb143c594fb58d317beb359, user_id=e6b2942796264be69981636f39107a48, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:54.965900 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948dc807-e122-488d-b351-1c459ede86e5 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:55.046524 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1479/2904] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:32:54 2022] PUT /identity/v3/projects/209d8dc88bb143c594fb58d317beb359/users/e6b2942796264be69981636f39107a48/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:32:55.057380 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb08a03-b828-43bc-aae4-e31504ff3d4e None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:55.060062 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb08a03-b828-43bc-aae4-e31504ff3d4e None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:55.060062 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb08a03-b828-43bc-aae4-e31504ff3d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:55.085252 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-9cb08a03-b828-43bc-aae4-e31504ff3d4e None None] MFA Rules not processed for user `e6b2942796264be69981636f39107a48`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:55.088696 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-9cb08a03-b828-43bc-aae4-e31504ff3d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:55.149554 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1426/2905] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:32:55.160654 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dc807-e122-488d-b351-1c459ede86e5 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:55.162386 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-948dc807-e122-488d-b351-1c459ede86e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:55.218597 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dc807-e122-488d-b351-1c459ede86e5 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:55.222200 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c329ed8-3a1b-42de-9207-316a4212f9dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bca1eca610c64b3a8ab04792dcca18b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:55.222793 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c329ed8-3a1b-42de-9207-316a4212f9dd service cinder] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:55.223071 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c329ed8-3a1b-42de-9207-316a4212f9dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:55.223341 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c329ed8-3a1b-42de-9207-316a4212f9dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:55.231297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c329ed8-3a1b-42de-9207-316a4212f9dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:55.232715 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c329ed8-3a1b-42de-9207-316a4212f9dd service cinder] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:55.241380 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1480/2906] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:32:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:32:55.260496 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb08a03-b828-43bc-aae4-e31504ff3d4e None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:55.319908 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb08a03-b828-43bc-aae4-e31504ff3d4e None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:55.325023 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada89da3-e01d-4b05-a442-958f5f1aaea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:55.325663 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada89da3-e01d-4b05-a442-958f5f1aaea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:55.325939 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada89da3-e01d-4b05-a442-958f5f1aaea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:55.326207 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada89da3-e01d-4b05-a442-958f5f1aaea8 admin admin] PATH_INFO: `/v3/users/e6b2942796264be69981636f39107a48` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:55.327319 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada89da3-e01d-4b05-a442-958f5f1aaea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b2942796264be69981636f39107a48)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:55.329223 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada89da3-e01d-4b05-a442-958f5f1aaea8 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:55.512090 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:55.518203 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ada89da3-e01d-4b05-a442-958f5f1aaea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b2942796264be69981636f39107a48'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:55.525618 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ada89da3-e01d-4b05-a442-958f5f1aaea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b2942796264be69981636f39107a48'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:55.526297 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ada89da3-e01d-4b05-a442-958f5f1aaea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b2942796264be69981636f39107a48'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:55.526927 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ada89da3-e01d-4b05-a442-958f5f1aaea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b2942796264be69981636f39107a48'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:55.572228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-ada89da3-e01d-4b05-a442-958f5f1aaea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b2942796264be69981636f39107a48'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:55.590433 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1427/2907] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:32:55 2022] DELETE /identity/v3/users/e6b2942796264be69981636f39107a48 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:32:55.594909 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37267c-6f72-4be9-b2af-1bc6a8ec4c68 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:55.595195 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37267c-6f72-4be9-b2af-1bc6a8ec4c68 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:55.595469 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37267c-6f72-4be9-b2af-1bc6a8ec4c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:55.614568 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-bf37267c-6f72-4be9-b2af-1bc6a8ec4c68 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:55.615765 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bf37267c-6f72-4be9-b2af-1bc6a8ec4c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:55.673556 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1481/2908] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:32:55.683334 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada89da3-e01d-4b05-a442-958f5f1aaea8 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:55.684818 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ada89da3-e01d-4b05-a442-958f5f1aaea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:55.741890 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada89da3-e01d-4b05-a442-958f5f1aaea8 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:55.745893 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a212b-8941-4984-9d26-4a8a82f1c309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:55.746497 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a212b-8941-4984-9d26-4a8a82f1c309 service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:55.746776 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a212b-8941-4984-9d26-4a8a82f1c309 service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:55.747047 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a212b-8941-4984-9d26-4a8a82f1c309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:55.756104 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a212b-8941-4984-9d26-4a8a82f1c309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:55.757570 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a212b-8941-4984-9d26-4a8a82f1c309 service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:55.767635 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1428/2909] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:32:56.140521 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37267c-6f72-4be9-b2af-1bc6a8ec4c68 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:56.142047 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-bf37267c-6f72-4be9-b2af-1bc6a8ec4c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:56.154601 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37267c-6f72-4be9-b2af-1bc6a8ec4c68 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:56.159297 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36334531-ce30-4b52-9d90-7b110ea8d646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:56.159929 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36334531-ce30-4b52-9d90-7b110ea8d646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:56.160206 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36334531-ce30-4b52-9d90-7b110ea8d646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:56.160532 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36334531-ce30-4b52-9d90-7b110ea8d646 admin admin] PATH_INFO: `/v3/projects/209d8dc88bb143c594fb58d317beb359` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:56.161698 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36334531-ce30-4b52-9d90-7b110ea8d646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=209d8dc88bb143c594fb58d317beb359)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:56.163609 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36334531-ce30-4b52-9d90-7b110ea8d646 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:56.259201 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-36334531-ce30-4b52-9d90-7b110ea8d646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209d8dc88bb143c594fb58d317beb359', 'request_id': 'req-36334531-ce30-4b52-9d90-7b110ea8d646'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:56.264505 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-36334531-ce30-4b52-9d90-7b110ea8d646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209d8dc88bb143c594fb58d317beb359', 'request_id': 'req-36334531-ce30-4b52-9d90-7b110ea8d646'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:56.314955 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-36334531-ce30-4b52-9d90-7b110ea8d646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209d8dc88bb143c594fb58d317beb359', 'request_id': 'req-36334531-ce30-4b52-9d90-7b110ea8d646'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:56.326661 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-36334531-ce30-4b52-9d90-7b110ea8d646 admin admin] The token cache is being invalidate because project 209d8dc88bb143c594fb58d317beb359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:32:56.329411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-36334531-ce30-4b52-9d90-7b110ea8d646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:56.329411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-36334531-ce30-4b52-9d90-7b110ea8d646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:32:56.329411 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1482/2910] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:32:56 2022] DELETE /identity/v3/projects/209d8dc88bb143c594fb58d317beb359 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:32:56.333954 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28692cbe-f3fa-4353-b32e-d634cfd1e461 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:56.334244 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28692cbe-f3fa-4353-b32e-d634cfd1e461 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:56.334519 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28692cbe-f3fa-4353-b32e-d634cfd1e461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:56.354228 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-28692cbe-f3fa-4353-b32e-d634cfd1e461 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:56.355422 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-28692cbe-f3fa-4353-b32e-d634cfd1e461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:56.413204 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1429/2911] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:32:56.421350 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb15838-fb8e-4f4d-9368-55f6074f68d5 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:56.421663 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb15838-fb8e-4f4d-9368-55f6074f68d5 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:56.421936 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb15838-fb8e-4f4d-9368-55f6074f68d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:56.441793 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-1cb15838-fb8e-4f4d-9368-55f6074f68d5 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:56.446646 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-1cb15838-fb8e-4f4d-9368-55f6074f68d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:56.451444 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1483/2912] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:32:56.456045 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28692cbe-f3fa-4353-b32e-d634cfd1e461 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:56.466539 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28692cbe-f3fa-4353-b32e-d634cfd1e461 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:56.471296 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed57cf-98dc-4a2f-a661-6534a151df82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:56.478273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed57cf-98dc-4a2f-a661-6534a151df82 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:56.478273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed57cf-98dc-4a2f-a661-6534a151df82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:56.478273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed57cf-98dc-4a2f-a661-6534a151df82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:56.478273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed57cf-98dc-4a2f-a661-6534a151df82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80523) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 19:32:56.478273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed57cf-98dc-4a2f-a661-6534a151df82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:56.478273 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed57cf-98dc-4a2f-a661-6534a151df82 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:56.487038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1430/2913] 10.222.0.65 () {58 vars in 1153 bytes} [Tue Aug 9 19:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 19:32:56.491460 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb15838-fb8e-4f4d-9368-55f6074f68d5 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:56.496593 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:56.501932 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb15838-fb8e-4f4d-9368-55f6074f68d5 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:56.507100 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3cc88-ee50-460d-9e68-c77ee3dba6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:56.507774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3cc88-ee50-460d-9e68-c77ee3dba6de admin admin] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:56.507774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3cc88-ee50-460d-9e68-c77ee3dba6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:56.507774 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3cc88-ee50-460d-9e68-c77ee3dba6de admin admin] PATH_INFO: `/v3/projects` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:56.508959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3cc88-ee50-460d-9e68-c77ee3dba6de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:56.510913 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3cc88-ee50-460d-9e68-c77ee3dba6de admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:56.593577 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1484/2914] 10.222.0.65 () {60 vars in 1153 bytes} [Tue Aug 9 19:32:56 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:32:56.596996 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed57cf-98dc-4a2f-a661-6534a151df82 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:56.607637 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed57cf-98dc-4a2f-a661-6534a151df82 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:56.655411 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:32:56.668483 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf855f92-af78-4d52-b0fd-14cd42b0983e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:56.669033 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf855f92-af78-4d52-b0fd-14cd42b0983e admin admin] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:56.669314 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf855f92-af78-4d52-b0fd-14cd42b0983e admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:56.669623 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf855f92-af78-4d52-b0fd-14cd42b0983e admin admin] PATH_INFO: `/v3/users` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:56.670583 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf855f92-af78-4d52-b0fd-14cd42b0983e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:56.672534 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf855f92-af78-4d52-b0fd-14cd42b0983e admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:56.835402 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1431/2915] 10.222.0.65 () {60 vars in 1144 bytes} [Tue Aug 9 19:32:56 2022] POST /identity/v3/users => generated 284 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 19:32:56.840085 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3cc88-ee50-460d-9e68-c77ee3dba6de admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:56.850057 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3cc88-ee50-460d-9e68-c77ee3dba6de admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:56.855643 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2068354-d54f-409f-b6b1-6b294995501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:56.857664 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2068354-d54f-409f-b6b1-6b294995501a admin admin] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:56.857664 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2068354-d54f-409f-b6b1-6b294995501a admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:56.857664 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2068354-d54f-409f-b6b1-6b294995501a admin admin] PATH_INFO: `/v3/roles` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:56.857664 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2068354-d54f-409f-b6b1-6b294995501a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:56.859120 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2068354-d54f-409f-b6b1-6b294995501a admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:56.869754 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1485/2916] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:32:56.873993 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf855f92-af78-4d52-b0fd-14cd42b0983e admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:56.884802 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf855f92-af78-4d52-b0fd-14cd42b0983e admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:56.889406 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c7abb-7373-446a-9d9e-70742796a8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:56.890030 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c7abb-7373-446a-9d9e-70742796a8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:56.890313 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c7abb-7373-446a-9d9e-70742796a8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:56.890584 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c7abb-7373-446a-9d9e-70742796a8d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:56.891279 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c7abb-7373-446a-9d9e-70742796a8d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:56.892871 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c7abb-7373-446a-9d9e-70742796a8d6 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:56.905436 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1432/2917] 10.222.0.65 () {58 vars in 1122 bytes} [Tue Aug 9 19:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 19:32:56.909745 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2068354-d54f-409f-b6b1-6b294995501a admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:56.920803 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2068354-d54f-409f-b6b1-6b294995501a admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:56.925212 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760ca00-521e-40d3-a0d1-c4b8391e8fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:56.925930 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ca00-521e-40d3-a0d1-c4b8391e8fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:56.926203 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ca00-521e-40d3-a0d1-c4b8391e8fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:56.926468 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ca00-521e-40d3-a0d1-c4b8391e8fd7 admin admin] PATH_INFO: `/v3/projects/f224bcd44c8a4ced96bbbd1f3db5581b/users/df57d79148034c33920dfaff8513f062/roles/ead9959857d24ec6bea3b7556da18ce5` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:56.940873 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760ca00-521e-40d3-a0d1-c4b8391e8fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f224bcd44c8a4ced96bbbd1f3db5581b, user_id=df57d79148034c33920dfaff8513f062, role_id=ead9959857d24ec6bea3b7556da18ce5)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:56.943606 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760ca00-521e-40d3-a0d1-c4b8391e8fd7 admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:57.034963 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1486/2918] 10.222.0.65 () {60 vars in 1483 bytes} [Tue Aug 9 19:32:56 2022] PUT /identity/v3/projects/f224bcd44c8a4ced96bbbd1f3db5581b/users/df57d79148034c33920dfaff8513f062/roles/ead9959857d24ec6bea3b7556da18ce5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 19:32:57.047107 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caadf2-f256-4d59-853c-b8bafa114957 None None] REQUEST_METHOD: `POST` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:57.047393 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caadf2-f256-4d59-853c-b8bafa114957 None None] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:57.047664 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caadf2-f256-4d59-853c-b8bafa114957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:57.075931 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.auth.core [None req-60caadf2-f256-4d59-853c-b8bafa114957 None None] MFA Rules not processed for user `df57d79148034c33920dfaff8513f062`. Rule list: `[]` (Enabled: `True`). {{(pid=80523) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:32:57.077149 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-60caadf2-f256-4d59-853c-b8bafa114957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:57.139206 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1433/2919] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:32:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:32:57.151870 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760ca00-521e-40d3-a0d1-c4b8391e8fd7 admin admin] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:32:57.153619 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-f760ca00-521e-40d3-a0d1-c4b8391e8fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:32:57.229973 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760ca00-521e-40d3-a0d1-c4b8391e8fd7 admin admin] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:32:57.233623 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763a77e-683a-47df-8aca-c36f3cd16e65 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98d8000eb20445b78ee56ac372cd024c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:32:57.234213 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763a77e-683a-47df-8aca-c36f3cd16e65 service glance] REQUEST_METHOD: `GET` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:32:57.234488 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763a77e-683a-47df-8aca-c36f3cd16e65 service glance] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:32:57.234755 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763a77e-683a-47df-8aca-c36f3cd16e65 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:32:57.243114 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763a77e-683a-47df-8aca-c36f3cd16e65 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:32:57.244545 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763a77e-683a-47df-8aca-c36f3cd16e65 service glance] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:32:57.253391 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1487/2920] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:32:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:33:07.136369 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:33:07.249623 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=58,keystone:INSERT=2 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:33:28.889420 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caadf2-f256-4d59-853c-b8bafa114957 None None] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:33:28.951431 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caadf2-f256-4d59-853c-b8bafa114957 None None] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:33:28.955874 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65f9ad-86a6-4ee0-82cb-b544c40da631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:33:28.956497 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65f9ad-86a6-4ee0-82cb-b544c40da631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:33:28.956778 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65f9ad-86a6-4ee0-82cb-b544c40da631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:33:28.957052 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65f9ad-86a6-4ee0-82cb-b544c40da631 admin admin] PATH_INFO: `/v3/users/df57d79148034c33920dfaff8513f062` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:33:28.958207 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65f9ad-86a6-4ee0-82cb-b544c40da631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df57d79148034c33920dfaff8513f062)` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:33:28.960901 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65f9ad-86a6-4ee0-82cb-b544c40da631 admin admin] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:33:29.145447 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5b65f9ad-86a6-4ee0-82cb-b544c40da631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df57d79148034c33920dfaff8513f062'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:33:29.152917 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5b65f9ad-86a6-4ee0-82cb-b544c40da631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df57d79148034c33920dfaff8513f062'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:33:29.153606 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5b65f9ad-86a6-4ee0-82cb-b544c40da631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df57d79148034c33920dfaff8513f062'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:33:29.154215 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5b65f9ad-86a6-4ee0-82cb-b544c40da631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df57d79148034c33920dfaff8513f062'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:33:29.195125 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.notifications [None req-5b65f9ad-86a6-4ee0-82cb-b544c40da631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df57d79148034c33920dfaff8513f062'} {{(pid=80523) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:33:29.212530 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1434/2921] 10.222.0.65 () {58 vars in 1224 bytes} [Tue Aug 9 19:33:28 2022] DELETE /identity/v3/users/df57d79148034c33920dfaff8513f062 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:33:29.217055 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f52c7c-8497-4737-b457-0b9f9f70b5f0 None None] REQUEST_METHOD: `POST` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:33:29.217566 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f52c7c-8497-4737-b457-0b9f9f70b5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:33:29.217685 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f52c7c-8497-4737-b457-0b9f9f70b5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:33:29.236225 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.auth.core [None req-d9f52c7c-8497-4737-b457-0b9f9f70b5f0 None None] MFA Rules not processed for user `de54cc4aa2214403a8d5cfbff5af1478`. Rule list: `[]` (Enabled: `True`). {{(pid=80524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 19:33:29.237413 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d9f52c7c-8497-4737-b457-0b9f9f70b5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:33:29.293230 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1488/2922] 10.222.0.65 () {58 vars in 958 bytes} [Tue Aug 9 19:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 19:33:29.303182 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65f9ad-86a6-4ee0-82cb-b544c40da631 admin admin] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:33:29.305410 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-5b65f9ad-86a6-4ee0-82cb-b544c40da631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:33:29.362528 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65f9ad-86a6-4ee0-82cb-b544c40da631 admin admin] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:33:29.366893 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8294bc-8500-4271-989b-8ee3a7b908bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62d954163ca4bf298f461b4d253269e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:33:29.367500 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8294bc-8500-4271-989b-8ee3a7b908bc service neutron] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:33:29.367784 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8294bc-8500-4271-989b-8ee3a7b908bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:33:29.368058 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8294bc-8500-4271-989b-8ee3a7b908bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:33:29.376850 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8294bc-8500-4271-989b-8ee3a7b908bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:33:29.378329 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8294bc-8500-4271-989b-8ee3a7b908bc service neutron] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:33:29.388191 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1435/2923] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:33:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:33:29.767834 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f52c7c-8497-4737-b457-0b9f9f70b5f0 None None] Authenticating user token {{(pid=80524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:33:29.769306 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.fernet_utils [None req-d9f52c7c-8497-4737-b457-0b9f9f70b5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:33:29.781509 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f52c7c-8497-4737-b457-0b9f9f70b5f0 None None] Validating token access rules against request {{(pid=80524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:33:29.786118 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241037ba-ff82-4258-abd1-24ee0615241f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de54cc4aa2214403a8d5cfbff5af1478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f9bf2f261408aa0230daf03acb9d1', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:33:29.786766 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241037ba-ff82-4258-abd1-24ee0615241f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:33:29.787034 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241037ba-ff82-4258-abd1-24ee0615241f admin admin] SCRIPT_NAME: `/identity` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:33:29.787308 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241037ba-ff82-4258-abd1-24ee0615241f admin admin] PATH_INFO: `/v3/projects/f224bcd44c8a4ced96bbbd1f3db5581b` {{(pid=80524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:33:29.789238 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241037ba-ff82-4258-abd1-24ee0615241f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f224bcd44c8a4ced96bbbd1f3db5581b)` {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:33:29.791210 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241037ba-ff82-4258-abd1-24ee0615241f admin admin] RBAC: Authorization granted {{(pid=80524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:33:29.880840 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-241037ba-ff82-4258-abd1-24ee0615241f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f224bcd44c8a4ced96bbbd1f3db5581b', 'request_id': 'req-241037ba-ff82-4258-abd1-24ee0615241f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:33:29.886544 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-241037ba-ff82-4258-abd1-24ee0615241f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f224bcd44c8a4ced96bbbd1f3db5581b', 'request_id': 'req-241037ba-ff82-4258-abd1-24ee0615241f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:33:29.955102 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-241037ba-ff82-4258-abd1-24ee0615241f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f224bcd44c8a4ced96bbbd1f3db5581b', 'request_id': 'req-241037ba-ff82-4258-abd1-24ee0615241f'} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:33:29.966572 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-241037ba-ff82-4258-abd1-24ee0615241f admin admin] The token cache is being invalidate because project f224bcd44c8a4ced96bbbd1f3db5581b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 19:33:29.967551 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-241037ba-ff82-4258-abd1-24ee0615241f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:33:29.967551 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG keystone.notifications [None req-241037ba-ff82-4258-abd1-24ee0615241f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 19:33:29.968959 dv-cinder-852654-1-smb devstack@keystone.service[80524]: [pid: 80524|app: 0|req: 1489/2924] 10.222.0.65 () {58 vars in 1233 bytes} [Tue Aug 9 19:33:29 2022] DELETE /identity/v3/projects/f224bcd44c8a4ced96bbbd1f3db5581b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 19:33:39.384067 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:33:39.963772 dv-cinder-852654-1-smb devstack@keystone.service[80524]: DEBUG dbcounter [-] [80524] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:37:03.694632 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8294bc-8500-4271-989b-8ee3a7b908bc service neutron] Authenticating user token {{(pid=80523) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 19:37:03.696038 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-8a8294bc-8500-4271-989b-8ee3a7b908bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:37:03.832947 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8294bc-8500-4271-989b-8ee3a7b908bc service neutron] Validating token access rules against request {{(pid=80523) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 19:37:03.890269 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfc865-f875-4e49-bdcb-c484dac5e77a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6172f0733384291992624ef6a527ea2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c90c37ebe7a44ad2a10a9d2b5a1e2ec8', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80523) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 19:37:03.890872 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfc865-f875-4e49-bdcb-c484dac5e77a service placement] REQUEST_METHOD: `GET` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 19:37:03.891150 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfc865-f875-4e49-bdcb-c484dac5e77a service placement] SCRIPT_NAME: `/identity` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 19:37:03.891421 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfc865-f875-4e49-bdcb-c484dac5e77a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80523) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 19:37:03.893115 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.fernet_utils [None req-ecdfc865-f875-4e49-bdcb-c484dac5e77a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80523) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 19:37:03.904081 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfc865-f875-4e49-bdcb-c484dac5e77a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 19:37:03.905685 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfc865-f875-4e49-bdcb-c484dac5e77a service placement] RBAC: Authorization granted {{(pid=80523) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 19:37:03.915317 dv-cinder-852654-1-smb devstack@keystone.service[80523]: [pid: 80523|app: 0|req: 1436/2925] 10.222.0.65 () {60 vars in 1365 bytes} [Tue Aug 9 19:37:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 19:37:13.911190 dv-cinder-852654-1-smb devstack@keystone.service[80523]: DEBUG dbcounter [-] [80523] Writing DB stats keystone:SELECT=89 {{(pid=80523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}